How I Programmed My AI Vtuber

Поделиться
HTML-код
  • Опубликовано: 27 окт 2024

Комментарии • 236

  • @SchizoDev
    @SchizoDev  Год назад +121

    Thank you for watching!
    If you are trying out the program and have some issues, please open up an issue over at github instead of here at youtube. github.com/Koischizo/AI-Vtuber/issues
    Thanks.

    • @ImPossiblyElgia
      @ImPossiblyElgia Год назад +1

      This is a phenomenal video, and has inspired me to add on to this AI and really make it my own! The only problem is I have never coded in my life, and have no idea where to start. Any advice on a good place to start would be appreciated :)

    • @Meleeman011
      @Meleeman011 Год назад +1

      looks liek a great start, kinda wanna try llama tho, i'll probably write a similar solution to yours

    • @shanonsun8538
      @shanonsun8538 Год назад

      how'd you get this on a chrome book lol im too broke to even afford a 1 cent computer

    • @TwintailsVtuber
      @TwintailsVtuber Год назад

      @@ImPossiblyElgia hey, did you progress through the github stuff? I'm also in the same boat haha

    • @michelle8805
      @michelle8805 Год назад

      Hello, I don't want to use eleven labs, so I want to modify the pyttx3 voice to Spanish but I don't know how to make this change, I would appreciate your help

  • @asddsa8203
    @asddsa8203 Год назад +280

    This madlad is making AI waifus real

    • @shaneknight1489
      @shaneknight1489 Год назад +2

      I would join his team and let him be my mentor/teammate. It would be nice to work with him

  • @NikodemCh.
    @NikodemCh. Год назад +24

    thank you for your kindness ,sir

  • @BM-13_KATYUSHA
    @BM-13_KATYUSHA Год назад +15

    "Touhou is space invaders on crack."
    I have no objection.

  • @Mogo-jan
    @Mogo-jan Год назад +40

    The first depressed and toxic AI vtuber. Technology sure is amazing.

  • @junaidazam12
    @junaidazam12 Год назад +50

    Safe to say , our flesh tubers with extra steps are gonna be here for a little while longer . Banger tutorial video though , learnt some things and had a laugh too XD
    Edit : I called it in the last video , I knew you were a undercover Capipalist

  • @Hani-ni3ij
    @Hani-ni3ij Год назад +144

    I think another cool idea would be to make it a desktop application, like just having it on your computer so you can talk to it and it can find stuff or open stuff for you but thats another step that i dont even know if its possible to do, just like the MAID from Sakurasou if u know what i mean

    • @lunablossom5241
      @lunablossom5241 Год назад +3

      that'd be awesome

    • @veto_5762
      @veto_5762 Год назад +21

      ChatGPT can already search info for you and even more, it doesn't sound impossible having jarvis-like ai desktop assistants in the near future

    • @triangulartriangle
      @triangulartriangle Год назад

      ​@@veto_5762 jarvis, show me this guy's balls

    • @ernestw955
      @ernestw955 Год назад +2

      You just took the words of my mouth, wanted to create such an assistant recently and I don't see why it shouldn't be possible at current moment from the technical point of view. Using voice commands to do things on pc like opening some programs is not all that difficult. With gpt 4 it would be even possible to make screenshots of something and let the assistant analyze them for you by taking it from your clipboard.

  • @carlosa.a.1007
    @carlosa.a.1007 Год назад +7

    Jeez...
    The era of *true* virtual youtubers is looming, guys.
    Let's simp onto *programs* .

  • @VeryButtery
    @VeryButtery Год назад +5

    Yo this voice goes crazy too it’s so realistic

  • @transfaeries
    @transfaeries 8 месяцев назад +3

    This is exactly what I was looking for. An AITuber tutorial with an open source repository and a schizo loli. Perfect!

  • @ahmadmaulanai4843
    @ahmadmaulanai4843 Год назад +23

    Congratulations, hope you got interviews by vice,verge and thewired. Btw gpt-3 and elvenvoice can replace by anything as long it work

  • @SapphireYuna
    @SapphireYuna Год назад +3

    U just opened my eyes today.. I'M CREATING MY OWN AI VTUBER TODAY!

  • @shaneknight1489
    @shaneknight1489 Год назад +8

    I am trying your projects man. Can’t wait to see the final results

  • @NeuronSama
    @NeuronSama Год назад +56

    thank you for this, hope everyone can make their ai waifu soon

  • @feanixfukari
    @feanixfukari Год назад +1

    I love how to stopped "borrowing" towards the end of the project.

  • @pennyquintero2983
    @pennyquintero2983 Год назад +9

    Just what I was needing like 2 days ago. You just won me man. Keep the hard work!

  • @angelbird538
    @angelbird538 Год назад +3

    She is absolutely precious, I love her!

  • @vihj3645
    @vihj3645 Год назад +19

    I mean, you could try utilizing Pygmalion A.I, to say, circumvent some restrictions.
    Or just, increase the degree of customization for your A.I Vtuber.

  • @BrokeCopiat
    @BrokeCopiat Год назад +1

    amazing.. this will be nice to learn some new stuff. Thank you !

  • @draggador
    @draggador Год назад +1

    OMG; thanks a whole lot for sharing implementation details

  • @LandRiders7th
    @LandRiders7th Год назад +5

    This would be so helpful as I do have plans to create my own AI assistance for my live streams as well as handling workloads that require critical thinking and decision making plus more if it turns out this good at doing so.

  • @coperkk1077
    @coperkk1077 Год назад +3

    Nice video !! You give a dream to build the own AI Vtuber challenge ,Thx you I will try my best。

  • @peterxyz3541
    @peterxyz3541 Год назад +1

    Thank you, hilarious. I shall do this

  • @ronansorgdrager
    @ronansorgdrager Год назад +2

    can't stop focusing on the COM3D2 music lmao

    • @ronansorgdrager
      @ronansorgdrager Год назад

      especially when the fucking music came on at 8:18 holy shit

  • @BreadLoafs_1
    @BreadLoafs_1 Год назад +3

    How does this man ONLY HAVE 4.28k subs

  • @asddsa8203
    @asddsa8203 Год назад +2

    God there's so much fucking coding theft, I love it. Absolutely unhinged, schizophrenia/10

  • @IDiedInOsaka
    @IDiedInOsaka Год назад +3

    A hero we need but don't deserve.

  • @H0mework
    @H0mework Год назад +3

    I was *ahem* inspired by your code.

  • @Mochizuki031
    @Mochizuki031 Год назад +3

    I like her voice lowkey.

  • @TheJDMedia
    @TheJDMedia Год назад +2

    What a legend, thank you sir.

  • @rioharta526
    @rioharta526 Год назад +2

    amazing! thanks for sharing your knowledge sir!

    • @DeadMedia-vf4je
      @DeadMedia-vf4je 6 месяцев назад

      Yea but he sadly didn’t say where we can get the Koishi Fumo Model

  • @VeryButtery
    @VeryButtery Год назад +2

    I was thinking about doing this now that I find this will make everything way easier I don’t have to do hardly any code between this and other RUclips videos

  • @chill5783
    @chill5783 Год назад +2

    thank you so much schizophrenic developer!

  • @jacktherater3533
    @jacktherater3533 Год назад +1

    Ima gonna borrow your code.. and crank it to 11. Thank you vermuch for sharing

  • @EnuelZ
    @EnuelZ Год назад +2

    Me without knowledge of programming and limited english and free time: ok... I'll try

  • @seniormute2364
    @seniormute2364 Год назад +11

    This is amazing, but costly tho....in my country I cant even pay for the OAI text model unless I use a VPN witch translates to pay even more, because they simply don't have the option to let you pay...great project tho, i guess we have to wait for other free options

    • @ericcarvalhoferreira512
      @ericcarvalhoferreira512 Год назад +5

      The tor browser is a free vpn, you just have to get lucky to end up in a country you can pay in.

  • @Eltaurus
    @Eltaurus Год назад

    A very fine choice of music.
    I approb.

  • @EzoRedFox22
    @EzoRedFox22 Год назад +2

    we need more, maybe time for insane

  • @wikanz09
    @wikanz09 Год назад +8

    Great work on this, man
    I might want to try making some. But for me it's going to be a companion while I'm playing a game. Like the AI will comment on me and youtube chat.
    Keep those tutorial going, dude!

    • @ProjectAnjo
      @ProjectAnjo 6 месяцев назад

      Hey man!
      I thought about the same thing!
      You did it? It worked out? Any tips?

  • @mayzdev
    @mayzdev 8 месяцев назад

    just found this youtuber and i instantly will be subscribing

  • @Ilveilijalixiang
    @Ilveilijalixiang 2 месяца назад +1

    The Koishi made me click on this at lightspeed

  • @shadowdemonaer
    @shadowdemonaer Год назад +3

    We have more things now that can improve this. What about the new auto gpt? It could be used to improve the results even faster every day :) Quite frankly I can't wait to try this for myself and see how it goes.

  • @Sceptid
    @Sceptid Год назад +1

    I thought we would need at least 1 more year

  • @mevimavett
    @mevimavett Год назад

    Thank you comrade.

  • @SweetFacade
    @SweetFacade Год назад +10

    Could you make a version that’s more of a virtual assistant rather than streamer? It would be Siri 2.0 😂

    • @_EllieLOL_
      @_EllieLOL_ Год назад +5

      The Japanese already made one called Gatebox

    • @Alice_Fumo
      @Alice_Fumo Год назад +10

      it wouldn't be particularly hard to do this. Infact all you really have to do is to replace the youtube chat input with a text transcription input of your voice (use whisper locally or any of the cloud services for it) and maybe change the initial prompt a bit to make it somewhat less streamer and more helpful in terms of personality.

  • @polinskitom2277
    @polinskitom2277 Год назад +2

    that ending man, I still miss beatani

  • @mr.shgamingguy
    @mr.shgamingguy Год назад +2

    So cool

  • @glitchvapor513
    @glitchvapor513 Год назад +1

    This is really cool

  • @Abandex369
    @Abandex369 Год назад +1

    Creating my own gf assistant but replacing the AI bit with prewritten responses to better optimize and run locally so no glowies can spy on us 🤭

    • @Abandex369
      @Abandex369 6 месяцев назад

      I failed. OK I'm kms.

  • @Hectorreto
    @Hectorreto Год назад +2

    RUclips's algorithm is powerful

  • @MochaBeanOfficial
    @MochaBeanOfficial Год назад +1

    I'd love to be able to create one myself! But i have 0 coding skills, and it puts me off slightly...

  • @Dodogama-TW
    @Dodogama-TW 10 месяцев назад

    Thanks, I am a beginner, learned a lot from your video

  • @ronaldbordaje7460
    @ronaldbordaje7460 Год назад

    Hi sir I'm sorry i didn't see this video, thank you for the source ❤️❤️❤️

  • @Overneed-Belkan-Witch
    @Overneed-Belkan-Witch Год назад

    Teach me, Master, Sensei, Dean, Professor, Teacher,

  • @shiso6810
    @shiso6810 Год назад +3

    koishi is good and good and very good

  • @RiverSanzu01
    @RiverSanzu01 Год назад +3

    koish moo moo

  • @sanaan0168
    @sanaan0168 Год назад

    AI breaking there filters

  • @Solinaru
    @Solinaru 2 месяца назад +1

    im generally not a fan of AI, but love AI vtubers that are unhinged to the point were theyre both complaining about NGE and praising it for the same reasons. Like, perfect accuracy AI is a waste of tech when you can just make them into legit gremlins.

  • @WhaTheRohay
    @WhaTheRohay Год назад +45

    I appreciate the transparency to share your process on this interesting topic and even open a git repo. After deciding to go down the rabbit hole recently, I was disappointed when another guy seemed very hush hush about how he went about making his.

    • @john.darksoul
      @john.darksoul Год назад +17

      If you're talking about Vedal, it kinda makes sense for him to not open source his project since it's making him money
      I mean, people are probably gonna figure everything out eventually, let the guy enjoy his monopoly while he can, I think he earned it

    • @ronansorgdrager
      @ronansorgdrager Год назад +3

      @@john.darksoul i reckon that one day he'll open source it, maybe if he gets permabanned from twitch lmao

    • @Gr13fM4ch1n3
      @Gr13fM4ch1n3 Год назад

      @@john.darksoul He deserves the monopoly. He's such a gift to all of us. I love that man.

    • @jeffbrownstain
      @jeffbrownstain Год назад

      @@john.darksoul He would literally make more money by letting people help make Neuro better 😂

  • @gavinsepicgaming9835
    @gavinsepicgaming9835 7 месяцев назад +1

    NO NOT KOISHI SHE GONNA COMMIT WAR CRIMES ON LIVESTREAM
    insert uh KKHTA here or smth

    • @DeadMedia-vf4je
      @DeadMedia-vf4je 6 месяцев назад +1

      That’s a vary Heart Throbbing clam

  • @Slaash2105
    @Slaash2105 Год назад +4

    so is there a twitch version of this would love it

  • @tomonausagi3276
    @tomonausagi3276 Год назад +3

    Nice to see someone open-sourced an AI vtuber (unlike those another dude who uses Whisper and GPT-3 for his own AI). Not that it matters since I decide to follow yours instead. Cheers!

  • @Jim-qu6jr
    @Jim-qu6jr Месяц назад

    @SchizoDev You're the reason I'm learning python.

  • @yuugaming-ix6tc
    @yuugaming-ix6tc Год назад +12

    Thank you for making it possible to create my dream waifu! :) Since I'm a complete newb, I hope you can clarify a few things about this project.
    1) I've executed the file using the second livestream link to test, and I immediately noticed the A.I.'s responses are no where near the same.
    Is this because the A.I. still needs to be trained? If so, can you recommend a resource and instructions how to implement the trained data into this project?
    2) The TTS output is "very" rough. Is this purely a potato PC issue?
    Thanks ShizoDev for all your hard work. (づ ◕‿◕ )づ (づ ◕‿◕ )づ

    • @angryspearmen3614
      @angryspearmen3614 Год назад +2

      Do you tts function works first time?
      Mine is kinda stuck on "Permission denied" error while trying to load audio from responce

    • @timtvb7270
      @timtvb7270 Год назад +1

      @@angryspearmen3614 Same error pls tell me if u could fix it!!

    • @timtvb7270
      @timtvb7270 Год назад +2

      @@angryspearmen3614 Yeah i saw this already, it seemed more in depth but also harder, plus the google voice is kinda meh. Did this work for u??

    • @angryspearmen3614
      @angryspearmen3614 Год назад +2

      @@timtvb7270 Yes. But i used different voice site (I needed foreign language :D). It took some time

    • @timtvb7270
      @timtvb7270 Год назад +1

      @@angryspearmen3614 Wow thats sweet man! What tts did u use? Voicevox?

  • @ihatenamez
    @ihatenamez Год назад

    a step closer to future

  • @PrideSage99
    @PrideSage99 Год назад +3

    That is my daughter. I'm adopting her, nobody else can, end of story 🥺🥺🥺 ok?

  • @TMG_Dude
    @TMG_Dude Год назад +1

    *V-Tubers are just FleshTubers With Extra Steps*

    • @DeadMedia-vf4je
      @DeadMedia-vf4je 6 месяцев назад

      There 2 vary different things the only similarity’s is you need a Webcam
      That’s it

  • @Ataxs
    @Ataxs Год назад +1

    -9842 social credits, your execution is tommorow

  • @AhmiAhmer
    @AhmiAhmer 3 месяца назад

    This is a nice concept. I just have a few questions?
    1: Can this work with Twitch chat?
    2: Why you don't have many subscribers?

  • @TITCHY
    @TITCHY Год назад

    you are my new hero!!!!!!!!!!!!

  • @cositapoca2576
    @cositapoca2576 Год назад +2

    simple amazing, I have all set, I just have a doubt, where did you paste the converted to python code? It's giving me an error in line 15, the EL_voice line, I did something wrong for sure, thanks a lot, let's the real vtubers revolution begin!!!!!!

  • @KurtStaInes
    @KurtStaInes Год назад +1

    Can she Run with PygmalionAI ? but that would probably make her cursed .

  • @millyawns
    @millyawns Год назад

    Hey that's a GPD WIN MAX! I have one of those!!

  • @ImmortalAbsol
    @ImmortalAbsol Год назад

    I've never seen a laptop with analogue sticks and a d-pad

  • @Karagee2
    @Karagee2 Год назад +3

    Hold up...
    I hear a certain tunes...
    one does not belong in SFW video
    Also, don't abuse your meidos

  • @angryspearmen3614
    @angryspearmen3614 Год назад +6

    "I have a date with my girls"
    Oh no...
    But also thank you! That's really inspiering

    • @angryspearmen3614
      @angryspearmen3614 Год назад

      So um... i tried it. And it actually works! ... for the chat part. When it tries to execute tts() function I got:
      "PermissionError: [Errno 13] Permission denied: 'C:\\Users\\CD86~1\\AppData\\Local\\Temp\\tmpy5oeix9k.wav"
      Any collegues know how to fix that?

    • @angryspearmen3614
      @angryspearmen3614 Год назад

      Just rewatched the video and saw that this part of code was written with chatGPT. Oh no...

    • @SchizoDev
      @SchizoDev  Год назад +1

      Should be fixed, git pull and then reinstall the dependencies from the requirements.txt

  • @dud5682
    @dud5682 Год назад +1

    i love ur content

  • @oppaidah
    @oppaidah Год назад +10

    She sounds way more natural than Neuro

  • @gamefeel964
    @gamefeel964 Год назад +4

    Would it be possible to make it run locally without services that require internet? Would it also be possible to give her computer vision?

  • @LeafYin
    @LeafYin Год назад

    That's so cool

  • @satorusuzuki7371
    @satorusuzuki7371 Год назад +1

    Thanks a lot man. btw Can u tell me which virtual camera you were using to move her head,streaming other stuff for A.I. vtuber streaer set? And can you give me that link of the repository? Would really appreciate your help

  • @sigmundfraud7068
    @sigmundfraud7068 Год назад +1

    Neurosama collab when?

  • @M65V19
    @M65V19 Год назад

    I am in da video!

  • @mckelepic
    @mckelepic Год назад

    amazing

  • @peterpoppanda879
    @peterpoppanda879 7 дней назад

    im one year late to the competition but imma go ahead and program myself a 2B who will respond (hopefully) to my voice so I finally have someone to talk to. Im hobbyless

  • @polecat3
    @polecat3 Год назад

    fleshtubers with extra steps lol

    • @DeadMedia-vf4je
      @DeadMedia-vf4je 6 месяцев назад

      There 2 things with the only similarities is that you need a Webcam
      That’s if

  • @ryuk407
    @ryuk407 Год назад

    97% CPU, I can feel it bro😔😔😔

  • @evieyorisou2586
    @evieyorisou2586 Год назад +1

    So modified the code should monitor both RUclips API and twitch API I've also added expressions to show emotions the only thing I'm having trouble with is the 11 Labs API I can't get her to respond correctly with the TTS

    • @bel5578
      @bel5578 Год назад

      Where did you add the twitch api and token in the code? Tried for both this one and the awdii ai but nothing works so far.

    • @evieyorisou2586
      @evieyorisou2586 Год назад

      It's under config line 8 between nickname and user. It says token

    • @bel5578
      @bel5578 Год назад

      @@evieyorisou2586 Weird I cant seem to figure out where to add twitch token and api requests without the pytchat constantly requesting an ID.

    • @twelvyvisionz7637
      @twelvyvisionz7637 Год назад

      @@bel5578 You ever get the Twitch part to work? I've been searching all day

  • @OsrNumero35
    @OsrNumero35 Год назад +2

    Thanks, its possible to use GPT 3.5 or 4? Or use custom voices?

  • @Sanyaai
    @Sanyaai Год назад +1

    Im having one trouble man my program is working totally fine just somewhere have problem in audio or maybe im not good at doing settings so its actually generating text but not talking and not moving lips also and pls tell which software you are using for streaming ?

  • @thetulipjani
    @thetulipjani 2 месяца назад

    ily

  • @arufianz
    @arufianz Год назад

    1:36 Gura: bruhhh

  • @niggyshiggy
    @niggyshiggy Год назад

    ara ara

  • @DeadMedia-vf4je
    @DeadMedia-vf4je 6 месяцев назад +1

    Can you leave a link for the VTuber Model you use?
    I don’t know where to get it as it looks really cute

  • @angrybirds902
    @angrybirds902 4 месяца назад +1

    is that a cm3d2 soundtrack

  • @潘傑德
    @潘傑德 Год назад +1

    This is amazing,but can I ask a question?Is it counts the TTS's word number as I'm using AI?Because it has a limit amount right?I'm using free now,so I'm worried.

  • @notChocoMilk
    @notChocoMilk Год назад

    no way, koishi vtuber

  • @bonedboss
    @bonedboss Год назад

    Thanks for the effort, I'll try to see if I can run the ai, I only need to install the programs that notepad says?

  • @raspberries2042
    @raspberries2042 Год назад

    Neuro-sama 2.0

  • @IDKMANTECH
    @IDKMANTECH Год назад

    I need it