Automatic lip-sync source code released! (lazykh walkthrough tutorial)

Поделиться
HTML-код
  • Опубликовано: 14 окт 2024

Комментарии • 411

  • @ardentofzeal6244
    @ardentofzeal6244 2 года назад +458

    Mad respect for making your code available ❤️

    • @abjw
      @abjw 2 года назад +5

      @Gray Man 🅥 bruh imagine advertising

    • @ivywt
      @ivywt 2 года назад +3

      @Gray Man 🅥 literally stop bruh

    • @_general_error
      @_general_error 2 года назад

      Ha.. we should automate the whole process...

    • @mathshouldntdie000epic
      @mathshouldntdie000epic Год назад

      ​@@_general_errorI agree

  • @codenamelambda
    @codenamelambda 2 года назад +204

    Two things:
    1. considering the things you've explained, this does look like it should work on Linux pretty with only minimal changes, especially because gentle works well enough in a docker container in my experience
    2. 17:40 this is because your terminal isn't wide enough for the whole line, and since iirc (I could be wrong) it literally just outputs
    to rewind the line to the beginning, meaning that if there *was* a line break because a line was too long, it won't rewind far enough

    • @RobinHagg
      @RobinHagg 2 года назад +2

      Would be fun to hear someone run it on Linux (since I'm a noob) he he

  • @invinciblenoodle
    @invinciblenoodle 2 года назад +63

    "[...] well-polished, nicely wrapped up piece of marketable software like something that Adobe would create".
    As someone whose only experience with Adobe software was Flash CS5, I'm legitimately not sure if this was intended as a joke.

    • @MaxSpec
      @MaxSpec 2 года назад +2

      Either that was a backwards joke, or he was being sarcastic in a weird way.
      Edit: I genuinely doubt that was a joke now after that further into the video, because I just wanna say that he is really, really wrong.

    • @MaxSpec
      @MaxSpec 2 года назад +9

      To clarify, I didn't want to insult him on that. It's just, I believe Adobe products aren't that good, but well, people have their own choice of what they use.

  • @mini_bomba
    @mini_bomba 2 года назад +121

    17:40 Your terminal is not wide enough to fit the whole status line, that's why it's creating new lines.

  • @aka5
    @aka5 2 года назад +25

    Very cool project. Each component seems simple enough but the result is greater than the sum of its parts. The outcome looks amazing considering how few clues you give it about emotions and stuff but it probably helps a lot that your drawings are so expressive! Also the changing pose on punctuation really helps. Great work

  • @aiforge8866
    @aiforge8866 2 года назад +15

    Thanks for making this code available! Really enjoyed the lazykh channel, and really excited to see how it all worked

  • @drowzee4425
    @drowzee4425 2 года назад +11

    17:18 the reason why it may be so inefficient is because Mac laptops don’t usually have the best of the best optimization for open source projects. FFMPEG is a powerful tool, however it could be much slower running under the circumstances of CPU rendering rather than GPU. This can’t be solved on WSL because it doesn’t have the means to hardware accelerate. The only way to increase speed would likely either be hacky optimization or running Linux with a good GPU for ffmpeg to use. Really glad you released the source and I will be using it for future projects!

    • @coderhd8554
      @coderhd8554 2 года назад

      It isnt running ffmpeg at this point- its drawing the frames correct??

    • @KimChhay-hm5ef
      @KimChhay-hm5ef 9 месяцев назад

      Îjśijjdjsßnxnjxksnamakækdkdkßkdkkdifkdfododdiidpœæęjfjjdhlïisj

  • @thecatherd
    @thecatherd 2 года назад +14

    People who want something like this on Windows may want to look into HONK. It's a low-cost, single-developer project to create a program that people can use for vtubing avatars, and will lip sync to spoken word on the fly. Just wanted to put that out there for the people who either aren't using MacOS/Linux, or want something already pretty well polished.

    • @MeepChangeling
      @MeepChangeling 2 года назад

      What if I don't want to do live stuff at all? Ever? What if I just want to make a video that I then upload?

    • @DoomRater
      @DoomRater 2 года назад +2

      @@MeepChangeling what's the difference between on the fly and recorded for later use? A miserable little pile of bytes, pretty much.

    • @HAAAAAAAAHHHHHH
      @HAAAAAAAAHHHHHH 2 года назад +1

      on windows 10 you can use the windows subsystem for liinux feature

    • @Matthew_MBG
      @Matthew_MBG 2 года назад

      @@HAAAAAAAAHHHHHH and 11

    • @HAAAAAAAAHHHHHH
      @HAAAAAAAAHHHHHH 2 года назад

      @@Matthew_MBG yea but 11 is shit

  • @justjames4
    @justjames4 2 года назад +10

    Very neat! I'm glad you're fulfilled with what you did on the LazyKH channel.

  • @JustEggroll
    @JustEggroll 2 года назад +3

    The first video I watched from your channel was that video. This brings back so much memories

  • @arf20
    @arf20 2 года назад +5

    The gentle library *does* run on Linux, and Windows using the docker image, as stated by the README.

  • @wafflesforbreakfast774
    @wafflesforbreakfast774 Год назад +2

    Hey carykh, I've watched your videos since 2019-2021. I like your channel. Your videos have alot of effort and you animate amazingly. That's why I subscribed.

  • @LifEsYouTubeChannel
    @LifEsYouTubeChannel 2 года назад +6

    Gentle should run fine on Windows, as it says that it will run fine on all platforms supported by docker :)

  • @farofa9999
    @farofa9999 6 месяцев назад +1

    "cat, i'm recording a video"
    " *MEEEOOWWW* "
    cried at this part

  • @EdbertWeisly
    @EdbertWeisly 2 года назад +6

    Rip Lazykh

  • @maflouffe
    @maflouffe 2 года назад +9

    Oh my, I can't believe my immense luck. I was somehow born around the time the htwins started to upload videos out of the multiple thousands of years i could have potentially been born in. I'm literally witnessing history watching lazyhk retire, and even if I'm just water in the sea, I'm happy haha.

    • @maflouffe
      @maflouffe 2 года назад

      @@wamwamwam watch the video maybe?

  • @EdanMeyer
    @EdanMeyer 2 года назад +3

    Very neat, and awesome of you to open source this! I'm very tempted to try using this for videos on a second channel

  • @edward17829991
    @edward17829991 2 года назад +3

    In the rendering step, it shouldn't take that long just to overlay a few images together. It's the PNG compression slowing down the process and since they're just intermediate files so you can switch to some lower compression image format such as bmp or jpeg at the cost of larger disk usage temporarily.

  • @Hyperboid
    @Hyperboid 2 года назад +2

    One reason to use lazykh over the other options is that it's free of charge, and the source code is available.

  • @stuff31
    @stuff31 2 года назад +3

    It's a good day when cary appears to bless us with his code

  • @DigitalicaEG
    @DigitalicaEG 2 года назад +3

    I love this! Thank youuu

  • @aekwav
    @aekwav 2 года назад

    Almost went away after hearing it only works on Mac but found that it works on Linux in the description. 👍

  • @2OXX
    @2OXX 2 года назад +17

    Please clarify. On Github your repository is MIT licensed which requires no attribution. Yet, you say in the video to attribute you if we use the code. Is attribution necessary for derivatives?

    • @LandonJobe
      @LandonJobe 2 года назад +1

      MIT does require attribution though... "The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software."

    • @4rumani
      @4rumani 11 месяцев назад

      What an obnoxious comment

    • @4rumani
      @4rumani 11 месяцев назад

      ​@@LandonJobeAnd that's not implying attribution.

  • @2000YG
    @2000YG 2 года назад +2

    about 17:40 : ffmpeg is breaking each line, because your terminal is to small and the one line is broken into two lines and ffmpeg only replaces the second half, because it does not know how big your terminal is. So just fullscreen your window and it will work.

  • @jiaweiliu5226
    @jiaweiliu5226 2 года назад

    cary's back with his first upload in 2022

  • @OccyDaBoss
    @OccyDaBoss 2 года назад +3

    cary upload within 5 years challenge

  • @santumChannelYes
    @santumChannelYes 2 года назад +1

    i was just rewatching the original video yesterday and wondering if the code had already been released
    what a coincidence

  • @andrewmirror4611
    @andrewmirror4611 2 года назад +1

    Oh I was so excited to try the thing out as I literally just recorded and edited audio for a dumb video of mine. It's unfortunate that it's MacOS only, but, like, totally understandable.

  • @jan_harald
    @jan_harald 2 года назад +5

    this is awesome, though I wonder if there wouldn't be any way to speed up that inefficient generation...maybe multithreading? or without the billboards, you could check which frames would be duplicates, and just skip generating, and straight copy those? the billboards could be added on with ffmpeg, as another layer

  • @SegaChann3l
    @SegaChann3l 2 года назад

    You’re finally back after your long hiatus :D

    • @SegaChann3l
      @SegaChann3l 2 года назад

      macOS Ventura just released To beta profiles so you really need to update :q

  • @Pixiltation
    @Pixiltation 2 года назад

    Finally a video on carykh after 5 months

  • @cnflx
    @cnflx Год назад

    I'm gonna give you all a huge tip on getting gentle, especially on Mac.
    If you use curl on the REST API in the pre-built app, you can get the json file needed.
    No need for getting therapy from compilation errors, and no need for python virtual environment shenanigans.
    Just bliss.

    • @SaiTejaVanamala
      @SaiTejaVanamala Год назад

      Could you please tell me how to use it? I'll even pay you :D

  • @objecter-qe9fh
    @objecter-qe9fh 2 года назад +1

    CARYKH IS BACK!

  • @CARCATGames
    @CARCATGames 2 года назад

    I just watched the lip-sync video earlier today and then I watched this one and I was like "what do you mean YEARS AGO?" I thought it newer lol

  • @Myalnyblth0
    @Myalnyblth0 2 года назад

    Yay I’ve always wanted to experiment with the program you made so thanks!

  • @zvwiztihvihgwiv7388
    @zvwiztihvihgwiv7388 2 года назад +1

    Nice that gonna be evolving.

  • @dunlopchop54
    @dunlopchop54 2 года назад +1

    *15:00** you can hear a nice inflection when the phonemes are enunciated "so i uploaded a video"*

  • @nikitademodov3446
    @nikitademodov3446 2 года назад +2

    The fact that there's a timer for drawing the billboards kills me. xD

  • @dhpz
    @dhpz 2 года назад

    12:35 i see that someone is a bit lazy
    jk your projects are always crazy good and the fact that you make it public is amazing, keep it up!

  • @astropgn
    @astropgn 2 года назад +1

    17:45 if you increase the window size, ffmpeg will update in just one line. For some reason, when it breaks it doesn't do it. I think it is because it is showing the info and then telling the terminal to delete the last line, preparing for the next update. But since it is breaking into two lines, it just do it for the last line, leaving the second to last still visible. But if you resize your terminal it works as expected.

  • @codahighland
    @codahighland 2 года назад

    Now I want to try my hand at putting a nice GUI on this project.. and maybe trying my hand at the DSP necessary to do phoneme alignment myself. Sounds like a fun challenge.

  • @12DAMDO
    @12DAMDO 2 года назад

    i have been waiting for this since the original video

  • @nzcsx
    @nzcsx Год назад

    I just want to say this: You are amazing.

  • @banirolls
    @banirolls Год назад

    This dude's content is like crack to me I love it so much aa

  • @BostYT
    @BostYT 2 года назад

    24:08 IT'S HILARIOUS HOW THE CHARACTER STARTS FROWNING AND GETS SUCKED AWAY LOLOLOL

  • @zachdoesanimations.
    @zachdoesanimations. 2 года назад +1

    RIP Lazykh Jan 2nd 2020- May 13th 2022. You were amazing. lol I’m doing the Muslim prayer on it.

  • @tommyhetrick
    @tommyhetrick 2 года назад

    A Cary upload… on the main channel!?!?!

  • @LendriMujina
    @LendriMujina 2 года назад +3

    @ the LKH retirement video: It's a little disappointing that you're giving up on AI, since seeing how it gets built up is more interesting to me than the end results of OpenAI's models, but I respect your decision.

  • @sevenam9609
    @sevenam9609 2 года назад +1

    You can write a Dockerfile packaging your app if you want it to run on any platform. Might do an MR if I get the motivation/time 😇

  • @12DAMDO
    @12DAMDO 2 года назад +1

    the whole reason i subscribed all those years ago was because i knew there had to be a future where you finally decided to release the source code... finally, that future is today.. i have no reason to be subscribed anymore (just kidding)

  • @Emeraldboy-rj5dx
    @Emeraldboy-rj5dx 2 года назад

    I like watching this channel Carykh you are the star to me

  • @countingwithjerold
    @countingwithjerold 2 года назад +2

    This is epic 😎

  • @Yukki64_
    @Yukki64_ 2 года назад

    Can't wait for a Windows and Linux port of some kind

  • @HurelyDev
    @HurelyDev 2 года назад

    "Why are there police cars outside now?"

  • @itze_
    @itze_ 2 года назад

    Such a nice human/virtual being

  • @Omperpera
    @Omperpera 2 года назад +3

    Cary posted :D

  • @actravaz
    @actravaz 2 года назад

    Finally something that's only available on mac and not windows

  • @AlexSolander
    @AlexSolander 2 года назад +1

    Hi Cary!
    I am Alex or Alexandfriends!
    But you can check out M&BA on June 17 at 9PM EST.

  • @mynameisphi-2v49x
    @mynameisphi-2v49x 2 года назад

    finally, a new upload

  • @EricJSamme
    @EricJSamme 2 года назад +1

    Wow this is just amazing

  • @4zaUniv
    @4zaUniv 2 года назад

    Babe look! A new CaryKH video!

  • @stary5446
    @stary5446 2 года назад

    next kh joke must be: cary killing hotdogs

  • @frosty_toast1422
    @frosty_toast1422 2 года назад +1

    Cary is just flower with no petals

  • @TrueKrisDreemurr
    @TrueKrisDreemurr 2 года назад +1

    i might actually use this. this is cool!

  • @Funniguy2011
    @Funniguy2011 Год назад

    “WHAT THE FRICK, AAAHHH” says the thumbnail

  • @Mr-Raptor
    @Mr-Raptor 2 года назад

    I just watched that video today and you released this one
    What a coinsidence

  • @AchrafHakimi121
    @AchrafHakimi121 2 года назад

    Cary I have a question. Sorry I cant make it to the meetup
    I’m not vaccinated cause I’m a kid but if your gonna host
    a live stream I’ll be sure to join and also is the rocky plush
    gonna be available online after July 30?

  • @marcyvillegas5443
    @marcyvillegas5443 2 года назад

    New favorite RUclipsr

  • @braydensonaslaughtmbve545
    @braydensonaslaughtmbve545 2 года назад

    Well I am making an object show and I think this will help me! Also keep up the awesome work!

  • @zendio6882
    @zendio6882 2 года назад +1

    i have a suggestion for a cool maybe filler, what if you made or used a pre-made auto-encounter, and made a recursive loop, where you gave it a starting image, then re-gave it into the encoder, and then so on and so first until you (hopefully) get a cool animation and a different final image?

  • @narayanbandodker5482
    @narayanbandodker5482 2 года назад +3

    would you be merging PR's submitted to it though?

  • @gingerb0z0dogarmy17
    @gingerb0z0dogarmy17 2 года назад

    I like how people think that flower is Cary with a pink wig on.

  • @frankocean_loverr
    @frankocean_loverr 2 года назад

    Say Cary Kangaroo Heist for the next intro

  • @matzematratze
    @matzematratze 2 года назад +2

    What would be the result with other languages like german or spanish?
    Great work, thanks!! ❤️

  • @yasebaravenclaw2192
    @yasebaravenclaw2192 2 года назад

    Damn, that channel somehow went under my radar and now its being retired. Thanks for the tinker project though

  • @pringle378
    @pringle378 2 года назад

    I literally just watched the lip sync video for the first time yesterday lol

  • @priyaganguly1045
    @priyaganguly1045 5 месяцев назад

    This should run on Linux pretty well especially windows and Ubuntu

  • @dafaakingdom9692
    @dafaakingdom9692 2 года назад +1

    WOOO

  • @violet_broregarde
    @violet_broregarde 2 года назад

    Good job releasing it!

  • @kreuner11
    @kreuner11 2 года назад +11

    Does it run on Linux then? The source says it should

    • @carykh
      @carykh  2 года назад +6

      Fortunately, it does! I actually used to run this project in Ubuntu 16.04 a couple years ago, before I switched desktops. So if anything, you could say lazykh is sort of "designed for Linux"!

    • @atravellingbleach8668
      @atravellingbleach8668 2 года назад

      @@carykh I mean, most people probably can infer that it works on Linux too but maybe you should clarify that it works on Linux aswell

    • @kreuner11
      @kreuner11 2 года назад

      @@atravellingbleach8668 Technically it should work on most POSIX systems, which would be Cygwin or WSL on windows, though that depends

  • @GoofballPaul
    @GoofballPaul 2 года назад +1

    adobe creating well polished software hahah, good one!

  • @RealApple_BYT
    @RealApple_BYT 2 года назад

    I just realized kh is just his middle name and last name initials

  • @jessicadickerson3050
    @jessicadickerson3050 2 года назад

    YES- I needed this- TY CARY!!!!

  • @smull2318
    @smull2318 Год назад +1

    So basically a BFDI maker

  • @ToastHQ_
    @ToastHQ_ 2 года назад +1

    heres an idea new bfdi mouths and part that look more hand drawn and a tool for auto lip sync for them

  • @HuntingSunder
    @HuntingSunder 2 года назад

    'Like something that Adobe would create'
    Hah! Good one!

  • @StickmanDude2009
    @StickmanDude2009 2 года назад +1

    Its well made and its sounds fun to use, but plz try to make a windows version for the program because im a fan of your content and I dont have a mac and I cant buy a Mac because the price is too much

  • @alexthespooder7544
    @alexthespooder7544 2 года назад

    wow havent seen carykh in a while that's crazy

  • @thomascoping6696
    @thomascoping6696 2 года назад +1

    Why is this so fun to watch

  • @holybananapeel3795
    @holybananapeel3795 2 года назад

    Holy crap a rare Cary sighting!

  • @maxcraftobjectssituated5519
    @maxcraftobjectssituated5519 2 года назад

    We need mor acronyms Cary Kant Hear

  • @marilynumbanacagmat5004
    @marilynumbanacagmat5004 2 года назад +2

    Hello KHary!

  • @brebsamoungusacount
    @brebsamoungusacount 10 месяцев назад

    The thumbnail: you saying wtf you saying aaaaaa

  • @JamesTDG
    @JamesTDG 2 года назад

    I think a good workaround to give it win support is to give it linux support, as win 10 and later can run Linux applications

  • @BiskutOSC
    @BiskutOSC 2 года назад

    I JUST WATCHED THE VIDEO YESTERDAY NO WAY

  • @TheOfficialHattyHattington
    @TheOfficialHattyHattington 2 года назад

    ITS ALIVE

  • @donutgamer6505
    @donutgamer6505 2 года назад

    does it work with music too?

    • @Fjiere
      @Fjiere 7 месяцев назад

      not sure

  • @JohnPaulBuce
    @JohnPaulBuce 2 года назад

    great job bro

  • @Himhim0801
    @Himhim0801 2 года назад

    Did You Use Adobe Character Animator?
    If Not, Any Thoughts Of Using Adobe Character Animator?

  • @flippedmasterguardian
    @flippedmasterguardian 2 года назад

    The legend returns!