AUTOMATIC LIP-SYNCING
HTML-код
- Опубликовано: 10 сен 2024
- Check out Brilliant.org for fun STEMmy courses online! brilliant.org/...
THE SOURCE CODE IS NOW PUBLIC! Here's info on that: • Automatic lip-sync sou...
Lazykh source code: github.com/car...
Lazykh RUclips channel: / @lazykh_
Part 1 of this video: • Automatically making Y...
For the legal aspect: Google has a way you can filter images by commercial reuse with modifications
What how??
@@PlasticSinks After you search look under the search bar and click Tools > Usage Rights
He did say that the cc image library was "lame" in the video
that's assuming the uploader is honest and actually knows what it means (look up "distracted boyfriend" with the filter on and see how many low-effort edits of the copyrighted you-need-to-pay-for-it image are there)
personally i'd like to see a crowdsourced thing where you ask a discord bot for a prompt and send it an image you drew matching it (of course with some sort of similarly crowdsourced report system so the video isn't full of garbage and dingdongs and "subscribe to my channel"s)
Yep. It also defaults to this setting when you try to search for images in Google Docs, which can be kind of annoying, but I understand why.
Cary 1 year ago: Did editing, voices, animating, coding, etc.
Cary 1 year in the future: COMPUTER, MAKE A VIDEO!
*computery ;)
@@martysh1226 Cary's just going to become an AI at this point
Alexa, make a youtube video.
and thats it. the computer just makes a complete, perfect video, in half a minute at longest.
@@blueninja012 That might be the end goal
This man is working hard so he doesn’t have to work hard.
Every automated system ever
Aint that the most true sentence
That's how humanity has progressed this far
@@RinInABin until AI got so advanced and started making an automation for themself which is the automation is also an AI and then they got so advanced that they made an automatic machine for themself and so on.
@@kakyoindonut3213 _the singularity_
Cary in a few weeks: "My entire RUclips channel is now running automatically"
Can you see the future? Perhaps that is where this is all going :P
Cary in three years: Forcefully taking control of RUclips and running it using AI
wait you watch cary? so do you watch bfdi?
Do you want SkyNet? Because that's how you get SkyNet!
@@icecreamsandwich7522 that is youtube in a nutshel whitout the taking over or cary
My man just automated his whole RUclips channel, he's my new hero
the bigger picture is that he actually just enabled a new wave of youtube creators who don't want to/can't put much effort in their videos. They can just draw some basic shapes, write a script and video done. Not only did he automate his channel, he automated countless other channels
Teri Hornych madlad
similar bot have been done but this one is next level
@@110110010 gonna recreate and sell it xdd
Teri Hornych well he did not open source the sourcecode of the program, so thst won’t gonna happen any time soon.
“Digital animation isn’t real animation. The computer does it for you”
Animator: Lmao, I wish that was true.
lul
YES THATD BE AWESOME
True...
:((( it takes me like 10 minutes to SKETCH a 0.5-2 SECOND CLIP- TwT
((probably because I don't draw stick figures and I draw cats and people at least semi-realistically-))
@@Xox_InSocks aaaaa I get how you feel lol
what about after effects animators ?
If you filter google images by "licensed for noncommercial reuse" there will be no copyright issue! I had to learn to do this for school. Upvote so he sees this.
OMG that's really smart! I should go implement that into the Google-Image-searcher, and see how well it works. If the resulting images are still up-to-par, that might solve this whole issue!
I think this would probably be commercial reuse, though. He is earning money from it.
The problem is I don't think RUclips videos qualifies as non-commercial if they are monetized.
@@carykh make sure it's licensed for commercial reuse, as you are making money off your videos the noncommerical ones aren't allowed
"Licensed for non-commercial reuse" isn't the same thing as "royalty-free" nor "open". It's sufficient for school presentations, since those aren't commercial, but Cary's videos are commercial, he earns money from them. This wouldn't help him in the slightest.
Anything: is manual
Carykh: *visible agitation*
wont take him long until he creates automatic breathing
1 minute of animation = around 1 day of work.
cries in 3D
Sometimes 2D is harder than 3D
me who only traces in desmos
3D animation is underrated
Animation is underrated
@@onefinalobjectepisodes oh really
This works so much better than I thought it would
Lmao
Nailed it
Hello
Subbed
Ikr!
Google has an "advanced image search" so you can filter by non copyrighted images
Yeah
Cary in a decade: “my body is moving automatically”
How I get 77 likes
@@14_bryce65 80.
81*
@@pendantperuke9440 248*
😢😮😅
And now skip 10 years into the future and Carykh has just a button next to his bed that when presses searches for an interesting topic, creates a script and uploads an entire RUclips video about it.
A button? How primitive. A brain interface definitely requires less energy and is faster to use, he just has to think about doing it.
@@thoregrimm6042 lmao
@@thoregrimm6042 Thinking would also require effort - just schedule it to run every week
@@OpenKeith Just let the AI decide when it's the best time to upload
@@timgreller first of all there's no AI in this, it's just a bunch of python scripts. second of all why use an AI when a cron job is simpler and would produce a more consistent upload schedule
The next thing you need to make is an automatic KH joke generator.
You can do It yourself, just get all of the words that start with k, generate a random number and pick that, repeat with h. My best result at this choosing specifically is kleptomaniac hallucinogenic
@@Adomas_B
Sure, but then it's not really automatic
i mean this method could be automated really easily. random number generator + list of words that start with k and h. done.
@@entropy687 "Hi, Kindergarten hallucinated here!"
@@entropy687 Well there is one problem, it could choose two nouns or two verbs and may sound weird or nonsensical, so it should also be scripted with structure with verbs are followed by a noun, adjectives are followed by a noun, etc.
And here he calls himself Cary kaleidoscope hoarder. The funniest shit I ever heared
Once he called himself “Cary key hole” lmao
@@kiana.118 that’s the one i heard first and what i thought he meant.
pyro tf2 is right
Mmmmmph
Language dude
8:37 cary's "lip synced mouth" is broken
Lol
Plot twist: Cary was automated the whole time.
plot twist: this is not automated
@@dat1pengu1n Plot twist : you missed the joke
@@dat1pengu1n r/woooosh
@@Dragona- plot twist:
That's not a plot twist, it's just obvious
YOU NEED TO SELL THIS
Just having a program that makes the timing and inserts the right lip flap into Premiere would be so incredibly helpful to the entire animation industry. I know quite a few abridged series that could benefit from such a thing.
I could definitely use that.
Also VTUBERS COULD MOD IT TO BE LIVE SO EVERY FEW SECONDS IT FITS THE EXPRESSION IT HAS TO HAPPEN!
0:20 Mom, look! I'm on TV!
lucky man
Nice
BRUHHH
No way!
Lucky
The stars have aligned and we got a Jacknjellify, a carykh, and a humany video all in one day.
THE ANGELS HAVE BLURSED US
thats why ruby took out the freesmart supervan duh
@@olgahapitan312 LOL
Sebastian Lague too
who?
6:03 They’re talking about Pencil’s mouth not being on her body. You’ve gotten 0 complaints about the lip syncing!
10 bonus KH points if you can find where I am in this video.
hi demipixel!!!
Ok.
you must be the swatter at 1:24!!!!!
found it
@carykh when is next TWOW
"If you give a lazy person a difficult job, they'll find the fastest way to do it" Steve Jobs, in The Art Of War, circa. 69420
Bro, that was Ghandi in "The art of the Deal"
Eduardo P What’cha Talking about. It’s Sun Tzu from 1984
@@eduardop2111 "Most quotes on the internet are misattributed." - Abraham Lincoln
@@spidercubed9718 well that's the point, if you can't tell
69420
Cary:
kaleidoscope hoarder??
Viewers:
It's... Acceptable.
STOP HOARDING THE WHIPS CARY!
Carykh: post video, me: SPEED IS NECESSARY
yep
yep
SPEED IS KEY
@@por1264 yep
@@captcalvin2293 yep
Hey, Cary! We have a channel that uses a lot of animation and we have been struggling with incorporating lip sync, because it is sooo time consuming. Adobe animate has an auto-lip sync feature but it is not as clever and smooth as yours. I think that your piece of software might have serious commercial potential. Also, is there a way we can try the software ourselves?
CuriosaMente lol no
Nope
nop
Sully Bully you don’t know and so do the rest...
Who knew the day would come when cary could vibe check his fans
Holy heck I just now realized this was one of the guys who produced BFDI! Dude thanks those animated shorts made up a huge portion of my childhood.
Same
Every singer ever could use this
2Pac hologram: 😱
Cary: My dog just died
TheOdd1sOut: Yeah, they do that
lolololOLOLOLolololOLOLOL
Lol
XD XD XD i get it
irrelevant cringe meme :/
Lolooloolooollololololoolololol9olololololllollololololololololololoololollololololololololololololololololoollolololololololololoolololololollo
0:03 it sounds like he was banging his head on the keyboard while typing.
category:
*g a m i n g*
Ah yes, *g a m i n g .*
But Cannot See The Category :(
Did RUclips Removed Them :( Plzzz Tell Me 😭😭
@@MFahrulRozi huh
Ny Favourite.
Danny Devito has entered the chat
only a gamer could do this
I must say that the lip sync system is pretty amazing and well made. With a few tweaks, it could improve the video creation pipeline 100 fold
It looks like a fun game at 9:34 where you have time to draw something that someone else will try to guess what it is.
Gartic phone?
@@Elunatrixyes
Cary: *Talks about the mouth shapes he used*
My Brain: One for Pho
noodle
@@tastyyoylecake2069 The Pho taste very nice
Pho
2:19 “stop using images we don’t have the rights to”
*Uses images he probably has the right to as images he doesnt have the right to*
Hi stalliongd from 3 years. I'm thefakesdslayer in 3 years
OMG ITS THAT GUY
StallionGD lmao
9:52
*Imagine if he didn't write the O on time*
next: automatic animator
after that: accurate voice synthesizer
etc.
in the end: fully automatic video creator and uploader.
I wonder how much money he'd get from that...
what about Automated Movie Producer
I mean, Vtubers are already a thing. They're absolute shite so far as I know, but they exist :)
final result: fully automated Pewdiepie
Final: Automatic viewer. I robot that'll watch the whole thing. Each with separate personalities that’ll help decide whether to like or dislike.
8:37 there is a mouth glitch here
0:31
“I hope this isn’t my legacy”
Lowkey that whole sentence explains all my dramatic pasts-
At 8:37, Cary’s mouth doesn’t move when he says last time.
You found an error :0
It's actually him performing entriloquy.
oMg DiSlİkEd
@@jerrysimon8771 ventriloquy*
Leave the poor robot
He did whole video correct except this
when he finishes making these tools, he should release them with the assets removed so people can replace it with their own. that'd be really cool of him
I would pay for this software.
@@markus3666 same !
some of these already exist; there are the pamela and rhubarb projects connecting speech recognizers with lipsync output. commercial studios have already been using neural net based ones for a while but it's not generally talked about.
@@TheSkrylar can u please name one that actually has decent auto lip sync
This man is literally creating automatic animation
Dude. This is one of the most awesome things I’ve ever seen accomplished with a RUclipsr coder :)
The moral of the story was to not let your dog walk without you.
He hates animating mouths because he’s too busy hoarding kaleidoscopes
Scratch Lip Sync Engines: “Am I a joke to you?”
???
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh @@retiredaccount6032
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
he meant scratch.mit.edu
He addresses this.
Yes
This man is single-handedly reworking how videos are made.
You’ve got a profitable idea to market to RUclips animators. Also, the jigglyness is fine, it just needs to be animated more subtly, or replaced with a slight expression change to more intensity
as an animator, i struggle with lip sync. this actually boosted my understanding! thanks!
you create stuff on gacha life. that isnt animation.
@@crash-wb8ij don't be toxic, dude.
@@crash-wb8ij everyone starts somewhere my guy
@Nem Gam Boi if y'all were to actually look at their channel they have hand drawn animated content too lmao. Y'all just hateful to be hateful.
Big brain ideas: If you too lazy to do lip-syn just wear mask.
**GENIUS**
How topical.
@Paper Towels Nope, they meant topical
Or don’t draw masks
Pull a let me explain studio on em
BAK Robert Johnston did you mean mouths? Or just masks?
this is the video that introduced me to your channel. i did not even know bfdi existed back then
I am actually interested in seeing how this program can be adapted to different types of avatars and mouths. My avatar is essentially a 3D model, so having it without the mouth is kind of tricky. I can recompile it without the mouth, I still have the source files, but having the mouth itself separate is something I don't know what to do. I am thinking of resorting to do several shots of my avatar performing various actions, similar to some storytime animators, but that seems like it's too much trouble for it, and like you said, work smarter, not harder.
I mean it kinda was adapted to some vtuber avatar softwares using audio.
in 3d easier would be to just predefine different mouth shapes and then animate them according to audio
The bouncy-ness of the automatically generated character makes me nauseous.
Same
I got used in 5 minutes.
8:42 "Instant jumpcuts it is!"
Yaaaaaay..... Perfect for my ADD. Something on the screen needs to bounce around and be exciting every 0.5 seconds or I can't stay focused.
Yeah, same
Bouncy Bouncy
1:31 Kurzgesagt would like a word with YOU!
They're a team of animators
they have a giant group of animators
I can't believe Cary just found a way to automise animated story time RUclipsrs
In a few weeks he won't even be recording the videos
Ah finally those story time youtubers would be even more lazier
Wow, that lip sync is amazing! Though, I think it's better to have more than 5 poses, it still feels somewhat repetitive, especially the one where the avatar is holding its chin. That pose doesn't feel like you're supposed to talk, so that kinda felt "weird".
Yeah the holding chin one didn't fit at all.
It looks like he is taking a moment pause, tbh
I personally liked it
3:45 right after this part, i got an ad
same
I got 2 ads
but I didn't
I GOT AN AD WHEN I CLICKED ON THE TIMESTAMP-
Him: This Video.
Animators: Here is thousands of dollars, share this technology!
It seems like the jigglyness is because the avatar switches to a default pose of some sort for 1 frame in between the 2 poses
No, when you watch in slow motion you can see that there are several intermediate frames with no apparently default pose. I think he should try to make them less jiggly or get rid of them all together.
I actually love the jigglyness of his new character
Should have animated transitions and not just change poses
3:37, Cary here when the machine was supposed to lip-sync to you saying “two” the mouth stayed closed too long
@regentfernYT don’t be sad. It’s ok lol.
Randomly, the mouth stops moving even though you're still talking. Just a heads up btw.
Also, even though you have no repeating poses, some poses show up too often imo.
Errors like 8:37, yes. But it stops most of the time because he has a “small” amount of faces relative to the amount of phonetics there are, and some of them can even be the same face.
Did not notice any repeat of poses. But I dislike a lot that he always smiles even talking on a serious topic.
@@happysongs4kyrone yeah I think simply changing the probabilities for faces to show up should solve the problem
your gonna to leave one day and just leave this thing running.
yes
maybe he already did
*A stranger threw my dog off the bridge*
WHAT KIND OF-
A BFB episode AND a carykh video?!
ON THE SAME DAY?!
=D
Ik what is going on
Quarantine makes house job easier.
9:40 Oh my goodness. You could make this a game.
Give players a prompt, they draw it, and then have them rate four other players' drawings from best to worst.
Players receive a score based on how well their drawings compared to others' drawings in the public eye.
You gradually end up with a library of all the "best" illustrations for any number of topics or prompts.
This might be how you get a library of 300 pictures of penises though... If cary or someone else acts as a moderator, that might work.
gartic phone?
"If you ever animated yourself, you know that creating a ten minute animation can take several weeks" XDDD DEAD.
I've been working on my 8 minute graduation film full time since pretty exactly the upload date of this video. As a core team of two, plus a bunch of animators. And it's about halfway through rough animation after a year of production.. Automation is cool but my heart is with everything that's handmade, obviously (:
This can actually be a game changer for animation videos, props
There's already a way to automatically animate, you just have to outsource to China
Good
At least I got a nice stable job
Till it's outsourced to china or rEpLaCeD bY a rObOt
@@rerease *haha odd1sout quote go brrrrr*
@@rerease i was thinking that too when I read that comment too lol
@@rerease *are you my classmate in disgui-*
*OHHHH WHAT OH YEAH I’M A GOOD PERSON!!*
This popped up in my reccommended. I wanted to stop in and say WOW!
As much as its "lazy" to automate animation, making the entire machine to do it is an amazing job!
Cant wait for more :D
8:00 I see what you did there.
This is very interesting. I have been thinking of how to do a project exactly like this (auto animation, mainly for lip-sync) and it is great to see that it is actually possible. Could you share how long did it take you to train the model, and how big was the training set?
*F* IS FOR FRIENDS WHO DO STUFF TOGETHER
*U* IS FOR U AND MEEE
*N* IS FOR- uhhh... guys, I forgot.
n is for anywhere at anytime at all
down here in the deep blue sea
Ni
Nice
N word
No
Wait... He animated Battle to dream Island??
Dude animated my _CHILDHOOD_
0:30, Farted at the right time
4 years and no replies? Sad.
Four years and one reply. Sad…..
Four years and 2 replies? Sad
Four 444
4 years? 4 REPLIES? so sad
have you done," I am Cary kommits homicide."
Hank Just moika
@@suwinkhamchaiwong8382 Moika
@@suwinkhamchaiwong8382 Moika
THIS IS THE SAME MAN WHO MADE BATTLE FOR DREAM ISLAND WHY AM I JUST NOW LEARNING THIS
i've just started watching the video - but u have inspired a lot of my university projects over the past two years and are much of the reason I chose to pursue CompSci with AI! Thanks a bunch man
Animators: my job is to hard for a robot to do
Cary: im about to ruin this mans whole carrier
the timed drawing segment honestly looks like it would be fun as something like a party game to play with friends
so basically gartic phone
Cary's mouth is got mistake when removing recomended characters
1:25 *S P L A T*
Carykh when animating 30 minute animation without lipsync: oh no, it will take an month
Me animating an single walk cycle in garrys mod: AHHHHHHHHHHHHAAAAAAHHHHHHHH👹 IT WILL TAKE MY ENTIRE... LIIIIIIIFE
that’s so well programmed omg.
your avatar will be amazing what ever it is lmao B)
commented thrice but thats ok
at some point, this channel is going to be completely replaced by an AI and we'll have no idea
2:54 ''my dog just died'' i feel like thats a bad place to start off
“Cary kaleidoscope hoarder”
Much better, thank you
3:14 all I can think of is
"NOOOO BAXTER!"
I watched this long time ago thinking it was a normal video now I come back with honor
i really like the idea of still having to manually draw. might be cool to have it save the animation of you drawing so it can fit the process of you drawing the frame into and through the time it gets used on screen.
0:22 mom look I make it
Carykissedhumphry
I actually enjoy animating lip sync, it’s perspective and the rest of the body (expect for the eyes) moving that gets me.
If you guys don’t know what it’s says it’s says safety first 8:07
letting out a sigh of relief after seeing he stopped using pygame
5:20 I just realized who this is
""LETS WORK SMARTER AND NOT HARDER" -carykh 2020
10:58 the blue guy sounds like Pin!
Man, Cary Kaleidoscope Hoarder is such a fun RUclipsr to watch.
He should release to the public as a program. This could be really handy when animating.
Adobe animate has auto lip sync now