This solution is so simple, it's pure genius! No addons, no mouth shape keys or pose library. I don't need perfectly synced lip syncing, so this is perfect. Love it!
Oh man. Totally gonna try this out. I’ve been looking for a way to get a talking avatar in my videos without using AI. This is EXACTLY what I need. Thanks 🙏
Thank you for the tutorial. I never thought of using an empty but it does give you more control and if you bake the emties action you get a curve that you can fine tune
haha I was so excited by this video that I followed along and rendered even before getting to the section where you talk about audio codec. So first render came without sound. Thanks for this tutorial. I appreciate you
Note 👉 For Blender 3.6 onward, there are some changes in the menu options. Now the Bake Sound to F-curve option comes under the Channel menu instead of the Key menu (same for Bake Curve and Unbake Curve). The functionality remains the same, only the menu location has changed
Do you blend other key shapes around this method? So one could bake an audio file to a characters mouth, then do manual key shaping for different vowels?
@@JoeyCarlino ah ok. I can't thank you enough. The prospect of manual key framing mouth animations began to terrify me as I learned it last night. This is a huge relief.
Southern Shotty has a recent tutorial displaying what you described if you're interested in that seeing that method too. It's really up to you how much work and realism to put in.
Was thinking, it wouldn't be too hard using this technique to do a few recordings based on the sound, but not from the sound itself - like just speaking anything at the right time - more than 1 track could be used. I wonder if possible to "blend" the animation data between separate tracks, so like, one track could be for mouth open top to bottom, one for mouth open side to side, one for mouth pucker (and when both are at hte same time, then blended animation) -D oesn't matter what you say, just the amplitude and the time, and a separate one for each mouth pose. So a bit more work, but not too bad really. Still all driver based.
If you want the background transparent go to render properties, under Film there is a transparent option. If you want the mesh to be transparent and you're in Eevee, you have to make sure under material property setting you have blend mode set to alpha blend. Hope this helps.
@@JoeyCarlino Thank you for answering so quickliy :) I tried it out with the transperent option under Film, but it's just black and not transparent....I put it onto a video to see it if it worked, but didn't. Gonna try that you what you said with the material property.
So I tried it out but the background is still black even though on the rendered view it shows all those little light and dark squares like a transparent picture should have...
Thank you very much for the video, I have a question, once created the lip sync in this way how can I export the animation to fbx? I try but the mesh is exported without aniamzione
@@JoeyCarlino my scroll wheel doesn't do that. i have the latest version 2.92.0. i am also lost on your bevels. i got the empty to move the mouth on Vincent (blender cloud), so YAY! im not able to click surfaces by hitting the L key either, some addon?
If your scroll wheel doesn't work for adding loop cuts, just place one and a dialogue box pops up in the lower left corner where you can change how many loops. The bevel was just a bevel modifier, and using L to select connected parts isn't an addon, you might just have to hover over the right part when you're hitting L for it to work right. Like if you're in vertex select mode, make sure you're hovering over a vertex when you hit it.
Okay 1 time is works for me. But now is "Bake Sound to F-Curves" always grey and i cant use it. Here is a picture > www.gutefrage.net/frage/bake-sound-to-f-curves-funktioniert-ploetzlich-nicht-mehr but why now it doesnt work?
⚠ Bake sound to f-curve is now called "sound to samples" and is in the channel menu
This solution is so simple, it's pure genius! No addons, no mouth shape keys or pose library. I don't need perfectly synced lip syncing, so this is perfect. Love it!
dude seriously, your channel is severely under-rated
I try
That's a jewel! Thanks a lot. Very good tutorial. I needed that. Liked and subscribed.
Oh man. Totally gonna try this out. I’ve been looking for a way to get a talking avatar in my videos without using AI. This is EXACTLY what I need. Thanks 🙏
Dude I just found your channel tonight and I wish i had months ago. Best blender creator out there!!!
Thank you for the tutorial. I never thought of using an empty but it does give you more control and if you bake the emties action you get a curve that you can fine tune
УРА! ВИДЕО НА РУССКОМ!!!❤❤❤❤❤ СПАСИБО, КАК Я ДОЛГО ЭТОГО ЖДАЛ!!!
Seriously, this is immensely helpful, dude. Exactly what I was looking for. Thanks a lot.
haha I was so excited by this video that I followed along and rendered even before getting to the section where you talk about audio codec. So first render came without sound. Thanks for this tutorial. I appreciate you
This was an amazing Tutorial. thank you for this
this is fantastic. thank you for this
So talented !!
5 million likes LET'S GOOO.
Love this man ❤️
This is great! Is there a tutorial that builds on this technique and adds in subtle things like: eyebrow movement, blinking, head movement, etc.?
Note 👉 For Blender 3.6 onward, there are some changes in the menu options. Now the Bake Sound to F-curve option comes under the Channel menu instead of the Key menu (same for Bake Curve and Unbake Curve). The functionality remains the same, only the menu location has changed
Really helpful and the inro was super good! Defentally subbed now B)
This is exactly what I was looking for. Thanks bud!
you are the best bro!
This was fantastic
Great tutorial!
You can also bake the value to an audio file! Most audio visualizer how tos show how to :)
fantastic data - thanks a bunch for sharing!
Great stuff. Nice presentation!
Will you please remake that video?
So simple solution great 👍
Excellent ,simple to understand
Do you blend other key shapes around this method? So one could bake an audio file to a characters mouth, then do manual key shaping for different vowels?
You could do that for more accurate lip syncing, but it wouldn't be as automated.
@@JoeyCarlino ah ok. I can't thank you enough. The prospect of manual key framing mouth animations began to terrify me as I learned it last night. This is a huge relief.
Southern Shotty has a recent tutorial displaying what you described if you're interested in that seeing that method too. It's really up to you how much work and realism to put in.
Thank you soo much now i can lipsync dat boi with any audio file
Was thinking, it wouldn't be too hard using this technique to do a few recordings based on the sound, but not from the sound itself - like just speaking anything at the right time - more than 1 track could be used. I wonder if possible to "blend" the animation data between separate tracks, so like, one track could be for mouth open top to bottom, one for mouth open side to side, one for mouth pucker (and when both are at hte same time, then blended animation) -D oesn't matter what you say, just the amplitude and the time, and a separate one for each mouth pose. So a bit more work, but not too bad really. Still all driver based.
Yeah, I don't see why not
Thank you Sir.. Great tutorial 👍🏽
dedouze has multiple animations though, so i guess he'd have multiple shapekeys, but how would you automate randomly adding them in?
Joined at 120 subs, will still be there when it's 120k. Peace!!
ty so much
I wanted my animation to be transparent but I still don't get it how to do it, sitting on it for hours rn and I can't get it to be transparent...help
If you want the background transparent go to render properties, under Film there is a transparent option. If you want the mesh to be transparent and you're in Eevee, you have to make sure under material property setting you have blend mode set to alpha blend. Hope this helps.
@@JoeyCarlino
Thank you for answering so quickliy :)
I tried it out with the transperent option under Film, but it's just black and not transparent....I put it onto a video to see it if it worked, but didn't. Gonna try that you what you said with the material property.
So I tried it out but the background is still black even though on the rendered view it shows all those little light and dark squares like a transparent picture should have...
Make sure you are rendering as a PNG with rgba checked
@@JoeyCarlino ok thx
Thank you very much for the video, I have a question, once created the lip sync in this way how can I export the animation to fbx? I try but the mesh is exported without aniamzione
Thank you
Really helpful... ❤️
will this still work for the newest version of blender? really helpful tutorial by the way!
Yes, it still works
thank you😊
Excellent
Hi! How do you add those loop cuts to the lower jaw? I've been trying to do that, but it only adds them to the whole cube instead.
I think the shortcut is ctrl r, then use the scroll wheel to change the amount of cuts.
@@JoeyCarlino my scroll wheel doesn't do that. i have the latest version 2.92.0. i am also lost on your bevels. i got the empty to move the mouth on Vincent (blender cloud), so YAY! im not able to click surfaces by hitting the L key either, some addon?
If your scroll wheel doesn't work for adding loop cuts, just place one and a dialogue box pops up in the lower left corner where you can change how many loops. The bevel was just a bevel modifier, and using L to select connected parts isn't an addon, you might just have to hover over the right part when you're hitting L for it to work right. Like if you're in vertex select mode, make sure you're hovering over a vertex when you hit it.
Your video is so so nice 😍😍🥰
Thank you so much,
i dont know how to thank you
By being a patreon ,,😋😋😋
How can we have multiple clips of audio on one empty?
nice
Can we also use auto lipsync in 2d animation?
Yes, it should work with grease pencil objects.
@@JoeyCarlino thank you sir!
wow❤
Can you make normal characters instead of crazy characters?
Unfortunately no. I can only make crazy characters because of a curse
Wdym normal
😂
I like your video bro
How to adding other clip audio ?
addings clippins?
Puppet muppet
You from New YAWK
Okay 1 time is works for me. But now is "Bake Sound to F-Curves" always grey and i cant use it. Here is a picture > www.gutefrage.net/frage/bake-sound-to-f-curves-funktioniert-ploetzlich-nicht-mehr but why now it doesnt work?
Try deleting the keyframe and adding it again.
My reaction to this 😱😦
please project file blend please share
Thank you
nice