Yes, working with individual phonemes yields a different style. We aimed to find a good balance between making it easy to use and look good. Thats why we decided for automatic mouth animation and not asking the user to provide manual mouth shapes for each phoneme.
DUDE! I COULD KISS YOU! Not only is this plugin AMAZING! But I've had After Effects for years without realizing you just hold down CONTROL and drag the timeline to hear the sounds! I'VE BEEN DOING RENDER PREVIEWS THIS ENTIRE TIME OMG! * hugs you tightly and doesn't let go * My only issue is, why is mine transparent inside the mouth and not black like yours? (I mean I can add a layer of black behind it but it didn't seem you did that) Also, the white won't go away, there is not cleaning this, it's very cartoony in style there are literally only black and white colors and it's adding a whiteness inside the mouth that won't go away no matter HOW much I try to smudge. It's really straight so...not sure how to fix this.
Glad you like it :-) The inside of the mouth is always transparent. Maybe in the tut I had the background color of the comp set to black. So yes, the best way to color the inside is to put a colored solid behind it.
Why does the mouth shape change just from adding a marker please? I understand the setup you have for fine tuning, but i cannot understand why when you add the first marker, it changes anything?
Hi Matthieu, yes, I track it in mocha, create a stabilized precomp and do the Lip-Sync inside the precomp. Take a look at the "Tutorial about the talking car" (see link in the video description). It shows exactly this process.
Thank you Mathias - great idea for a plugin! and executed well! After downloading the plugin i was running a 30 second test video in an hour! haha! Previous lip-syncs this length took me about 6 hrs of frustratiing, and painful image swapping and hundreds of keyframes. Yay!
It's still pretty amazing though. If I ever do anything more 3D style, I would definitely try it! I've tried using papagayo, pasting the generated keyframes into After Effects, but I think it's just faster and more accurate for me to just keyframe by hand. I've mapped my +/- keys to change the mouth shape keyframes based on their time remapped frame. It works fairly well, and faster than completely by hand, but something fully automated that worked with time remapped layers would be amazing! :-)
Hi Eddy, on the aescripts website go to Support -> Knowlegde Base -> Installation -> How to install and run scripts There is a video explaining how to install scripts like Auto Lip-Sync. Best, Mathias
You know, the Talking Head plugin work better for me, its soo cool!, because my animation are in 2D. AutoLyps-sync is more for 3D stuff or pre-made video o pictures , if i say so. thx for everything
Talking Heads is great if you have drawn individual mouth shapes yourself and want to toggle between them. Auto Lip-Sync warps the mouth which does not require you to provide individual mouth shapes and gives a very different visual result. Which tool is best for you depends on your workflow and mostly the style you are looking for.
If have two characters and only one voice file, whats the best way to have them talk? I know they both will talk at the same time, can i delete certain parts of the lip sync sentence on one character and then repeat the process on the other character,
Big brother Please you made tutorial for animal lip syn in fresh any easy way with mocha or without mocha. In updated video like tree,car,animal. May you made animal lips syn video.
This is a fantastic tool; I've been using it for years and I'm really happy with it! I do have some questions about how it works with the latest version of AE, though; has anyone else run into "after effects error: unable to compute distortion"? I'm also having a tough time exporting to Adobe Encoder with lip sync on, but no issues when I remove it... Any ideas? (also, is there a better place than RUclips to ask these questions? ;)
Hi Sandy, thank you for your feedback. We are not aware of such an issue, yet. Could you please open a support ticket at aescripts.com/contact/ Please include as much detail as possible. Does it happen sporadically or always? Only for one specific project or clip? Could you attach a project where the issue occurs? The more details I know, the quicker and better I am able to help. In general, this sounds like an issue with one of the warp effects that Auto Lip-Sync is using for its rig. So most likely the issue is on Adobe's end. But also in that case I can contact the Adobe team and point them to the issue.
@@mamoworldae Think I got it figured out, and I think it was my fault! Seems to be working perfectly again; I think I accidentally used the wrong mesh warp tool in one of the steps. Thanks so much for your speedy reply, and again, love the tool!
Before I installed the CC split, and I'm having the same problem. Maybe I should uninstall to see if the green lines disappear. What do you think? Congratulations on your plugin.
If you have a problem with Auto Lip-Sync, please open a support ticket at aescripts and give a detailed problem description. The more detailed you describe the problem, the quicker we will be able to help.
good afternoon I have problem with Auto Lip-Sync I seek support files scrip ey entered Auto Lip-Sync but do not see it in After Effects CS3 I wonder where I find
Bro can u plz say that ,from this software i can animate only videos or i can do this with some of the 3d model .which later can be used in 3d softwares ...
This is neat, but probably wouldn't work for me. If it would analyze the phonemes from the audio and just return an integer value for each sound, that would be better. My mouth shapes are already drawn, and are drawn differently for each phoneme. They only need to be turned on and off for each keyframe, not warped. I can see this being useful for 3d-type cartoons, but mine uses a more 2d style.
Hi, what exactly does not work for you? Please create a support ticket at aescripts and I am sure we will be able to solve your problem quickly. Best, Mathias
Hi papa jack, maybe you run out of memory. If you use a picture, make sure that it is not too large. Best use a picture that has the size that the final video should have (e.g. 1920×1080 pixel). Cheers, Mathias Cheers, Mathias
If my subject head is slightly moving from side to side, how do I make the auto lipsync mouth automatically track it? My brain is not processing how a stabalized precomp will help
See this tutorial: ruclips.net/video/PVcsoULpDYI/видео.html A "stabilized precomp" rig gives you a composition inside which the tracked object is not moving anymore (the entire composition is moving with the track). Therefore, inside the precomp, the head is not moving anymore and you can apply Auto Lip-Sync inside of it without the need to worry about any movements. The cool thing is that all changes you do in the stabilized precomp will automatically also be visible in the main composition. See this tutorial for an overview how stabilized precomps work: ruclips.net/video/gMBJ1R3t4dw/видео.html
hi, i just want to ask why im getting an error after step 2. i get a error says After effects error: Can not add a property with name "CC Split 2" to this PropertyGroup. im just a newbie in adobe after effects, i hope you can help me. i want to make my baby girl sings gangnam style, pls help me. sorry for my bad english..
Just seen your video - downloaded and got a great result an hour later - one question - the open mouth inside is Transparent and not BLACK, so it looses the sense of the mouth hole. Is that a preset i can change? help appreciated! Many thanks!
Auto Lip-Sync always just "cuts a hole" in layer, so whatever other layer is below will become visible. You can put a black solid layer below the layer, to which you applied Auto Lip-Sync, for example. You can create a solid in the Ae menu Layer->New->Solid...
I'm having issues when placing teeth and a tongue behind the mouth as it is showing around the mouth when it goes back to a closed position. How do I rectify this?
Emma Hildreth the easiest solution is to apply Auto Lip-Sync to a layer that is large enough such that it covers the entire teeth and tongue layers. So, for example, a layer of the entire head instead of a layer containing only the mouth region. Alternatively, you can create a solid layer on top of the teeth layer, draw a mask on it such that it roughly contains (roughly) the region of the open mouth where the teeth should be visible and then set this layer as alpha matte for the theeth layer. By that, no matter how the teeth move, they are always clipped to the masked region of the solid.
Hi there. When I get to step 4. It places the opening of the mouth below where I want it to go. How do I move the opening so it sits on top of the lips/mouth in my video? Thanks.
If the corners of the mouth are not where you want them, make sure to set those properly on step 1. If the mouth is opening too much, in step 4 (or also later) you can change the effect controls "upper lip height" and "lower lip height" as needed. Note that in general, Auto LipSync assumes that you start with a closed mouth. If you start with an image of a mouth that is already open, please try to warp it into a closed mouth (for example in Photoshop) before applying Auto Lip-Sync.
Auto Lip-Sync is a plugin for After Effects. For general Ae questions like this one, I recommend to ask in this forum: forums.adobe.com/community/aftereffects
Wonderful tool, has a lot of potential! I just purchased it and am enjoying it. One question: Is there a way to eliminate or avoid the mouth jitter that I sometimes get? It looks like his lips are trembling. is there a way to make it so that only the more dominant aspects of the audio signal are recognized, or a way to even things out so that there's not so much mouth jitter? I didn't notice it on the first character I did, so maybe there's something about the audio file characteristics. Any suggestions would be greatly suggested. Thanks!
if you see such a jitter it means your audio is noisy. So the best approach is to make sure your audio does not contain any background noise before running Auto Lip-Sync. As a quick fix, you could try to apply a smooth expression to the voce volume keyframes. TO do this, alt-click on the keyframe stop watch of the voice volume property to activate the expression of this property and then enter as expression smooth(width = 0.2, 10) To smooth more, increase the 0.2 to higher values. Cheers, Mathias
In the Voice Volume attribute 18.08 you can see a graph. Select the points in the graph you want to have no movement of the mouth, and make them zero, delete them, or make them a straight line to the right amount you wish the mouth to be open or closed.
Great video I’m using the trial right now, but I want to purchase the plugin once the trial is over. Just wanted to know how you created the tongue and teeth for your character. As my character is left with a black hole for a mouth.
No, the render speed is the same. For optimizing the render speed of Auto Lip-Sync see aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
Auto Lip-Sync always reacts to the sound that is currently audible when it is applied. So you can first mute all audio in Ae except character 1 and then run Auto Lip-Sync for character 1. Then mute all audio except character 2 and run Auto Lip-Sync on character 2. Usually it is not a good idea to have more than one Auto Lip-Sync on the same layer. So if your characters are on the same source video clip, you can use two copies of the layer and mask them such that one contains the region with the face of character 1 and one the region with character 2.
Please my computer is too slow in ram preview and Effect liquify my computer cpu AMD-FX8150-8Core-- ram 12G-1600---Gskill VIG -AMD- Radeon-HD6570 WD--SATA/64MB/Cache Please needy answer for me and thank you
Make sure to use the most recent version of Auto Lip-Sync. If it still does not work, please open a support ticket at aescripts.com/contact/ This issue is caused by non-english versions of Ae and should be fixed in the most recent version of Auto Lip-Sync.
I hope someone will update this tutorial in 2022 to simplify, because today with the resources of after effects 2021 I believe that mocha is not necessary, does anyone know how to indicate a more updated tutorial?
In After Effects 2022 mocha is not s standalone app anymore, but a plugin. Hence, the workflow to create a stabilized precomp is a little bit different. This tutorial explains how to create stabilized precomps with the mocha plugin version that is included now in Ae: mamoworld.com/tutorials/stabilized-precomps-mochaimport-v6-and-mocha-ae-plugin
Hey man do you have any idea to recreate this simply using the puppet tool? I just wanna try it out without the plugin. I know there's the CS Split option, but it only splits straight mouths. Plus it doesn't make the mouth come together for "ooo" shapes.
Hi Chris, I just replied to your support ticket on aescripts. You have to install Auto Lip-Sync in Ae using the menu command "File->Scripts->Install Script UI Panel".
Think about it this way: If the tool saves you only one hour of work and we assume that you get payed reasonably for your work, it already pays off. Below, crazydan48 says in his comment that he could to in 30mins what took 6 hour before. Now you can do the math. :-)
@@sasankvempati4609 Auto Lip-Sync only works with After Effects. You can use it in After Effects and then import your After Effects composition as a clip in Premiere Pro (Dynamic Link), but still all the animation work has to be done in After Effects.
Can you easily swap in a new audio track for the same character, or do you need to go through all the re-morphing the mouth stuff every time you get a new audio track even if the head has not changed? I don't see a way to have it reanalyze my audio? thanks!
still getting the error :( when i press the continue in step 2, in the upper side theres like a converting audiio keyframes. when it gets to 97% i getting the error. i think my dream for my baby singing gangman style is over :( i dont know what to do because i dont know much about adobe after effects :(
How can I animate more than one mouth at the same time? Because I always get this error message: Unable to call"property" because of 1 parameter. The string is too long, it can only be 39 bytes after conversion. Thanks
+Femke De Bruyne which version of AE are you using and when exactly does the error happen? In general, to create more than one mouth, I would recommend to do it on separate layers (one layer for each mouth). If you have just 1 footage layer, you can use for each mouth one adjustment layer on top of the actual footage instead of applying Auto Lip-Sync directly to the footage layer. Just make sure that when you run the AutoLip-Sync wizard the first time, that only the first voice is audible and when you run it the second time on the second adjustment layer, only the second voice is audible.
Hello! Is it possible to replace the voice with the already created LIP? By the way, I am Japanese, but if the name of the layer that moves the mouth contains a Japanese language, I got an expression error when generating nulls for the tongue and jaw. Typing the name of the layer that moves the mouth back to English fixed the error. If you encounter such problems in languages other than English, you may be able to resolve them.
Thank you for the hint! I think non-latin characters cause trouble in expressions, unfortunately. Here is a tutorial showing how to replace the voice: ruclips.net/video/A9vsWCjcwDg/видео.html
Hi, i'm using the trial version of lip sync. First time i used it worked great. Second tryout: I run thru the wizard process which works fine. but when i finish the wizard and want to do some touch ups, After effects starts peaking my processor to 100 - 110%... i'm using small video files and low resolutions. i'm running a i7 with 16gigs of ram Is this a known problem? thanks Vincent
Hi Vincent, usually, this only happens when you use high resolution images. The speed simply depends on how many pixels Auto Lip-Sync has to process. When you have a huge image, apply Auto Lip-Sync to it and then scale it down, the process will be very slow. If you scale down your image in Photoshop to the size you need in the final clip and apply Auto Lip-Sync to this low-res variant, it will me much faster. Alternatively you can scale it down in AE in a precomp that has a low resolution (and NOT "collapse transformation" enabled) and apply Auto Lip-Sync to the precomp. To speed it up even further, you can build the project such that the layer only contains the mouth region that actually deforms. All the rest of the face can be placed on a layer below. If all of this does not help, you can also send the project to info@mamoworld.com such that we can check what is slow in your example. Cheers, Mathias
Hello Mathias, ive just wrote to your web mail, cause i have a error message when i try to create teeth and tongue. i hope you answer, cause my boss is making my life impossible! thanks, Nacho.
If you have a lot of perspective change, it is difficult. But if the object is just moving like the Bhudda, you can apply Auto Lip-Sync in a stabilized precomp as shown here: cgi.tutsplus.com/tutorials/a-look-at-how-to-use-auto-lip-sync--ae-20961
It works with any kind of video or image. It works best if the mouth is a straight line, if it is not, you can always warp it onto one as shown in the tutorial. But if you have an illustrator character, it is probably easier to change the mouth inside Ai to a straight line before importing it to Ae.
See here for some tips to increase render speed of Auto Lip-Sync aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/#slowrender
Yes, you can. Just run the Auto Lip-Sync Assistant twice. Each time make sure before you run it that only the audio of the voice you want to animate is audible. If you have each voice on a separate audio file, just mute the audio of the other voices temporarily. If they are on the same audio file, use keyframes on the audio level to mute the parts where the other people are talking.
I used another liquify effect to warp the eye such that it looks closed.Then I keyframed the Liquify's "Distortion Percentage" to animate between open and closed eyes.
In the first step, with the "Straighten Mouth Liquify" effect, you need to get rid of the smile and make sure the mouth is a straight line. When forming the final mouth shapes later, you can reintroduce the smile. For the teeth, you need to create new teeth on a layer below the actual mouth.
Which version of Auto Lip-Sync are you using? Please make sure to use the most recent version (1.10.000) and if you still have the issue, open a support ticket here and add a screenshot of the error message: aescripts.com/contact/
Hey, can you use this plugin to auto lip sync a mouth you create for a 2d cartoon? I made 2 separate psd files, one with the caracter and 1 with 7 differenth mouth shapes, for the main letter types. Would this work? Thanks!
Hi, you can use it for cartoons, but it does not work by switching between different draws mouth shapes. If you want to use it for cartoons, you only need one mouth shape (closed mouth) and all the animation is generated by warping this one shape.
Is there a way to shut off the lip sync after it is done because my file is moving really slow now. I tried to mute, shut off FX, and lock it. My file is still moving slower when Im making adj to other parts of the video. Thanks.
If you deactivate all effects on the layer, it should render fast again. Alternatively, you can setup your project such that Auto Lip-Sync is done in a precomp. Then you can simply render a proxy for the precomp once you are happy with the mouth animation.
Hi Joe, please make sure that - you set markers on this layer, not composition markers - the slider "additional O-Shape at markers" has a value that is large enough, - the O-Shape deformation effect is not disabled If all of this doesn't help, please send me the project to info@mamoworld.com and I will take a look. Cheers, Mathias
Joe K In a composition you can either set markers on an individual layer or on the composition itself. If you set them on the composition itself, they are shown at the very top of the timeline. But Auto Lip-Sync only considers the markers on the layer where you have the Auto Lip-Sync rig (no matter whether the layer itself is a composition or another kind of layer). If Auto Lip-Sync would also consider the composition markers, you would run into issues if you have more than one Lip-Sync layer, because all mouth would react to those markers simultaneously.
Oh okay. Thanks a lot. The program is really going to make things so easy for me and speed up my work. Ill send you a link when Im done. Keep up the awesome programs!
Hii, i was following your tutorial and i was really excited. When i was done with the 6 steps i wanted to see how it looked so far but it didnt load. I turned of the O expression and set the quality to a quarter and it did load now, only veeery slow. I tried rendering it but has been rendering for 2 hours now. Do you have any idea if this is fixable or speed op the progress??
Hi Elizabeth, see section "What to do if Auto Lip-Sync renders slow" here aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
scorpion Here you find all tutorials about Auto Lip-Sync. mamoworld.com/tutorials?filter=tid-64 The one about the talking car shows a method how to do it with moving objects. The talking chipmunk shows an alternative approach how to animate the movement manually if it is hard to track.
tried this product years ago, and it was buggy as hell. Came back to try it again, it still crashes all the time after doing the liquify (step 2) part. Can't say I can recommend this, as much as I want it to work.
The best way to solve such issues it to open a support ticket at aescripts.com/contact My best guess is that you apply Auto Lip-Sync to photos with a high resolution and that your machine is not able to process the effects on such huge layers. If your plan is to render a 1920x1080 video, for example, make sure to use a photo of that size. Using a much bigger photo and scaling it down makes the calculation of the warps MUCH slower (since every pixel of the huge picture needs to be processed). Also, it would be very helpful to hear which error messages you get. The more details I know, the quicker and better I can help.
This is a top-knotch script. The entire package is well designed, and your support for the product is of the highest quality. Excellent work, sir.
Thank you for the feedback, Geoffrey. :-)
Yes, working with individual phonemes yields a different style. We aimed to find a good balance between making it easy to use and look good. Thats why we decided for automatic mouth animation and not asking the user to provide manual mouth shapes for each phoneme.
DUDE! I COULD KISS YOU! Not only is this plugin AMAZING! But I've had After Effects for years without realizing you just hold down CONTROL and drag the timeline to hear the sounds! I'VE BEEN DOING RENDER PREVIEWS THIS ENTIRE TIME OMG! * hugs you tightly and doesn't let go * My only issue is, why is mine transparent inside the mouth and not black like yours? (I mean I can add a layer of black behind it but it didn't seem you did that) Also, the white won't go away, there is not cleaning this, it's very cartoony in style there are literally only black and white colors and it's adding a whiteness inside the mouth that won't go away no matter HOW much I try to smudge. It's really straight so...not sure how to fix this.
Glad you like it :-) The inside of the mouth is always transparent. Maybe in the tut I had the background color of the comp set to black. So yes, the best way to color the inside is to put a colored solid behind it.
Why does the mouth shape change just from adding a marker please? I understand the setup you have for fine tuning, but i cannot understand why when you add the first marker, it changes anything?
Hi Matthieu, yes, I track it in mocha, create a stabilized precomp and do the Lip-Sync inside the precomp. Take a look at the "Tutorial about the talking car" (see link in the video description). It shows exactly this process.
11 years ago but still rocks in 2023 !!
Thank you for the feedback, followspot44. Auto Lip-Sync does not occur in the AE effects. You find it in the Window menu of After Effects.
Thank you Mathias - great idea for a plugin! and executed well!
After downloading the plugin i was running a 30 second test video in an hour! haha!
Previous lip-syncs this length took me about 6 hrs of frustratiing, and painful image swapping and hundreds of keyframes. Yay!
nice
It's still pretty amazing though. If I ever do anything more 3D style, I would definitely try it! I've tried using papagayo, pasting the generated keyframes into After Effects, but I think it's just faster and more accurate for me to just keyframe by hand. I've mapped my +/- keys to change the mouth shape keyframes based on their time remapped frame. It works fairly well, and faster than completely by hand, but something fully automated that worked with time remapped layers would be amazing! :-)
You're a life saver! By the way, loved your pronunciation :D XD
Ze german accent is strong in zis one.
Hi Eddy,
on the aescripts website go to
Support -> Knowlegde Base -> Installation -> How to install and run scripts
There is a video explaining how to install scripts like Auto Lip-Sync.
Best,
Mathias
Will you give heart after 8 years 🤗
Very helpful bro...
Super helpful- thanks!
a low budget AE plugin that works perfectly and is actually intuitive? Whats the world coming to?
:-)
$40 low budger? Wish i had your budget plan...
You know, the Talking Head plugin work better for me, its soo cool!, because my animation are in 2D. AutoLyps-sync is more for 3D stuff or pre-made video o pictures , if i say so. thx for everything
Talking Heads is great if you have drawn individual mouth shapes yourself and want to toggle between them. Auto Lip-Sync warps the mouth which does not require you to provide individual mouth shapes and gives a very different visual result. Which tool is best for you depends on your workflow and mostly the style you are looking for.
mamoworld.com Yes, Exactly, that was my case, i already had drawed my mouths.
I would like to say that I have just experienced great customer service from Manoworld.
always happy to help :-)
If have two characters and only one voice file, whats the best way to have them talk? I know they both will talk at the same time, can i delete certain parts of the lip sync sentence on one character and then repeat the process on the other character,
Big brother
Please you made tutorial for animal lip syn in fresh any easy way with mocha or without mocha.
In updated video like tree,car,animal.
May you made animal lips syn video.
This is a fantastic tool; I've been using it for years and I'm really happy with it! I do have some questions about how it works with the latest version of AE, though; has anyone else run into "after effects error: unable to compute distortion"? I'm also having a tough time exporting to Adobe Encoder with lip sync on, but no issues when I remove it... Any ideas? (also, is there a better place than RUclips to ask these questions? ;)
Hi Sandy, thank you for your feedback. We are not aware of such an issue, yet. Could you please open a support ticket at
aescripts.com/contact/ Please include as much detail as possible. Does it happen sporadically or always? Only for one specific project or clip? Could you attach a project where the issue occurs? The more details I know, the quicker and better I am able to help.
In general, this sounds like an issue with one of the warp effects that Auto Lip-Sync is using for its rig. So most likely the issue is on Adobe's end. But also in that case I can contact the Adobe team and point them to the issue.
@@mamoworldae Think I got it figured out, and I think it was my fault! Seems to be working perfectly again; I think I accidentally used the wrong mesh warp tool in one of the steps. Thanks so much for your speedy reply, and again, love the tool!
@@SDebreuil That's great news! Thank you for the feedback :-)
amazing tuts very nice work i really enjoy and easy way to use
can't watch this without liking and subscribing to this !
Before I installed the CC split, and I'm having the same problem.
Maybe I should uninstall to see if the green lines disappear. What do you think?
Congratulations on your plugin.
Thank you soo much!! This program is phenomenal!!!
If you have a problem with Auto Lip-Sync, please open a support ticket at aescripts and give a detailed problem description. The more detailed you describe the problem, the quicker we will be able to help.
how do you proceed when you have a travelling shot (just like in all your examples). Do you stabilize the shot first?
good afternoon I have problem with Auto Lip-Sync I seek support files scrip ey entered Auto Lip-Sync but do not see it in After Effects CS3 I wonder where I find
Bro can u plz say that ,from this software i can animate only videos or i can do this with some of the 3d model .which later can be used in 3d softwares ...
Hi, Auto Lip-Sync is only for videos, since it only works inside Adobe After Effects.
Looks fantastic!
THANK YOU MY FRIEND!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
This is neat, but probably wouldn't work for me. If it would analyze the phonemes from the audio and just return an integer value for each sound, that would be better. My mouth shapes are already drawn, and are drawn differently for each phoneme. They only need to be turned on and off for each keyframe, not warped. I can see this being useful for 3d-type cartoons, but mine uses a more 2d style.
Hi, what exactly does not work for you? Please create a support ticket at aescripts and I am sure we will be able to solve your problem quickly.
Best,
Mathias
Awesome Tecnics!
this is really nice and fashionable
Brilliant, brilliant, brilliant.
I have two green lines in my project ?
Do you please explain me why.
Hi papa jack,
maybe you run out of memory. If you use a picture, make sure that it is not too large. Best use a picture that has the size that the final video should have (e.g. 1920×1080 pixel).
Cheers,
Mathias
Cheers,
Mathias
sänks for se tutoriäl :)
Great! I am always curious to see such experiments. Can you post it as a video reply to this video?
thanks! I like your products by the way... :)
Sounds good. Thanks for letting me know :)
Hi Naturelife2000,
the trial period is 14 days.
Cheers,
Mathias
Hi Ladyofthe Nba,
does your composition have a length of only a single frame?
HI Moreira Victor, did you use a trial version of some plugin?
If my subject head is slightly moving from side to side, how do I make the auto lipsync mouth automatically track it? My brain is not processing how a stabalized precomp will help
See this tutorial: ruclips.net/video/PVcsoULpDYI/видео.html
A "stabilized precomp" rig gives you a composition inside which the tracked object is not moving anymore (the entire composition is moving with the track). Therefore, inside the precomp, the head is not moving anymore and you can apply Auto Lip-Sync inside of it without the need to worry about any movements. The cool thing is that all changes you do in the stabilized precomp will automatically also be visible in the main composition. See this tutorial for an overview how stabilized precomps work: ruclips.net/video/gMBJ1R3t4dw/видео.html
Please tell me the is an update to this or some NEW software to make this easier in 2020?
Auto Lip-Sync is still alive and compatible with CC 2020. I am also not aware of any simpler Lip-Sync solution for After Effects.
thank you very much!
hi, i just want to ask why im getting an error after step 2. i get a error says After effects error: Can not add a property with name "CC Split 2" to this PropertyGroup. im just a newbie in adobe after effects, i hope you can help me. i want to make my baby girl sings gangnam style, pls help me. sorry for my bad english..
Just seen your video - downloaded and got a great result an hour later - one question - the open mouth inside is Transparent and not BLACK, so it looses the sense of the mouth hole. Is that a preset i can change? help appreciated! Many thanks!
Auto Lip-Sync always just "cuts a hole" in layer, so whatever other layer is below will become visible. You can put a black solid layer below the layer, to which you applied Auto Lip-Sync, for example. You can create a solid in the Ae menu Layer->New->Solid...
I'm having issues when placing teeth and a tongue behind the mouth as it is showing around the mouth when it goes back to a closed position. How do I rectify this?
Emma Hildreth the easiest solution is to apply Auto Lip-Sync to a layer that is large enough such that it covers the entire teeth and tongue layers. So, for example, a layer of the entire head instead of a layer containing only the mouth region. Alternatively, you can create a solid layer on top of the teeth layer, draw a mask on it such that it roughly contains (roughly) the region of the open mouth where the teeth should be visible and then set this layer as alpha matte for the theeth layer. By that, no matter how the teeth move, they are always clipped to the masked region of the solid.
Tongue, not thungh. Pronounce it as Tung. Additionally, Subtle. pronounced Suttle. Not Subtile.
Hi there. When I get to step 4. It places the opening of the mouth below where I want it to go. How do I move the opening so it sits on top of the lips/mouth in my video? Thanks.
If the corners of the mouth are not where you want them, make sure to set those properly on step 1. If the mouth is opening too much, in step 4 (or also later) you can change the effect controls "upper lip height" and "lower lip height" as needed. Note that in general, Auto LipSync assumes that you start with a closed mouth. If you start with an image of a mouth that is already open, please try to warp it into a closed mouth (for example in Photoshop) before applying Auto Lip-Sync.
What would be a good laptop to buy that would run this software easily
Auto Lip-Sync is a plugin for After Effects. For general Ae questions like this one, I recommend to ask in this forum: forums.adobe.com/community/aftereffects
Wonderful tool, has a lot of potential! I just purchased it and am enjoying it. One question: Is there a way to eliminate or avoid the mouth jitter that I sometimes get? It looks like his lips are trembling. is there a way to make it so that only the more dominant aspects of the audio signal are recognized, or a way to even things out so that there's not so much mouth jitter?
I didn't notice it on the first character I did, so maybe there's something about the audio file characteristics. Any suggestions would be greatly suggested. Thanks!
if you see such a jitter it means your audio is noisy. So the best approach is to make sure your audio does not contain any background noise before running Auto Lip-Sync.
As a quick fix, you could try to apply a smooth expression to the voce volume keyframes.
TO do this, alt-click on the keyframe stop watch of the voice volume property to activate the expression of this property and then enter as expression
smooth(width = 0.2, 10)
To smooth more, increase the 0.2 to higher values.
Cheers,
Mathias
The smoothing advice was exactly what I was looking for. Thank you for the quick and helpful response!
I just flatten the Voice volume for that area. It's especially needed when the audio has no speaking, but there is other sound in the clip.
When you say "flatten the Voice volume", do you mean you compress it, limit it, normalize it? Or what exactly do you mean by "flatten"? Thanks!
In the Voice Volume attribute 18.08 you can see a graph. Select the points in the graph you want to have no movement of the mouth, and make them zero, delete them, or make them a straight line to the right amount you wish the mouth to be open or closed.
Great video I’m using the trial right now, but I want to purchase the plugin once the trial is over. Just wanted to know how you created the tongue and teeth for your character. As my character is left with a black hole for a mouth.
mouth and teeth are created starting at 19:19 in the video.
Also, this video shows a different approach to creating teeth at 28:38 ruclips.net/video/PVcsoULpDYI/видео.html
Thank you
is the trial version of this plugin render slower than the full version?
No, the render speed is the same. For optimizing the render speed of Auto Lip-Sync see aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
I can’t figure out how to make the teeth and tongue with the mask.
To get started with using masks, I recommend this tutorial: ruclips.net/video/o0wzjcyvOiA/видео.html
I am using the lip sync but I need to use it on two or more characters? what would be the best way to have lip sync for more than one person? Thanks
Auto Lip-Sync always reacts to the sound that is currently audible when it is applied. So you can first mute all audio in Ae except character 1 and then run Auto Lip-Sync for character 1. Then mute all audio except character 2 and run Auto Lip-Sync on character 2. Usually it is not a good idea to have more than one Auto Lip-Sync on the same layer. So if your characters are on the same source video clip, you can use two copies of the layer and mask them such that one contains the region with the face of character 1 and one the region with character 2.
Please my computer is too slow in ram preview and Effect liquify
my computer cpu AMD-FX8150-8Core--
ram 12G-1600---Gskill
VIG -AMD- Radeon-HD6570
WD--SATA/64MB/Cache
Please needy answer for me and thank you
you are welcome!
Thank you for your comment! :-)
If you like to play with the 14 days trial, think about doing something for the Auto Lip-Sync contest on Aetuts+.
i can't go to step3, "could not run ae menu command to convert audio to keframes."
How do you solve this error?
Make sure to use the most recent version of Auto Lip-Sync. If it still does not work, please open a support ticket at
aescripts.com/contact/
This issue is caused by non-english versions of Ae and should be fixed in the most recent version of Auto Lip-Sync.
I hope someone will update this tutorial in 2022 to simplify, because today with the resources of after effects 2021 I believe that mocha is not necessary, does anyone know how to indicate a more updated tutorial?
In After Effects 2022 mocha is not s standalone app anymore, but a plugin. Hence, the workflow to create a stabilized precomp is a little bit different. This tutorial explains how to create stabilized precomps with the mocha plugin version that is included now in Ae: mamoworld.com/tutorials/stabilized-precomps-mochaimport-v6-and-mocha-ae-plugin
Hey man do you have any idea to recreate this simply using the puppet tool? I just wanna try it out without the plugin. I know there's the CS Split option, but it only splits straight mouths. Plus it doesn't make the mouth come together for "ooo" shapes.
The puppet tool is not the right tool for this purpose. Auto Lip-Sync uses the split and liquify effects of Ae internally.
Hi, how long is the trial version valid for?
I have purchase this and it won't work with my Adobe after effects
Hi Chris, I just replied to your support ticket on aescripts. You have to install Auto Lip-Sync in Ae using the menu command "File->Scripts->Install Script UI Panel".
Think about it this way: If the tool saves you only one hour of work and we assume that you get payed reasonably for your work, it already pays off. Below, crazydan48 says in his comment that he could to in 30mins what took 6 hour before. Now you can do the math. :-)
Hello do u have the same tutorial to work with premare pro????
@@sasankvempati4609 Auto Lip-Sync only works with After Effects. You can use it in After Effects and then import your After Effects composition as a clip in Premiere Pro (Dynamic Link), but still all the animation work has to be done in After Effects.
Can you easily swap in a new audio track for the same character, or do you need to go through all the re-morphing the mouth stuff every time you get a new audio track even if the head has not changed? I don't see a way to have it reanalyze my audio? thanks!
yes, you can:
mamoworld.com/tutorials/auto-lip-sync-how-replace-audio-after-creating-mouth-rig
were can i download the plugin?
do you recognize the plugin milleniathinker uses?
I don't know milleniathinker's work. Maybe you best ask milleniathinker?
still getting the error :( when i press the continue in step 2, in the upper side theres like a converting audiio keyframes. when it gets to 97% i getting the error. i think my dream for my baby singing gangman style is over :( i dont know what to do because i dont know much about adobe after effects :(
How can I animate more than one mouth at the same time? Because I always get this error message: Unable to call"property" because of 1 parameter. The string is too long, it can only be 39 bytes after conversion. Thanks
+Femke De Bruyne which version of AE are you using and when exactly does the error happen? In general, to create more than one mouth, I would recommend to do it on separate layers (one layer for each mouth). If you have just 1 footage layer, you can use for each mouth one adjustment layer on top of the actual footage instead of applying Auto Lip-Sync directly to the footage layer. Just make sure that when you run the AutoLip-Sync wizard the first time, that only the first voice is audible and when you run it the second time on the second adjustment layer, only the second voice is audible.
excuse me, required plugins?
thank you! :-)
Hello! Is it possible to replace the voice with the already created LIP?
By the way, I am Japanese, but if the name of the layer that moves the mouth contains a Japanese language, I got an expression error when generating nulls for the tongue and jaw. Typing the name of the layer that moves the mouth back to English fixed the error. If you encounter such problems in languages other than English, you may be able to resolve them.
Thank you for the hint! I think non-latin characters cause trouble in expressions, unfortunately. Here is a tutorial showing how to replace the voice: ruclips.net/video/A9vsWCjcwDg/видео.html
A new tutorial please! With internal track er please
Yes, this is on my schedule for January 🙂
It is amazing.
Hi, i'm using the trial version of lip sync. First time i used it worked great.
Second tryout: I run thru the wizard process which works fine. but when i finish the wizard and want to do some touch ups, After effects starts peaking my processor to 100 - 110%... i'm using small video files and low resolutions. i'm running a i7 with 16gigs of ram
Is this a known problem?
thanks
Vincent
Hi Vincent,
usually, this only happens when you use high resolution images. The speed simply depends on how many pixels Auto Lip-Sync has to process.
When you have a huge image, apply Auto Lip-Sync to it and then scale it down, the process will be very slow. If you scale down your image in Photoshop to the size you need in the final clip and apply Auto Lip-Sync to this low-res variant, it will me much faster. Alternatively you can scale it down in AE in a precomp that has a low resolution (and NOT "collapse transformation" enabled) and apply Auto Lip-Sync to the precomp.
To speed it up even further, you can build the project such that the layer only contains the mouth region that actually deforms. All the rest of the face can be placed on a layer below.
If all of this does not help, you can also send the project to info@mamoworld.com such that we can check what is slow in your example.
Cheers,
Mathias
Hello Mathias, ive just wrote to your web mail, cause i have a error message when i try to create teeth and tongue. i hope you answer, cause my boss is making my life impossible! thanks, Nacho.
Hey there. With the talking bhudda, how can it be done with the camera moving but keeping the proprotions/perspective correct?
If you have a lot of perspective change, it is difficult. But if the object is just moving like the Bhudda, you can apply Auto Lip-Sync in a stabilized precomp as shown here: cgi.tutsplus.com/tutorials/a-look-at-how-to-use-auto-lip-sync--ae-20961
cool thanks man, will be getting this in due course. nice work
How do I when rendering heavy on RAM 8 GB Windows
See the section "what to do if Auto Lip-Sync renders slow" here aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
Матиаз спасибо за скрипт и уроки .......!!!!!!!!!!
Does it work with an Illustrator image?
It works with any kind of video or image. It works best if the mouth is a straight line, if it is not, you can always warp it onto one as shown in the tutorial. But if you have an illustrator character, it is probably easier to change the mouth inside Ai to a straight line before importing it to Ae.
mamoworld.com Thx, Does this plugin have a trial version?
@@dans3XD yes, green TRY button here aescripts.com/auto-lip-sync/
The trial, of much time last?
@@dans3XD I am not 100% sure, one week or two.
I am using MaltyCam from maltaannon
Hello, I installed the Plugin but in AE the AutoLipSync window has nothing in there. What am I doing wrong?
Did you make sure to restart Ae after installing Auto Lip-Sync?
@@mamoworldae Yes.
@@mamoworldae Hello, now it's working. What are the limitations of the test version? Is it limited up to 30secs?
The preview rendering is painfully slow, how can I fix this?
See here for some tips to increase render speed of Auto Lip-Sync
aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/#slowrender
Can you animate more than one mouth at the same time? Having a conversation????
Yes, you can. Just run the Auto Lip-Sync Assistant twice. Each time make sure before you run it that only the audio of the voice you want to animate is audible. If you have each voice on a separate audio file, just mute the audio of the other voices temporarily. If they are on the same audio file, use keyframes on the audio level to mute the parts where the other people are talking.
Thanks So Much! I'll try and let you know!
How do you make the tree's eyes blink?
I used another liquify effect to warp the eye such that it looks closed.Then I keyframed the Liquify's "Distortion Percentage" to animate between open and closed eyes.
@@mamoworldae thank you!
Hi, if my footage is already smiling with open mouth and teeth, how can I animate it thru the plug in?
In the first step, with the "Straighten Mouth Liquify" effect, you need to get rid of the smile and make sure the mouth is a straight line. When forming the final mouth shapes later, you can reintroduce the smile. For the teeth, you need to create new teeth on a layer below the actual mouth.
i am getting a reference error 3343 line when i try to use this
Which version of Auto Lip-Sync are you using? Please make sure to use the most recent version (1.10.000) and if you still have the issue, open a support ticket here and add a screenshot of the error message: aescripts.com/contact/
Hey, can you use this plugin to auto lip sync a mouth you create for a 2d cartoon?
I made 2 separate psd files, one with the caracter and 1 with 7 differenth mouth shapes, for the main letter types. Would this work? Thanks!
Hi, you can use it for cartoons, but it does not work by switching between different draws mouth shapes. If you want to use it for cartoons, you only need one mouth shape (closed mouth) and all the animation is generated by warping this one shape.
mamoworld.com
Ok thank you!
I can't buy things D:
Is there a way to shut off the lip sync after it is done because my file is moving really slow now. I tried to mute, shut off FX, and lock it. My file is still moving slower when Im making adj to other parts of the video. Thanks.
If you deactivate all effects on the layer, it should render fast again. Alternatively, you can setup your project such that Auto Lip-Sync is done in a precomp. Then you can simply render a proxy for the precomp once you are happy with the mouth animation.
Okay thanks again. Im almost done with the Lip Sync animation. Maybe another week. Then You can check it out.
YES AND TO HARD FOR ADOBE TO FIX THAT.
LAZINESS is a disinclination to activity or exertion despite having the ability to ""do so"".
after effect value -0 out of range
help
THANK YOUU
Can i use this plugin Af2019 ??
Yes, it is compatible with any Ae version that is newer than CS3 (see tab "compatibility" on the product page aescripts.com/auto-lip-sync/)
HI I set up my first practice rig. But the markers dont seem to do anything. I did move the mask around a little. Any suggestions?
Hi Joe,
please make sure that
- you set markers on this layer, not composition markers
- the slider "additional O-Shape at markers" has a value that is large enough,
- the O-Shape deformation effect is not disabled
If all of this doesn't help, please send me the project to info@mamoworld.com and I will take a look.
Cheers,
Mathias
So you cant set markers on composition layers? Why? I did do this.
Joe K In a composition you can either set markers on an individual layer or on the composition itself. If you set them on the composition itself, they are shown at the very top of the timeline.
But Auto Lip-Sync only considers the markers on the layer where you have the Auto Lip-Sync rig (no matter whether the layer itself is a composition or another kind of layer). If Auto Lip-Sync would also consider the composition markers, you would run into issues if you have more than one Lip-Sync layer, because all mouth would react to those markers simultaneously.
Oh okay. Thanks a lot. The program is really going to make things so easy for me and speed up my work. Ill send you a link when Im done. Keep up the awesome programs!
Joe K
ok, I am looking forward to see what you create with Auto Lip-Sync.
Hii, i was following your tutorial and i was really excited. When i was done with the 6 steps i wanted to see how it looked so far but it didnt load. I turned of the O expression and set the quality to a quarter and it did load now, only veeery slow. I tried rendering it but has been rendering for 2 hours now. Do you have any idea if this is fixable or speed op the progress??
Hi Elizabeth, see section "What to do if Auto Lip-Sync renders slow" here aescripts.com/knowledgebase/index/view/faq/auto-lip-sync-frequently-asked-questions/
how do you do it with moving scenes?
scorpion Here you find all tutorials about Auto Lip-Sync.
mamoworld.com/tutorials?filter=tid-64
The one about the talking car shows a method how to do it with moving objects. The talking chipmunk shows an alternative approach how to animate the movement manually if it is hard to track.
tried this product years ago, and it was buggy as hell. Came back to try it again, it still crashes all the time after doing the liquify (step 2) part. Can't say I can recommend this, as much as I want it to work.
The best way to solve such issues it to open a support ticket at aescripts.com/contact
My best guess is that you apply Auto Lip-Sync to photos with a high resolution and that your machine is not able to process the effects on such huge layers. If your plan is to render a 1920x1080 video, for example, make sure to use a photo of that size. Using a much bigger photo and scaling it down makes the calculation of the warps MUCH slower (since every pixel of the huge picture needs to be processed).
Also, it would be very helpful to hear which error messages you get. The more details I know, the quicker and better I can help.
"...by the way this feature is only available in CS6..."
Gee, that would have been nice to know a little earlier