RUclips will have a dubbing feature built into studio next year, be interesting to see if it will be similar to this. If viewers can select which language they want to listen in then it might not be necessary to set up separate channels for different languages.
I've heard that too and you're right - it would be awesome if all videos were just available in multiple languages on the same channel!! Indeed, some of the AI tools are being built-in to the platforms we already use and will make some of these things obsolete as 3rd party tools.
I’m excited myself. They’ve actually had this audio track thing for a while now, (an Assassin's Creed trailer came out some time in 2020-2021 with an audio description track), but us normies haven’t been allowed to use it - only big creators. Kind of silly if you ask me, but at least we’re finally gonna get it. @@excelerator
I wrote in Polish, the film had a Polish title, but it was in English. Because of this, I wasted 30,000 credits to create a dub on ElevenLabs. As compensation, you should allow me to upload the translated film in Polish without question. It’s still generating, so I don’t know if it will turn out well.translated by ChatGPT
Thank you for the video. I used to use Eleven Labs with a copy of my voice to create voiceovers for English versions of my Ukrainian-language videos, but now I use my real voice. But I have a problem with my accent sometimes. Is it possible to use this tool (or any other in eleven labs) to overlay a copy of my voice on my real voice and thus remove all the problems with the accent? Or will it sound terrible and robotic?
I haven't tried it myself, but it does allow you to select other languages as the source language and then select English as the target language. So that should work.
Now I can dub any cartoon without having to hire a production company or team to translate the cartoon. The problem is that you have credits per month and if you have 2 hours you have to wait a whole month for the credits to renew and then you can continue dubbing.
@excelerator. Hi, I really like your videos. I’ve been learning a lot! Are there any classes out there for those who want to learn how to use text to speech, dubbing, etc?
So happy to hear you're getting something out of my videos!! As for classes, I'm sure they exist but I don't know of any personally (or even specific instructors) so I can't give any recommendations. My sources of knowledge have been RUclips and trial-and-error (mostly error 😃.) But if I see something that looks good, I will surely pass it along to you.
I just watch your video. Just curious if I can dub a whole 1 hour video using the paid plan? Because whenever selecting a video it says 500 mb or 45 minutes
There is a 100mb and 45-minute limit on how long the clip can be that you upload. You might try splitting the clip, start with the first section and then, in the dubbing studio, click the plus button to the right of the timeline to add a clip and try to add the second section. If the limit is truly per clip, this should work. If the limit is actually per project, it won't.
I did see its a very compelling option, I find it expensive per minute. For those who want to use them for a regular basis. They will need to purchase a high monthly plan. Looking forward to it, as AI hardware permits cheaper processing power per audio min. But its uber cool tho.
I agree, the cost could rack up quick for regular usage, especially for longer projects and may or may not produce a sufficient return. Like you said, the cost will hopefully come down as hardware costs decrease.
Can i dub from English to English? Maybe changing tonality from one voice to the others? Or English speaking with accent to native English speaking voice.
I just did a little testing with this in response to your question. I was able to dub from english to english. By default, it used 'clip clone' (a voice clone of the speaker in the original video) but I was able to edit the voice settings and change the voice for the new English translation to any voice from my voice lab. But, the lip movements and words weren't perfectly matched in the video/audio output. It wasn't necessarily out of sync, because I could see certain words and syllables hitting at just the right time, but some some facial movements didn't match the new speech well. Hope that helps. This wouldn't be a problem if you weren't trying to ensure lip-sync. But, if you don't lip-sync, using ElevenLabs speech-to-speech tool would probably be a much easier way to achieve a voice change/cleanup. Hope that helps!
Yes, dubbing uses your character balance. You can get a discount if you click the box to let elevenlabs put a "dubbing by elevenlabs" watermark on the video.
It somehow makes the audio in the new language, and the original video clip, the same length so you don't end up with audio drift, but it does not lip sync.
I guess to make the video understandable to folks who only speak a different language, even though it will be obvious that it was dubbed since the mouth movements won't align. I've seen a lot of movies and videos that do this. But, I agree, lio sync would be ideal.
Yes. This is probably not the most efficient way to translate a video you want to watch in a different language, but if you want to translate one for publishing, this is the tool.
@@excelerator Hello sir I just recently tried it however the dubbed voices was only on the top of the original voices I can clearly hear the original English Language isn't it should be remove and overcome by The Filipino Language I chose to Translation it Or should I use the paid version 11$ to make a clearly dubbed adaptation
That is not the expected behavior. I just tested converting english to Filipino and the output was in Filipino language only with no english (original language) heard. The dubbing studio is available in any paid plan. But, even without the dubbing studio, you can still use dubbing even in the free plan you just wouldn't have the dubbing studio to edit, adjust, and work with the tracks. If you are using dubbing studio (again, any of the paid plans have it) you might want to look at the tracks and see if you can isolate where the original language is and why it's bleeding through the generated dub. I hope that helps. If not, maybe ElevenLabs support can get you fixed up.
It is okay but I found that I had to make many adjustments to arrive at the finessed voice that I wanted. I was disappointed that each adjustment cost me credits, so it is too expensive in this respect. If you were able to fine tune the adjustments that you needed and then only pay for the final generated voice it would be worth subscribing. Unfortunately the current model is prohibitive. There is going to be a lot of competition for this type of app as AI evolves and becomes smarter - prices will have to become equally competitive to attract or retain subscribers.
I've looked at plenty but I can't say any are good. Even those that use preset characters have room for improvement. And the ones that try to lip sync a person in a user supplied or generated character... You may get the lips to move somewhat realistically, but they either keep the rest of the face still or have some odd movement.
Runway does a halfway decent job. CapCut just revamped their lip sync offering, but I haven't tried it out yet. They did well with lip sync in their AI characters, so there's hope.
I wanted to know how good this is based on my own language knowledge. As a native spanish speaker, your voice cloned to spanish is terrible, even when popeye spoke in the intro was all wrong. Maybe it has improved now.
👉 Get started with ElevenLabs:
excelerator.tech/getelevenlabs
Great Video Explanation! Looking forward to trying it!
Have fun!
RUclips will have a dubbing feature built into studio next year, be interesting to see if it will be similar to this. If viewers can select which language they want to listen in then it might not be necessary to set up separate channels for different languages.
I've heard that too and you're right - it would be awesome if all videos were just available in multiple languages on the same channel!! Indeed, some of the AI tools are being built-in to the platforms we already use and will make some of these things obsolete as 3rd party tools.
I’m excited myself. They’ve actually had this audio track thing for a while now, (an Assassin's Creed trailer came out some time in 2020-2021 with an audio description track), but us normies haven’t been allowed to use it - only big creators. Kind of silly if you ask me, but at least we’re finally gonna get it. @@excelerator
I wrote in Polish, the film had a Polish title, but it was in English. Because of this, I wasted 30,000 credits to create a dub on ElevenLabs. As compensation, you should allow me to upload the translated film in Polish without question. It’s still generating, so I don’t know if it will turn out well.translated by ChatGPT
Thank you for the video. I used to use Eleven Labs with a copy of my voice to create voiceovers for English versions of my Ukrainian-language videos, but now I use my real voice. But I have a problem with my accent sometimes. Is it possible to use this tool (or any other in eleven labs) to overlay a copy of my voice on my real voice and thus remove all the problems with the accent? Or will it sound terrible and robotic?
Very clear and informative. Thanks. Does it dub in the other direction? From a foreign language into English?
Oh, and what about music? If the voice sings, does the foreign language version sing? On key?
I haven't tried it myself, but it does allow you to select other languages as the source language and then select English as the target language. So that should work.
I can't find anything from ElevenLabs on using dubbing for music. My guess is that it would not work (or not work well), but I could be wrong.
finally, thank you ! you described it 100% better then eleven labs and influencers with 1m+ subscribers
You're too kind!
@@excelerator It's true !
Now I can dub any cartoon without having to hire a production company or team to translate the cartoon. The problem is that you have credits per month and if you have 2 hours you have to wait a whole month for the credits to renew and then you can continue dubbing.
True. If you're on the creator plan or above, you can buy more credits. Starter and below cannot.
thanks for the great examples, much appreciated
Glad it was useful
yeah hesa good kid
@excelerator. Hi, I really like your videos. I’ve been learning a lot! Are there any classes out there for those who want to learn how to use text to speech, dubbing, etc?
So happy to hear you're getting something out of my videos!! As for classes, I'm sure they exist but I don't know of any personally (or even specific instructors) so I can't give any recommendations. My sources of knowledge have been RUclips and trial-and-error (mostly error 😃.) But if I see something that looks good, I will surely pass it along to you.
@@excelerator thank you for replying
I just watch your video. Just curious if I can dub a whole 1 hour video using the paid plan? Because whenever selecting a video it says 500 mb or 45 minutes
There is a 100mb and 45-minute limit on how long the clip can be that you upload. You might try splitting the clip, start with the first section and then, in the dubbing studio, click the plus button to the right of the timeline to add a clip and try to add the second section. If the limit is truly per clip, this should work. If the limit is actually per project, it won't.
I did see its a very compelling option, I find it expensive per minute. For those who want to use them for a regular basis. They will need to purchase a high monthly plan. Looking forward to it, as AI hardware permits cheaper processing power per audio min. But its uber cool tho.
I agree, the cost could rack up quick for regular usage, especially for longer projects and may or may not produce a sufficient return. Like you said, the cost will hopefully come down as hardware costs decrease.
Great video
Glad you enjoyed it
Preciso assinar para ter acesso ao Studio?
Yes. Dubbing studio is only available in paid plans.
@@excelerator Qualquer assinatura, eu consigo acesso ao Studio?
@@excelerator Obrigado por responder 😃
Yes, even the cheapest paid plan (starter for $5/mo) includes dubbing studio.
Glad to help!
what about multiple voices like for say a documentary or a news piece
It can handle that. I included an example from elevenlabs in this video where they had 3 speakers.
Can i dub from English to English? Maybe changing tonality from one voice to the others? Or English speaking with accent to native English speaking voice.
I just did a little testing with this in response to your question. I was able to dub from english to english. By default, it used 'clip clone' (a voice clone of the speaker in the original video) but I was able to edit the voice settings and change the voice for the new English translation to any voice from my voice lab. But, the lip movements and words weren't perfectly matched in the video/audio output. It wasn't necessarily out of sync, because I could see certain words and syllables hitting at just the right time, but some some facial movements didn't match the new speech well. Hope that helps. This wouldn't be a problem if you weren't trying to ensure lip-sync. But, if you don't lip-sync, using ElevenLabs speech-to-speech tool would probably be a much easier way to achieve a voice change/cleanup. Hope that helps!
Does dubbing use minutes? Meaning, if I record a 5-minute clip and then dub it into 5 languages, did I just use 5 minutes or 30 minutes?
Yes, dubbing uses your character balance. You can get a discount if you click the box to let elevenlabs put a "dubbing by elevenlabs" watermark on the video.
The whole point of dubbing is to ensure the lip, syncs with the new language audio.
It somehow makes the audio in the new language, and the original video clip, the same length so you don't end up with audio drift, but it does not lip sync.
@@excelerator lol what's the point then
I guess to make the video understandable to folks who only speak a different language, even though it will be obvious that it was dubbed since the mouth movements won't align. I've seen a lot of movies and videos that do this. But, I agree, lio sync would be ideal.
Can you translate youtube videos?
Yes. This is probably not the most efficient way to translate a video you want to watch in a different language, but if you want to translate one for publishing, this is the tool.
I can't find the option " create a dubbing studio" is it in the paid version only ?
Yes, the dubbing studio is only available in paid plans.
Hello sir Can i ask
Can it dubbed the Voice of Multiple speaker "Woman and Man" in Movie and Recognize it Without changing their voice?
Yes, it will dub the voices (for all of the speakers) into whatever language you've selected.
@@excelerator Hello sir I just recently tried it however the dubbed voices was only on the top of the original voices I can clearly hear the original English Language isn't it should be remove and overcome by The Filipino Language I chose to Translation it
Or should I use the paid version 11$ to make a clearly dubbed adaptation
That is not the expected behavior. I just tested converting english to Filipino and the output was in Filipino language only with no english (original language) heard. The dubbing studio is available in any paid plan. But, even without the dubbing studio, you can still use dubbing even in the free plan you just wouldn't have the dubbing studio to edit, adjust, and work with the tracks. If you are using dubbing studio (again, any of the paid plans have it) you might want to look at the tracks and see if you can isolate where the original language is and why it's bleeding through the generated dub. I hope that helps. If not, maybe ElevenLabs support can get you fixed up.
It is okay but I found that I had to make many adjustments to arrive at the finessed voice that I wanted. I was disappointed that each adjustment cost me credits, so it is too expensive in this respect. If you were able to fine tune the adjustments that you needed and then only pay for the final generated voice it would be worth subscribing. Unfortunately the current model is prohibitive. There is going to be a lot of competition for this type of app as AI evolves and becomes smarter - prices will have to become equally competitive to attract or retain subscribers.
I do hope the pricing falls as competition increases and resources become more efficient.
Where is result video??
I'm sorry. I don't understand your question. 🤔
Does it sync lips?
No, it does not.
@@excelerator do you know any good lip sync tool
I've looked at plenty but I can't say any are good. Even those that use preset characters have room for improvement. And the ones that try to lip sync a person in a user supplied or generated character... You may get the lips to move somewhat realistically, but they either keep the rest of the face still or have some odd movement.
@@excelerator oh okay, but which is at least better than rest?
Runway does a halfway decent job. CapCut just revamped their lip sync offering, but I haven't tried it out yet. They did well with lip sync in their AI characters, so there's hope.
I wanted to know how good this is based on my own language knowledge. As a native spanish speaker, your voice cloned to spanish is terrible, even when popeye spoke in the intro was all wrong. Maybe it has improved now.
Thanks for bringing that insight. I really appreciate it.