So it's combining the script and vocal emotion of Notebook LLM, the facial expressions of Hedra, the realistic portraits of Vidu Studio, and the voices of Eleven Labs. It's very cool, but it definitely makes one long for a future where it's all provided by the same app.
Just one tip, since you were going for realism in the second example: make sure the woman's microphone isn't levitating. I'd also dial up the strength of her mouth movements, and have them smiling, since the voices sound like they'd be smiling.
Amazing Video I love how you didn't give away the punchline at start but still started with some powerful examples. Ended up being a pleasant surprise to see you take it to next level. Great thinking.
Great video! And thanks for your work! Very similar to the workflow we have been using for our Real talk with AI channel (we went the Hedra route because we had watched your prior videos on that)! We just started up our channel this week. :) We talk about the latest in the AI RUclips space and will feature your video from today, soon. We have featured others that you have done as well. We love what you are doing. :)
@@BobDoyleMedia You are welcome! The episode is now live (Ep. #5). Check out what AI had to say about your episode (I bet you get a kick out of it). :) Your content has been featured in episodes #2, #4, and #5 now. Our AI podcasters find your content...fascinating. It is almost if they are connected, in a very tangible way, to the very stuff, you have been talking about. ;)
@@RealtalkwithAI-AINews-o2f So cool! And fast turnaround! I mean I JUST posted the video they are talking about! ruclips.net/video/95pea0605GM/видео.htmlsi=kzv6mcvtOqmvuuUr
@@BobDoyleMedia Thanks! :) I've been trying to optimize my process so that I can respond as quickly as possible (still a good bit more to do in that regard). My general goal with each episode, is that most of them be based on something popular on RUclips in the AI space, where each episode has a video (or videos) as source inspiration. Ideally, the source inspiration video(s), at my "go public" time, would have been posted from within 24 hours of when my episode goes public. I also plan to include the source videos that inspired each episode in the description. That helps me contribute back to the source inspiration, it helps enrich my episode by pointing to additional rich information and content, and then hopefully it will also be such, as to help build community around our shared interest. :) I'll see how long I can keep that up (given that I also have a family and a separate fulltime job). Optimizing everything helps. :)
@@BobDoyleMedia just change the audio in Capcut pro. But splitting them out is a pain in the toosh. Wish you could export them as multi track. Maybe there is an ai for that...like Stemz or Moises.
I'll watch this tomorrow, but I just wanted to right now, thank you so much for the helpful tutorial. I really appreciate your works and helpfulness to our community. 💪
@@victoriadedicova No, it's definitely not Free and Unlimited. $10 for 20 min / mo, $50 for 110 min / mo and more restrictions like the lenght of the video ... etc.
Awesome Bob. I love your channel. Do you have any link to live portraits on MimicPC? I know you have a video about that service. Make it an affiliate one if you can so I can support you 😊
You can actually automate the face animation in comfyui with a workflow that takes audio and animates a talking head with Anitalker, then convert that to the actual head with liveportrait all in a single process.
I thought of doing it that way but is there a way to bump up the accuracy or body language and mouth movement, so it is closer to Hedra? Also with a little work you should be able to composite both together as if they were on the same set. I only did it with a single person where the background was extended to a full video dimensions. just hope Hedra gets a update. It really needs some higher resolution output and the ability to do it with different angles. If you didn't want to go through the complete changing of the voices you can just do some pitch shifting. New voices would be better but if you don't want to put the time into it that is an option. I also want to find if there are ways to modify the notebooklm podcast to trigger certain things. Say like make a intro and outro for the podcast with a name of the show etc.
nice im actually working on a flow that uses a comfy TTS. so can clone my or other peopels voices in. I think we could also use audimees voice bank..(since its paid for) But the biggest pain is the time to render live portrait. Oh and I would also use a web video of me dubbing lipsyncing or mouthign the script for the liveporttrait source movment video.
This is pretty interesting, but, I found some halucination to be an issue. Date changes and such. For example it changed a birthdate of November 1917 to born in 1918. Know your material.
@@BobDoyleMedia If you find anything please let us know. I hoped AudioStrip could handle it but they only seem to be able to split lead and backing vocals
Your channel is great. The only critic that I have is that most of the times you use horrible examples to showcase a function or a tool, like weird music from the 20’s, 40’s, with stupid lyrics that I’m sure make people laugh, but at the same time you’re lowering the bar for the product. Suno and Udio are tools to make professional music, commercial music and the way you present the product makes people believe it’s more of a toy than a professional app, and instead of getting aspiring musicians or artists to trust and believe these tools can do super professional stuff, you’re making look that you can do a great ticktock video and nothing more, when in fact all the tools you’re showing, aside from being the future of the entertainment industry is a way to make a serious living out of them…..think about it, hopefully you can do once a week a video for rookies aspiring to be professionals, and showing them that you can do profound lyrics, amazing arrangements, set the tempo, the key, etc…..and for AI videos, showcasing more the pro part of the tool rather than the comic part of it. Just a thought, my 2 cents to help the community. By the way, it’s obvious you’re a pro, with an amazing voice, always singing in key, play instruments and know the gyst of AI. Way more than most RUclipsrs You’re n amazing and outstanding teacher…..just encourage your audience, sometimes, to the pro side……😉
@@Achievly I resisted it for MONTHS but SO glad I just dug in. Once certain things click, it’s a game changer AND if you really want to create complex things, it’s just simply the way to do it. Don’t cut yourself off creatively because of the interface. It’s truly not that bad.
@@BobDoyleMedia maybe one day but just don’t have the time right now! Glad I stuck it out though because changing the voices in eleven was an “ah ha!” Moment for me ❤️
I was the same a couple months ago, but I gave it a shot and I realized it is easier to use ComfyUI everytime because there are tons of free workflows. Learning to use it is fast and easy. Comfy is the present and the future.
Dude..I have been trying to do this for the last 2 days and you just helped me get there so much quicker...thank you thank you thank you!!😄
@@UnclePapi_2024 so glad to hear it!
So it's combining the script and vocal emotion of Notebook LLM, the facial expressions of Hedra, the realistic portraits of Vidu Studio, and the voices of Eleven Labs. It's very cool, but it definitely makes one long for a future where it's all provided by the same app.
Just one tip, since you were going for realism in the second example: make sure the woman's microphone isn't levitating. I'd also dial up the strength of her mouth movements, and have them smiling, since the voices sound like they'd be smiling.
Amazing Video I love how you didn't give away the punchline at start but still started with some powerful examples. Ended up being a pleasant surprise to see you take it to next level. Great thinking.
@@timba2647 Thanks so much!
Great video! And thanks for your work! Very similar to the workflow we have been using for our Real talk with AI channel (we went the Hedra route because we had watched your prior videos on that)! We just started up our channel this week. :) We talk about the latest in the AI RUclips space and will feature your video from today, soon. We have featured others that you have done as well. We love what you are doing. :)
Wow, thanks so much! I really appreciate all that!
@@BobDoyleMedia You are welcome! The episode is now live (Ep. #5). Check out what AI had to say about your episode (I bet you get a kick out of it). :) Your content has been featured in episodes #2, #4, and #5 now. Our AI podcasters find your content...fascinating. It is almost if they are connected, in a very tangible way, to the very stuff, you have been talking about. ;)
@@RealtalkwithAI-AINews-o2f So cool! And fast turnaround! I mean I JUST posted the video they are talking about! ruclips.net/video/95pea0605GM/видео.htmlsi=kzv6mcvtOqmvuuUr
@@BobDoyleMedia Thanks! :) I've been trying to optimize my process so that I can respond as quickly as possible (still a good bit more to do in that regard).
My general goal with each episode, is that most of them be based on something popular on RUclips in the AI space, where each episode has a video (or videos) as source inspiration. Ideally, the source inspiration video(s), at my "go public" time, would have been posted from within 24 hours of when my episode goes public. I also plan to include the source videos that inspired each episode in the description. That helps me contribute back to the source inspiration, it helps enrich my episode by pointing to additional rich information and content, and then hopefully it will also be such, as to help build community around our shared interest. :)
I'll see how long I can keep that up (given that I also have a family and a separate fulltime job). Optimizing everything helps. :)
@@BobDoyleMedia just change the audio in Capcut pro. But splitting them out is a pain in the toosh. Wish you could export them as multi track. Maybe there is an ai for that...like Stemz or Moises.
Awesome but I still love the hedra clip
I'll watch this tomorrow, but I just wanted to right now, thank you so much for the helpful tutorial. I really appreciate your works and helpfulness to our community. 💪
If you ad Wave2lip to the Workflow after the video has been generated it will help
I love the video but am I missing something, Hedra only gives you videos of 1 min long for $10 a month, $50 a month for 4 min long videos, ouch!
It's free and unlimited
@@victoriadedicova No, it's definitely not Free and Unlimited. $10 for 20 min / mo, $50 for 110 min / mo and more restrictions like the lenght of the video ... etc.
Holly molly, that's a day of work just to split voices dude!, we are in the AI age where you just with one prompt to split voices!
NotebookLM and ElevenLabs are great. The Hedra tech still has a long way to go in terms of lip sync and facial expressions.
I actually followed that and will have a go. Thanks for making this not seem so overwhelming!
Tons of fun as always, Bob :D
Loving the AI hair. Def need that in RL.
Awesome Bob. I love your channel. Do you have any link to live portraits on MimicPC? I know you have a video about that service. Make it an affiliate one if you can so I can support you 😊
You can actually automate the face animation in comfyui with a workflow that takes audio and animates a talking head with Anitalker, then convert that to the actual head with liveportrait all in a single process.
I thought of doing it that way but is there a way to bump up the accuracy or body language and mouth movement, so it is closer to Hedra? Also with a little work you should be able to composite both together as if they were on the same set. I only did it with a single person where the background was extended to a full video dimensions. just hope Hedra gets a update. It really needs some higher resolution output and the ability to do it with different angles. If you didn't want to go through the complete changing of the voices you can just do some pitch shifting. New voices would be better but if you don't want to put the time into it that is an option.
I also want to find if there are ways to modify the notebooklm podcast to trigger certain things. Say like make a intro and outro for the podcast with a name of the show etc.
nice im actually working on a flow that uses a comfy TTS. so can clone my or other peopels voices in. I think we could also use audimees voice bank..(since its paid for) But the biggest pain is the time to render live portrait. Oh and I would also use a web video of me dubbing lipsyncing or mouthign the script for the liveporttrait source movment video.
Great video - I'm interested in how you created your animated avatar for the bit you didn't record. Have you covered that in another video somewhere?
I cover it in THIS video. I used Hedra, the first platform I demonstrated. :)
@@BobDoyleMedia cool - doh! - I think I was distracted by the avatar's look. I'm assuming that's AI generated. it's looks very good.
Super !
This is pretty interesting, but, I found some halucination to be an issue. Date changes and such. For example it changed a birthdate of November 1917 to born in 1918. Know your material.
I hope podcast feature is available in spanish soon.
Good work!!
A little tedious but very helpful.
The bots are way too sugar sweet. Almost too much to seem legit. Wish one could dial the chumminess in/out
Complicated I wish one click solution exists anyway thank for creativity
at the last test, did you manually separate the man's voice from the woman's?
@@tokyofamily8536 yes, all tests were done with the separated voices I edited in the video.
Very great
Is it possible to monetize that? what do you think?
For now
Amazing
I wonder if my audio software could split the voices automatically like it does for music creating stems for each.
@@mjfII I spent some time looking for a quick ai solution for this, as I’m sure it exists, it I just ran out of time and did it old school. 😎
@@BobDoyleMedia I asked Gigi (chatgpt)..she mentioned 'Speaker Diarization' but I haven't moved that far ..yet 😏
Descript can detect voices ✅
@@BobDoyleMedia If you find anything please let us know. I hoped AudioStrip could handle it but they only seem to be able to split lead and backing vocals
Fantastic!!!
I ❤ your fake hairstyle
@@autonicaadabsurdum Thanks! 🥸
Phenomenal
Your channel is great. The only critic that I have is that most of the times you use horrible examples to showcase a function or a tool, like weird music from the 20’s, 40’s, with stupid lyrics that I’m sure make people laugh, but at the same time you’re lowering the bar for the product. Suno and Udio are tools to make professional music, commercial music and the way you present the product makes people believe it’s more of a toy than a professional app, and instead of getting aspiring musicians or artists to trust and believe these tools can do super professional stuff, you’re making look that you can do a great ticktock video and nothing more, when in fact all the tools you’re showing, aside from being the future of the entertainment industry is a way to make a serious living out of them…..think about it, hopefully you can do once a week a video for rookies aspiring to be professionals, and showing them that you can do profound lyrics, amazing arrangements, set the tempo, the key, etc…..and for AI videos, showcasing more the pro part of the tool rather than the comic part of it. Just a thought, my 2 cents to help the community. By the way, it’s obvious you’re a pro, with an amazing voice, always singing in key, play instruments and know the gyst of AI. Way more than most RUclipsrs You’re n amazing and outstanding teacher…..just encourage your audience, sometimes, to the pro side……😉
suno has dope instrumentals for sure, sounds like a real pro
good
All they had to do was produce a stereo track with the voices in their own channel. Guess they never thought of it.
They have a feature request on their discord channel
@@yoagcur Sweet. I'm way too lazy to do what Bob makes look easy here.
@@bobhawkey3783 But are you too lazy to make the feature request?
I've subscribed so that you do not find me and K me!...........
lol!
Who the hell is going to watch an AI podcast, that's what I wanna know? ha ha
ah I close your videos every time you pop up Cummfy.
@@Achievly I resisted it for MONTHS but SO glad I just dug in. Once certain things click, it’s a game changer AND if you really want to create complex things, it’s just simply the way to do it.
Don’t cut yourself off creatively because of the interface. It’s truly not that bad.
@@BobDoyleMedia maybe one day but just don’t have the time right now! Glad I stuck it out though because changing the voices in eleven was an “ah ha!” Moment for me ❤️
I was the same a couple months ago, but I gave it a shot and I realized it is easier to use ComfyUI everytime because there are tons of free workflows. Learning to use it is fast and easy. Comfy is the present and the future.
I prefer AI people hahahaa