My hack for AI MUSIC VIDEOS! [Free Workflow!]
HTML-код
- Опубликовано: 31 май 2024
- Today I'll show you how to generate music videos with Stable Diffusion based on Windows Media Player or completely custom visuals made in After Effects.
If you like my work, please consider supporting me on Patreon: / mickmumpitz
And follow me on Twitter: / mickmumpitz
Tools used in this video:
- Windows Media Player LegacyOBS Studio obsproject.com/Stable Diffusion WebUI github.com/AUTOMATIC1111/stab...
- Control net github.com/AUTOMATIC1111/stab...
- Splitter AI vocalremover.org/splitter-ai
- Adobe After Effects
My settings file: drive.google.com/file/d/1u9QU...
Rotation Expression: drive.google.com/file/d/1CYFn...
LINKS:
- Spiral Animation Tutorial: • Spiral Animation • Aft... -
- How to Install Stable Diffusion - automatic1111: • How to Install Stable ...
- Stable Diffusion for Beginners: • How to use Stable Diff...
CHAPTERS:
00:00 Intro
01:28 The Process
02:22 Finding the right song
03:42 Setting up Deforum
06:16 Prompting
08:44 Control Net
09:26 Optical Flow
10:16 Visualization After Effects
11:49 controllism
14:30 Final Results
![Create mind-blowing AI RENDERINGS of your 3D animations! [Free Blender + SDXL]](/img/1.gif)
Ok, now we need a 1-hour version of the money shot at 13:09. Absolutely amazing stuff!
The amount of work that went into making this video .. Really amazing results, and very nice documentation and demonstrations.
Man I hope your channel keeps growing, your content is amazing!
Awesome!! Would love to see more videos like this! I’ve never seen anyone break down the music tracks and overlay effects on top of waveform visuals! Cheers
Amazing, truly mindblowing! This video was mesmerizing, entertaining & informative! Thank you for this!
Dude, that's brilliant!
You usually are very clever and ingenius regarding your workflows, but THIS ONE, WOAH!!
Strongly hope to see people building up on such cool ideas
The quality of your videos is simply outstanding. You do such incredible work. Thank you very much.
I watched this because I always watch your videos. I didn't really think this was something I would want to do. And your instruction changed my mind. You make everything look easy and your work is inspiring.
Thanks for this bro!!! 🔥 You have such an underated AI channel!!! I hope you get thousands more subs!
Haha nice! We were inspired by those vintage animations as well. But using them directly as input is a totally different way to create ai music videos that are driven by the music. Amazing idea! Keep it up!
amaaaazing brother, great work
Wow! This is wonderful! Thank you for making this video. I'm going to go see if I can follow this video and make something. I know I've been having trouble getting REV Animator, though. 🤔 This video and your animated result are amazing! Thank you, again!
I absolutely love your work!!💯🔥🔥🔥
Insane visuals!
This is awesome thanks for sharing!
WOW THATS SO SMART! Using a rendered Visualizer first and then use it to add AI... Makes things soooo much easier! Damn bro you are amazing!
Excellent Work
the spiral effect is quite cool
The End-Result is so satisfying to watch
Awesome video!
amazing work
Love this bro
Reminds me of some mushroom trips I did back in the day. Great 👍
I have to say, your idea is great, the combination of video and music rhythm, and it was successfully realized. I just watched it for the first time and didn’t understand it. My idea is to convert rhythm music into stuttering videos like TikTok. Of course, the premise is that I will watch your video a few more times. Thank you for your guidance.
richtig gute idee, sieht so nice aus!
very cool, mate
It's absolutely brilliant!!! Stunning work!!!
Will you share your settings with us? Please
great!! thanks for the video!!
You damn genius!
genius bro ,you are the chosen one
He Mick, This video is absolutely amazing, i 100% love it and it deserves much more views, but i guess they will come in over the coming weeks 🙂Now i just have to find out how to do the beat thing in Resolve
Thank you so much! I really hope so, it was a looot of work.
But even if it doesn't get many clicks I'm very happy to have made it. This has been on my list for a very long time! and it was so much fun!
@@mickmumpitz awesome 🙂
Love your work! This truly the future of music visuals! Do you think this type of AI will be able to sync with any track as Windows media player visual used to? No programming every track just a response to equaliser cues?
Amazing !
Really cool, thanks.
Do you know if it's possible to achieve the same results with using comfyUI (and if it is doing a tutorial about 😅)
Thanks
Hi Mick I follow your tutorial but is really difficult to control the prompts specially with faces
how you do the sound, to match?
can someone explain why and how to rectify this- its showing Attribute error: Nonetype object has no attribute
#HERO! 🙌
This is cool! I wonder how it would come out if the prompt changes according to the lyrics of the song along with the beat?
where is the setting file for deforum
dang, Ive the last 3 years learning JavaScript and all the frameworks and now I gotta learn yavascript? come on guys
13:09 Mind=Blown
Hey bro - amazing video. Your first link seems broken add %20 instead of spaces
Are you planning on revisiting this fascinating topic? Are you still planning on posting your Settings and Rotation Expression? Very fun video! Motivated me to join your Patreon.
Hey, I'm very happy that you've joined! Huge sorry that I forgot to update that. I have already uploaded the Deforum Settings File and the Rotation Expression (see video description).
I will upload the After Effects file to Patreon tomorrow. Then you can swap the music with your own to generate the visuals!
👍
Are all these tools free
we need the filess soon please
Now they are here! I'm so sorry I forgot to update the video description.
where tf is the place hes copying his settings to
Thank You! I had some issues with OBS (Totally on me!) then I looked into VLC visualizations, I found a lot, but nothing quite fit the bill, so I ended up using Hitfilm's atomic particles effect and set it to audio reactive, saved the video and ran it through deforum based on your settings. I am happy with the results, what do you think? ruclips.net/video/ldprNBln3-E/видео.html
Thanks for the video. I took some of your ideas and added them to my workflow to create a new style of video for me. here's a link to one of the vids. : ruclips.net/video/lLPUzPbimpc/видео.html I have others up there as well with little tweaks to the workflow. I've been playing around with the Window's Legacy Media Player videos as a hybrid source since I watched your vid. I've paired that with Parseq and I'm getting a ton of audio reactive motion. The other big change I've done from yours is I'm setting the intial image strength up around 0.2ish (I'm still playing around with that).
Really great result! Love the neon color palette too!
broo.. i have this error =( Error: OpenCV(4.8.1) D:\a\opencv-python\opencv-python\opencv\modules\imgproc\src
esize.cpp:4062: error: (-215:Assertion failed) !ssize.empty() in function 'cv::resize'
. Please, check your schedules/ init values.
I think such videos may harm eye health. I would be glad if there is an ophthalmologist among us who can share his ideas. Dear channel owner, one day you'll grow old and your eyes won't see as well as they do now