Making an Audio-Reactive AI-generated Video: RunwayML and TouchDesigner

Videos are so much cooler when they're synced up to music! And if you really wanna blow some minds you can use AI to generate the source video! 🤯
In this hands-on workshop, you'll learn how to make AI-generated videos in RunwayML runwayml.com, and also how to bring them into TouchDesigner derivative.ca to make them audio-reactive.
At the end of this workshop, you'll have:
* made your own AI-generated video that is synced up to a music track of your choice.
* learned how to build your own beat detector from scratch in TouchDesigner. This way, you can sync up any video to any audio track.
* learned a bit of machine learning in RunwayML along the way.
No prior experience necessary.
Make an account on RunwayML runwayml.com., and bring an .mp3 if you want to follow along!
Lia Coleman is an AI artist and educator. She makes art with AI and teaches others how to do it. You can find her on the internet at www.liacoleman.com
Workshop notes:
babycastles.github.io/Babycas...
Slides: docs.google.com/presentation/... -- Watch live at / babycastles
This program is supported, in part, by public funds from the New York City Department of Cultural Affairs in partnership with the City Council. And by Babycastles members. Thank you.

[@tann1art190]

i just finished the project!! did take a day, bc runaway changed since u did this workshop, but i was still able to do it. Ty so much!!

[@ishigirihayato]

This rules so hard, thank you for sharing your knowledge and creativity!

[@markus_knoedel]

And I just saw this again. Still so much knowledge from you to give out to us. Thank you so much.

[@sofigarazurreta4646]

thanks for this amazing tutorial :) sending love from Argentina

[@hati5626]

Ah, thanks for sharing this.
I'm studying AI and Touch designer because I want to make something in my idea.
So it will be a good tutor to me.

[@autumndyer5593]

Sweat😄~Love Lia Soooooo much. And this is a really great tutorial!!!😄

[@mrinalinisingha6040]

Thank you! Love from India.

[@aaavisuals2950]

So nice will try

[@malekarous]

is there an Ai model that generate particles according to the music type that is being played but without manually choosing the positioning and movement of the particles?

[@TheMicksteph]

Someone Can help me to know Ho to use the Trim here?. I'm really missed :(