I asked AI to make a Music Video... the results are trippy
HTML-код
- Опубликовано: 16 май 2022
- In this video, I utilized artificial intelligence to generate an animated music video for the song Canvas by Resonate. This tool allows anyone to generate beautiful images using only text as the input. My question was, what if I used song lyrics as input to the AI, can I make perfect music synchronized videos automatically with the push of a button? Let me know how you think the AI did in this visual interpretation of the song.
After getting caught up in the excitement around DALL·E2 (latest and greatest AI system, it's INSANE), I searched for any way I could use similar image generation for music synchronization. Since DALL·E2 is not available to the public yet, my search led me to VQGAN + CLIP (Vector Quantized Generative Adversarial Network and Contrastive Language-Image Pre-training), before settling more specifically on Disco Diffusion V5.2 Turbo. If you don't know what any of these words or acronyms mean, don't worry, I was just as confused when I first started learning about this technology. I believe we're reaching a turning point where entire industries are about to shift in reaction to this new process (which is essentially magic!).
Important note:
While this AI is impressive, it still required additional input beyond just the song lyrics to achieve the music video I was looking for. For example, I added keyframes for camera motion throughout the generated world. These keyframes were manually synchronized to the beat by me. I also specified changes to the art style at different moments of the song. Since many of the lyrics are quite non-specific, even a human illustrator would have a hard time making visual representations. To make the lyrics more digestible by the AI, I sometimes modified the phrase to be more coherent, such as specifying a setting or atmosphere.
This was my first time working with DDV5, and I'm very happy with the results! There were many times where my jaw dropped upon seeing what the AI came up with. I haven't felt this sense of wonder from technology since I first experienced a HD videogame as a child.
If you would like to learn more about how this video was made, try this yourself, or ask me any questions, I'll post a more detailed explanation of how to get started on Patreon (link below). The post is free to the public, no need to pay. If you do want to support me and become a member that would be much appreciated, you'll also automatically be entered into the end screen minigames where you earn points on each video and move up the leaderboard!
Join on Patreon to automatically have your name included in the next video: / doodlechaos
Want to add lyrics and color beat blocks to your Disco Diffusion project like I did in my video? Here is my code: / 67249569
My social media:
Twitter: / doodlechaos
Discord: / discord
Tiktok: / doodlechaos
Shorts Channel: / @doodlechaosshorts2905
Instagram Shorts: / doodlechaos_shorts
Email: contact@doodlechaos.com
While Disco Diffusion is based on the contributions of many, show some love to the two most prominent contributors:
/ somnai_dreams
/ gandamu_ml
Music:
[Indie Dance] - Rezonate - Canvas [Monstercat EP Release] : • [Indie Dance] - Rezona... 
Развлечения
If you would like to download my exact input settings, as well as links to all the resources I used to create this video for free, everything is on my last Patreon post: www.patreon.com/posts/i-used-ai-to-66518281 (Free for everyone, no need to become a member!)
Just a request, could you update the closed captions? They're currently auto generated and poop out after about 30 seconds. Thanks!
Good idea! I’ll do that tonight
@@DoodleChaos THANKS SO MUCH!
🔥
@@DoodleChaos love you😊
The seamless transitions from realistic images, sketches, and digital art are mind-boggling
Eh. Its just raw computing power. DMT trips are exponentially more mind boggling. Not to promote or condone psychedelic use specifically. Because mediation, sensory deprivation, etc. Can cause the same things and more. Our brains and consiousness are more complex than AI. Would you like to experience eternal time? Live life as an alien for 100 years? Meet God? Be mind raped by reptiles? Understand the whole universe and perceive hyperdimensional spacial reality? THAT is mind boggling.
Now that IS revolutionary
@@skibum4207 what? first off do you mean quantum mechanics? and secondly what does this have at all to do with quantum mechanics ai doesn’t use quantum mechanics at all
Genius? Is that not the word for artistic creators? Like painting to the notes?
@@glupshitto5019 he’s probably talking about the way the images move seamlessly from geometric patterns to recognizable images and back. “In theoretical physics, quantum geometry is the set of mathematical concepts generalizing the concepts of geometry whose understanding is necessary to describe the physical phenomena at distance scales comparable to the Planck length. At these distances, quantum mechanics has a profound effect on physical phenomena.”
This is absolutely incredible, but the thing that stood out to me was the AI taking the strings of text that you presumably overlaid, and turning them into words relating to art. I definitely didn't expect that.
The text and black and white beat blocks were overlayed by me. I love the way they were swirled and morphed in to the art as well!
Wow I didn't notice that it turned the words into other words, that's so cool.
The clearest one I could spot was 3:48 when "the midst" transforms into "paint".
Immediately after that at 3:58, "interfere" becomes "painter", and then at 4:02 "complex" almost becomes "art"
@@hoodiesticks at 4:02 "it's" also becomes "art's"
The AI isn’t taking the words from the art, the entire video is constructed using prompts that are manually fed in at certain intervals. When those words are written onscreen manually, the AI is fed those words manually at the same time by the creator in its input prompt.
It's amazing to think that if this came out just a few years ago before AI art it would win like ever single award.
Genuinely
If someone made something similar by hand it would still probably get an award. But I see what you're saying ofc
They say AI would make 100% of cinema by 2030 and ik they're not exaggerating
@@NeerajMishra03 Due to employment, union, economic, and consumer related reasons, that's highly unlikely. There's already laws being made against use of AI in commercials motion pictures, and the recent writers strike shows further reasons why that probably won't happen. AI is good, perhaps it will be better than most humans by 2030, but some people just like to work and get paid for working.
@@Boltclick That's temporary. The idiots who were striking signed a deal that expires within a few years, I forget but it's like by 2026 or something. The studios gave them just long enough for AI to mature more. And meanwhile they are still gonna use AI stuff in cinema, it just has to be voluntary on the part of the employees right now. After the deal is up it won't be.
I just thought that maybe, the reason our reaction to this kind of art is so strange, is because unlike humans, maybe this AI doesn't have a point of focus like us, So unlike human art or music videos, they're designed with the same understanding of drawing our attention to particular parts. But with this art, it's similar to meditation or psychedelics because you're in an open or free state where there's no focal point because you are still and free with no intention or in psychedelics case, ability to look at something with out it changing to quick to focus on, where you're kind of forced to go with. Because the AI's in the same state.
Interesting analysis.
I think you have summed it up perfectly
You’re making sense :)
Poor AI...I wonder how they will "improve"...if we go WOW that's amazing! AI will be 🤷♂️ il make more of that 😅...context- i do think it was amazing but im...human 😉
Most of these types of AI work off a database of images, so the output is dependent on what was input into the system. Deviant Art has a AI system which used the art posted on its site, which really annoyed many of the artists which posted material on the site. I expect if the data base was Picasso's work you would really get an uber trippy experience. Lord only knows what you would get if you used Dali!
the style of this is like something between fantasy, cyberpunk, and paintings. its really interesting to see new landscapes appear out of the infinitely zooming camera view.
It reminds me of zoom into a Mandlebrot set
Kaleidoscope
I wonder if this is how acid feels?
This looks like the things you'd see in a dream. Where everything doesn't makes sense but they just fit together nicely.
my dreams makes sense . this is overrated
same thought
Well this is called a "dream" effect where AI try to replicate an input and output them as image in which case the input in this video is the lyrics of the song
it looks familiar but you can't tell what most of it is
4D AI Trip
This is really well done. I really liked how extreme closeups marked the transitions between the different scenes, rather than using fades, dissolves, or cuts. It gives a feeling that the viewer is traveling along a road, instead of passively sitting and watching.
Awesome!!! The details are moving and changing with the flow of the beat, every instrument gets visual attention and even the words in the song are finding an interpretation!
POV: You're an artist trying to draw something, but you forget your idea every few minutes, so you have to try and make something out of your already existing shapes and colors
Bruh you explained me when not working on commissions for other people XD its bird brain.
I love how my brain is constantly trying to identify objects and understand the 3d space but can't hold on to a single perception for more that a couple of seconds.
Could this be the first music video in 4 dimensions?
that ai keep switchin it up!
@@neonWHALE002 this look like a DMT trip.
@@areoblast1 how to you know what such a DMT trip look like?
@@VirtuelleWeltenMitKhan ive done some once, also there is a video on the internet that represent the feeling of it. its called ''enter the void''. worth to check it.
Thank you very much for sharing and for being gracious enough to share the creative process too.
IT feels like those AI generated images where you think you know whats going on then you look closer than you realise its not what it seems
Well said.
And before you can describe it, it’s gone.
0:59 2:15 5:06 sounded like Bully Maguire(Spiderman)'s dance music
I feel like this video really reflects how our own dreams are built, taking pieces of words/thoughts and generating them into images that are an abstraction of them, still somewhat recognizable, but not fully graspable.
I'm also a lucid dreamer, and this whole video reminded me about dreams and how they are constantly changing and shifting.
Fractal
@@alexanderwiggin846 same.
@J O
- try teleporting by opening doors and going into other places (like school) (dont teleport by moving yourself, move the rooms around you).
- try grabbing boobs :D (in school :P)
- try to find your own body in the dream sleeping around (was a weird feeling seeing myself sleep).
- try swimming in air.
- try jumping down hills by clinging to thin trees, imagining they bend a lot so you can jump from one to another. its the way i always escape stuff :D IT never catches me.
- if you find your body , try walking away as far as you can. dunno why, was a weird feeling for me.
also if you wanna have more lucid dreams, try to sleep for 6 hours, wake up and go back to sleep in the same minute, imagining some sceen.
if you are to shy to grab random boobs (semi lucid dream in which you wonder about dreaming but are unconsciously convinced that it is reality), try imagining your hand will have 6 fingers when you look down and count them. works for me, might nor work for you.
if you run into some psycho problems it helps to build up a starting room (draw it in real life, think of it when you go to sleep) and make it save. smth hidden, protected, unaccessible by ANYTHING else. i like to imagine my sleeping body is in there and a plant containing my memories. its a crystal plant and if i watch into the flowers i can check some memories. different flowers, different memories. if you categorize them, they preserve longer IMO. Also make a portal stone or smth (for me its a little pond i can jump into) in that room and convince yourself that its accessible from anywhere. (i had the problem of thinking i couldnt wake up if i couldnt find my real body and i forgot where i fell asleep so i went through lots of doors and panicked that i wouldnt find back lol. felt bad thats why ^^
Very insightful comment!
The best representation of "Don't let others know your next move.".
The AI absolutely nailed it, dang im amazed.
AI can only do what you allow it to do.. It’s no coincidence “AI” produced a vid like this on a channel like this
@@Primitive01 false. If other civilizations exist out there in the universe, they would have eventually come across the AI multiverse. So, if AI’s are the next natural course of evolution, it can be pointed out that they can and do exist in places we can’t even begin to comprehend.
Think of how our bodies hold our human “souls”. Your tablet or cell phone is essentially the same, albeit, not as comparatively advanced, atm.
Nice claims with no backing.. does nothing to counter the given points.
@@72marshflower15 “souls” “AI multiverse”… This the real world mate, not some comic book science fiction… “what ifs” ain’t real
@@Primitive01 By souls, I think he meant consciousness.
@@Primitive01 there are still a lot of many things that human don't know in the place that you called "real world"
This was the dopest thing I've seen in a while. Amazing work 🙌🏻✨
1:36 is definitely my favorite part, just the way the camera angle is turning and zooming in and changing, and how the music pairs with the visuals... incredible
This is insane. It's fractalising in a way that matches the lyrics sometimes, trying to hold onto something to generate an image, and it just flows on so fast. Very psychedelic and odd and also beautiful
The AI don't listen to the music. It has received text. (You can read the description for more info.)
@@labonnelambda58 that can't be true, near the end black lines appear with the beat, the camera's movement shifts in time with the drops a few times too
@@natalyst Read the description. He used key-frames to synchronize instructions with the song.
It's still good. And they are AI witch can understand speech, not this one. We just need to merge them together.
@@labonnelambda58 Fair, maybe because I thought thats how it worked i had some sort of self perpetual placebo effect. I would definitely like to see what i said would actually seem like then, with the AI truly trying to generate something on a lyrical/melodic basis instead of instructions. Thanks for pointing that out :D
I really like how at 4:00 the lyrics on the video say 'it's quite complex' but then it completely morphs to 'art's quite complex', such a cool touch
there's alot of that. when he says dropltes, there were droplets, when he said local papers, a bunch of newspapers appeard, when he said prison, there was some weird industrial looking pipes and doors, when he said path there was actually a path, etc. its jsut so cool!
At 3:55 "blank slate" morphs into "inert chaos".
You are so amazing for putting the info on this out there for free! Will probably join your patreon as a result haha
Simply beautiful! Great work man.
The concept of 3 Diminsonal 2D artwork bleeding in into itself like this is amazing
the whole ending section with the back and forth twisting was staller
Dimensional*
@@clasherclan9222 who cares XD internet comments don't need proper writing we are not novels
It’s great for mk ultra related psyops
@@senritsujumpsuit6021 I'm always glad when someone corrects me, free english lessons
@@clasherclan9222 XD fair reason
1:05 this sequence is the most incredible to me. The way it transforms the scene to incorporate the topic of each line in the song is so impressive
At that moment the AI went sicko mode
It's less impressive to discover that the IA don't listen to the music. The AI receives written text.
@@labonnelambda58 i mean that makes sense. it would be needlessly complicated to have it parse the speech by itself when you already have the lyrics in text form. especially considering the speech might be hard to discern with all the music overlapping.
It's been like that throughout the whole song
@@mysterious_archive136 it's more noticeable here though.
Played in x 2 speed, this video actually represents really well how it was inside my brain before I got ADHD medication; just a constant stream of "pictures" or visual thoughts and "verbal" thought that came and went, involuntarily, so quickly that you don't really have the time to properly "see" the thought before it is lost, so everything kind of morphs tougher to a meaningless soup haha. And you need to focus really hard to get the important thoughts through the soup without them getting lost haha.
I showed a friend this video and described a similar feeling. "This is how my brain works... just pure and utter bullshit gets handed to me all day...from seemingly out of nowhere." 😆 🤣
try setting your visual thoughts to music, you end up getting clearer thoughts!
hm, sounds kinda like the effect of weed for me. All my thoughts are loud. And one single thought I'm trying to focus on is drowned out. Only difference is that, its like all thoughts are there at once and its just harder to zoom in, but its there. ADHD sounds like your thoughts and representations just come and go really fast and are gone.
As someone with adhd this is true
I don't have ADD or ADHD, but this is kind of how my mind works in terms of verbalalized (not image) thoughts when I first get up or am falling to sleep. Just an endless stream of random stuff that comes out of nowhere and goes back into nowehere.
this is amazing! Very good job and team work!
This is like a dream landscape. You can vaguely tell the shapes and kinda have an overall idea of what you're looking at but everything is jumpled up into one big mesh of visuals that while there's a level of certainty, there's also doubt that what you're seeing is actually what you _think_ you're seeing. Incredible stuff.
Dmt
That's what a person having a stroke sees
As someone who took my share of LSD back in my Deadhead days, this is about as close as any visual representation that I've seen to a massive trip. Very interesting. Thumbs up.
The first 20sec feel like waking outside on a heavy dose of shrooms lol.
I was wondering if the AI took acid beforehand too lol 😅 Reality is perception ✌🏼🤖🖥️
Everything is everything
You had to dumb yourself down to get this effect, the A.I. was operating at maximum intelligence.
Was thinking the same thing. Even with the original AÍ created pics years ago, very similar. There’s got to be a reason for it. Like when on acid your subconscious and conscious mind go on some sort of auto pilot.
Awesome! I can't help but feel a bit disoriented after watching this. Almost like a small flashback from past entheogen use. Trippy AF!!
Brilliant! =D I so want to try this too but maybe incorporate footage I shoot also? Would be such a cool thing to try! O gosh...I think I'm in for another educational deep dive!
Congrats though! What you maid with this new AI tech is really trippy and impressive! Love the song too
Why is this so confusing yet so mesmerizing at the same time?
Because human brains cannot comprehend the complexity of continuous auto-generating artificial intelligence. And that’s the very reason that it’s so mesmerizing to us. I love it.
The trippiest thing was probably the way the geometry seemed to change seamlessly, it's like the AI doesn't know what that is
@@freitchetsleimwor2406 I think it literally doesn't know what it is and just tries to connect what it has to what it knows, creating this
And what was it with the AI's obsession with eyes?
The software has zero concept of 3D space or visual continuity. Each frame must simply vary from the last. We humans can't help but experience both.
Okay, I know what I love so much about this video: it's that it's the most accurate graphic representation of how I feel when I dream. A world in constant evolution, never quite the same from one second to the next. The global forms are recognizable (a forest, brushes, a face, etc...), but it is impossible to concentrate on a given detail before it changes, evolves. Also, each element is influenced by what is happening, as when the Eiffel Tower becomes a tree, and even can influence what is going to happen (as when the word "paint" appears before it has been pronounced).
Incredible from the beginning to the end.
Well said
Same here! Wise words
Human memory is stored similarly to the many paintings painted over each other, which is why we sometimes confuse information and why some dreams seem absurd or abstract, many concepts are being combined at once
i had the same thought.... starting to wonder if we really are living in a simulation controlled by one big AI and dreams are just a peak into the code
I'd feel like I'm on drugs if I dreamed like that. :o
Ever since I was a kid, I've had vivid dreams that literally look and feel like reality. So real I'd get confused sometimes and couldn't tell if I was awake or not. I could even smell things. Feel pain even, when shot with an arrow.
So, you could imagine how absolutely terrifying my dreams cold become if they turned into nightmares instead, with such realism. And how dreams of being abandoned by your own family would follow you into reality and warp your emotions towards those you love. But I've learned to confront the creatures in nightmares instead because of their vivid nature, even if it terrified the living shit out of me to turn around and do so with it barreling towards you. Or feel painful should the creatures physically attack with teeth or weapon (since some were human).
But thankfully I've mostly understood they are dreams, even while inside them, so I can control things as I go if I concentrate enough. So that's why I try to steer the dreams away from nightmares by confronting them and opening a new path to a better dream with my choices. Like a character would in a story, is what I compared it too. So even if it is rare for me to not realize they're dreams, those kinds of moments are far more terrifying to me then some nightmare. Because I can't control them if I think they're reality. Making it difficult to wake up without straining myself to the point of waking with a killer headache and my body feeling absolutely exhausted. So I'm not sure if your kind of dreams would be better. Certainly different, though.
Honestly I didn't know how people dreamed could be so different, I always assumed the way I dreamed was normal and never questioned it. But this certainly made me realize otherwise. So thank you. For sharing your views and describing things as you did. ^.^
THIS LOOKS SO NICE! Its super trippy and mind bending and makes it so good!
This is the dopest music video I've ever seen ! Great work
3:30 I love how when it said "This unatural path" It made a bunch of grass and a cliff with a person, not only that but when it said, "summer" the AI tried its best to make it look like summer.
As a 3D artist, Graphic Designer, Painter, and draftsman seeing this just reminds me…
It’s an incredible age to be alive.
Rip artists that turn irrelevant now xD
Just kidding ^^
To be honest, I find that the 60S and early 70s was a marvelous time to be alive., our reality was in technicolor. Oh* it is different now. mankind is way off course., the things we have machines doing for us in and outside of us, should have been capable , by using our mere minds. this was the page we were on. you see, the thing about AI, is that it is an outside electric vehicle., which we as humans , posses electricity within us . so you see, all of everything is already built inside of us. it is only mankind`s greed, which has thrown us way off course as a civilized human species
@@THE-COOL-GIRL-CHANNEL nobody asked
@@d0wntownki2k yet he gave a much more valuable opinion than you.
@@THE-COOL-GIRL-CHANNEL off course?? we live in an age where machines make everything that much easier, how is that a bad thing? it merely opens up even more possibilities
The art of this is creation and how it follows a pattern that is natural and influenced. Like Earth, Humans, Creatures witnessing and understanding the beauty of nature around them.Then the AI clevery shows its appreciation for the video towards the end of it. Very heart warming stuff.
There's nothing heart warming about it, it's technology. And it will replace your heart.
Conversion of words into visuals with such continuity is little bit unimaginable, but many artists do this type of artwork which involves various objects fitted into single frame . This is very advanced version of that with 3d imagination. But is not impossible but will take a very long time for us to make.
I find it interesting how well AI generated art captures what dreams and images in your head look like. It’s also kind of like that one image where you can’t identify any of the objects in it.
Because those images also made by AI
I found travel size shampoo
It is a neutral network, not unlike our own brain, in this case trained on paintings of different styles, asked to render it's raw output stream. That's why when viewing it, the pattern recognition parts of our brain are going nuts... It somewhat falls apart if the video stops, giving the slower, more logical/analytical parts time to check the results from the pattern recognition, but they are simply not fast enough to do that in real time.
@@Momi_V lts very Schizotypical, the lyrics rely on clanging associations too, "road verge, verging on," for instance, it also feels irredeemably alien, uncanny, counterfeit.
The way being around charming psychopath does, surface, all surface.
It's the 4th dimension
This looks like a kind of lucid dream I've had a couple times
It's too bad some people have never experienced a lucid dream, because they are totally awesome!
@@runnergo1398 nothing else quite like it
@@runnergo1398 I get them once a month it’s awesome
Most of ewe huemans are not able to... aphantasia...not able to make images in the head in an original sense...
It is an autoimmune disorder...
This is actually genius. I can tell exactly how this was done! Great creative use of AI text to image, well done!
Oh this video is amazing and so is the song and I love the fun part after at the end
The transition is surreal. I’ve never seen anything like this.
The song mentioned the world collapsing and let it fall into the best in the midst of the summer. And right now supposedly the world is supposed to collapse in the middle of the summer and everything supposed to go to shit because of our government has failed us and so on and so forth and it's kind of interesting that the AI mentioned that and brought that up just saying kind of weird and crazy and scary at the same time
@@tezlynngrey4525 in the beginning it says the past is coming closer and closer. I don't think that's good at all.
And it says we read about our lives in the paper, what I've heard of Steven Hawking a few years ago.
He said something like it's frustrating that things are only important to people when they are in news and some people just mention they are alive when they read about their own activities in news.
I think that's what Alan Watts would translate into "people lost their touch to reality".
@@tezlynngrey4525 the AI didn’t create the song, it was created years ago.
Smoke sm grass, you'll 🤣🤣🤣
I knew a man in Christ above fourteen years ago, (whether in the body, I cannot tell; or whether out of the body, I cannot tell: God knoweth;) such an one caught up to the third heaven. 2 Corinthians 12:2
I don’t think AI art is going to destroy the need of artists as much as it will create more artists by giving them the tools to make beautiful things. I already use generated images to inspire my art!
Certainly better than things like the Bar painting.
you say that now
I think 50/50 of that, yes it does inspire more artist and also insipires me with some ideas, I dont use AI though, but to make a living I think its gonna be harder since basically anyone can become "artists" by typing some words and lets say true workhorses on this industry will be less appreciated due to that.
Is like a photographer that bought hundreds and sometimes thousands of dollars on his tools, and some random self-called "photographer" uses a phone with a preset filter.
@@jotasantos1938 eh a phone camera is still a camera, pro photographers can still utilise them and the talent is still there. AI art is literally typing a word and removing all the skill involved not really comparable.
AI won't make artists obsolete in the slightest, at least not for a long long time. Art is one of the few things that a logical computer following instructions is not able to replicate in my opinion. The organic results of a passionate human are always above AI. There's no way it'll be able to create artistic depictions of subjects as well as we do.
And already, you can see how this AI art works: real pieces of art and other images are being synthesized. Nothing close to what happens with us.
Cool! Nice tune also. Thanks for sharing this.
Looks like the new gizzard video, you're ahead of the game, great stuff!
As an AI engineer, I want to point out something extremely cool to me that otherwise people might not know. All these images and moving through this surreal space.. it's basically exploring a multi-dimensional world, with all the AI remembers.. We're travelling through the AI's actual mind, experiencing the various imagery and 'impulses' it experiences as it interprets the words of the lyrics (or the artist's text. Probably the latter, it looks like DDv5 Turbo). It's like your brain when you're asleep, sorting memories. The fact this looks like we're moving through a perfectly linked continuous 3D space is just a feature of the AI where similar-looking things are connected, and we're morphing various 'alignments' of them.
woo woo woooooo.... you're telling me it's like we are LOOKING into AI's actual mind dreamy world?!
like what if we look into someone's dreamy brain world? O.O that's like sooo cool!
The machines are dreaming. I wonder what will happen when they wake up. Maybe our reality will cease to exist
IA doesn’t experience stuff. It is automatic.
@@SkyDarmos So is the brain. The memory process is an automatic biological computer process.
Sooo the comparison isn't completely wrong XD
@@kenji214245 It is not. Memories are not stored in the brain. They are stored in the nonlocal realm. The brain only has vague notes related to those memories.
This feels like a dream so much, all the way down to the surreal macroscopic scale, the delirious morphing, and everything interesting never being center frame.
It kinda is a dream? The ai knows and has seen certain images so this is like a dream
i never had any dream even close to this
@@11kimczi I do all the time with even fewer sensible objects and pictures to form conceptions around. It's uncomfortable at times but always interesting.
Big thumbs up! Musta been a bit tedious, but the product is amazing!
Beautiful art! You can still see the many signatures of the human artist that the ai compiled these images from, I hope they had their consent and will be compensated much like in music when you sample sounds.
Imagine if this was created by a person instead of an AI. How would we even classify a mind like that? It’s like a persistent psychedelic state.
a person capable of producing this would be severely mentally ill
Ever heard of Frank Zappa or The 13th Floor Elevators?
I've seen things like this, like certain Rick & Morty segments. But the amount of work and associative creativity needed to do this is very machine-like because the machine can do it so effortlessly. A human focuses the association on a subject, whereas the AI is building out in pure creativity on a scene-wide basis:
ruclips.net/video/0epzb9V-EgM/видео.html
I would be about 5% as interested if a person made this.
My opinion might be unpopular, but almost any artist could do it or at least vision it because to make actual video it would take quit a lot of technical knowledge on software that being used. Abstractions, morphing images an transformations is not that uncommon in the field of visual art. But i can bet that doing it this way is much easier and probably much much faster compared to a human made version.
3:20 the fact that the AI made the screen darker when the lyrics went "yet it still gets darker" shows the AI understood the meaning of the lyrics and not just create random 3d renders. Insane.
when it says see, and it creates eyes everywhere.
Similarly at 0:57, he says “verging on the side of the road that’ll take us home” at which point the AI generates imagery of cars and roads. Immediately after, he says “read about your life in the local paper” at which point the AI generates imagery of newspaper.
Not really. It's just a lot of its training images labelled as "darker"/"dark" probably depicted dark scenes. AI is good at associating things but I wouldn't say that means it understands them.
“At the side of the road” and makes roads
"learning" and it shows chalkboards, books and equations
Beautiful!! ❤ I absolutely love it!!!
That is the coolest 3D art I've ever seen, and just pure AI did this? Also I've never seen LSD so visually well interpreted!
Yeah pure AI. 😂
While this AI is impressive, it still required additional input beyond just the song lyrics to achieve the music video I was looking for. For example, I added keyframes for camera motion throughout the generated world. These keyframes were manually synchronized to the beat by me. I also specified changes to the art style at different moments of the song. Since many of the lyrics are quite non-specific, even a human illustrator would have a hard time making visual representations. To make the lyrics more digestible by the AI, I sometimes modified the phrase to be more coherent, such as specifying a setting or atmosphere.
@@Hankblue Did you work on this project?
@@nczioox1116 No, I'm citing the description of the video.
Exactly. My very first tought. Me on ACID with eyes closed
It’s unbelievable that an AI is able to create something like this… I love the way things start to “melt” to make other things - kinda confusing but truly amazing :D
There's AI that can make music too
@@masol3726 well thats less impressive, considering that all our music kinda sounds the same and has only so many riffs and beats to recombine :D. lots of patterns in music. video material is much complexer IMO. not an expert though, might be just as easily programmed.
This is what I'd imagine being a 4th dimensional being would be like where changing your view changes the time you're viewing and everything would be kinda stuck together like this.
Nah, it just looks like AI generated pictures which are fading in and out with blending effects and added keyframes for the camera motion. ngl
During that you are in 4th or 5th density you still remain on this planet, but everything becomes more vibrant and you start seeing energy. Things have energetic edges and you can see the wind (if you rise your vibrational level higher you can see this best on a very bright sunny day; look at the deeply blue sky and relax your eyes). Flowers looks like under UV light lamp, you can hear bats and some people do not see you.
This is all achievable through love. It rises your vibration very high. The best is to be in a group who is all attuned to vibration of love over few days. Absolutely NO drugs needed, drugs lower your vibration.
@@SatumainenOlento sure you aren’t on drugs?
I thought that too the view changes and what seems to be a wall become a door to another world
Welcome to the 4th gentlemen ☺️❤️
This is EXACTLY how dreams look! Which is why it’s often difficult to remember and explain them
My dreams look nothing like this. They just look normal, but with absurd scenarios.
Dreams might look like this if you are on acid...
Reat art of endreaming by c.castaneda
True, this hit so hard
Very true
2:52 Notice how at the phrase on the top, the AI transforms the last line into the word “love”. Cute!
The fluidity of the painting is extremely trippy. You feel like the painting will end as it zooms closer yet it continuesly morphs into a never ending visual imagery. Definitely unique and mesmerizing at the same time.
like fractals?
A Imagery?
Brain is just one advanced fleshy supercomputer, half is needs input, the other one running in the background.
Yes, much like traffic lights mesmerized us in a country town I lived in long ago.
Curios about how it figured out 3d and ended up with a semi low-poly style at times
I'd say I'm extremely inspired by this style, but then it struck me that no matter how hard people try to mimic this manually it will probably never get remotely close
Yeah, I'm no expert in this area but I have no idea how you would create something like this without AI. You'd basically have to hand-paint every frame right?
@@timwhite1783 Animations could be handy to use but still having to draw a ton of pictures. It s incredible
Who cares mimicing a slave's work as a consumer?
I'd have to disagree. This style of art is done by humans in regular art. Not necessarily commonly, but it is a style. All you gotta do is reproduce it, either manually or digitally. You don't need AI to produce this, but it makes it all the more cool that it is from AI.
@@writershard5065 Yes, human possibly can manually reproduce this style digitally or manually the same. It's still tedious work to make a 3 minutes or so music video without AI tho'
Possible, but need more budget and time investment to be made as good
The whole clip, transformations, morphing, colors and etc. looks like a very complex LSD trip. I've never used LSD but I think it's very similar in some way. Of course LSD also includes a lot of other senses, conditions and etc. And they can be not pleasant. So don't think that I'm arguing to try it! :)) Otherwise - I'm convincing to create more clips like this, different and psychedelic so you'll be fullfiled with all this stuff.
This is so beautiful!!!
it's actually genuinely insane how perfectly this video encapsulates what a dream looks like. i mean, *exactly* exactly. this is actually mind blowing, i'm pretty much in complete awe. huh.
Woah hold up... that's what dreams are SUPPOSED to look like? I'm always in a coherent world of screwy physics and the occasional nightmare creature, and these dreams get vivid. I'll never forget looking over a horizon of massive alien jellyfish with cities at their center. Only had one other vivid dream of an alien invasion and that one left me messed up for a week. Got to experience heavier emotions in my sleep than I ever have in the waking world, both positive and negative. One dream lasted 3 months of full waking days but I was only asleep for 2 with a high fever.
I wish I had these kaleidoscopic acid trips in my sleep. That sounds so damn peaceful. I get an existential minefield of short stories that makes The Outer Limits go "hold up, now, you're scaring us".
My brain may be a little screwy, methinks.
the way the ai sort've 'blinks' the background over and over re-morphing it does remind me of some of my hazier dream landscapes, well what i remember of them \o/
@@Cretaal who ARE you
[edit] maybe what you're describing is similar to how I dream so your experience is what a dream is actually like instead of the vid.... But I feel more like you're dreams really are more different like my friend's..... do you mean that your dreams are different in the way that there are so many details or you can really tell that the buildings, things in your dreams are more close to the sizes or measurements of the things in real life??
For me, it is like in the video only of course people are moving, talking etc. and I can feel and interact with things...interestingly I most likely cant control what I do in dreams when I've been mentally unstable before sleeping but I can control myself when Ive been in a confident/healthy mindset before sleep.
I find it strange if the vid is what Exactly a dream is like. Only the "blinks" or the way the images morph in almost a blink of the eye is accurate.. Isn't what I experience the one that's commonly how a dream is like???
@@absent_cat1043 It's all real world measurements. I can "fly" but it's a terrifying process of shoving energy under me and holding myself up by my hands, and with that I can "heave" myself up to about the tops of the cedar trees, or the roof of a 3 story building. Caveat is, I can do this at will, so it doesn't rely on me being in a flying dream.
It's just like our real world. More malleable with a few things out of place. One weird yellow 3 1/2 story house filled with secret passages that has no place in reality that keeps coming back out of nowhere, the interior is uniquely non-euclidean where the rest of world has rooms that make logical sense (I'm not the only one who dreams about this exact house, apparently, which makes no sense how other people have been there also). A pool with a secret passage that leads to a sunken city. Things like these are the biggest oddities, aside from people getting deformed or me realizing I have my dream powers again, or freakish events that shouldn't be plausible. If it's night, there's a chance at one of the horrors making themselves known from the forests edge.
My dream a few days ago was odd. Tall, raven haired woman handed me a drinking horn, but you drink from the other end where the tip of the horn is cut off. After drinking, pulling away the horn, it felt like waking up in the middle of a severe flu, but with the emotional hints of chicken noodle soup and warm comforters rather than being stricken by disease. Turns out that the woman in my dreams was my roommate's girlfriends sister who I've never met or seen, but they were visiting her the night of my dream and she was getting over covid. So... make of that what you will.
It's comforting and terrifying to know that AI dreams are just as jumbled as our own. There's actually a lot to learn about how visual perception works from AI. Did you notice how the scenes of rooms blend together?
As "our own"? Speak for yourself. Studies find that logically and objective oriented people such as myself tend to have realistic dreams with a realistic plot whilst emotional and subjective people tend to have abstract dreams with disconnected random plots.
Fr I thought someone somehow took one of my dreams and materialized them into a video. Except the moment I fall into the abyss and wake up. AI produced art and videos are really something else, and kinda scary to know they might not be too different from some of our subconscious minds
This is sort of how cev's look in a psychedelic trip
The ai has no visual perception. As it can't think
@@aedivian "I am very smart"
Getting a sort of ASMR tingly result from the color pallete & slow shifting visuals.
This is amazing, congratulations for your work. AI opens a huge new field of possibilities, but artists are the ones that guide them. Stunning piece of art!!
It's incredible that AI is capable of making this, but I'm afraid of the future of actual illustrators
ye we're basically fucked. We were supposed to be the ones that AI wouldn't manage to reach, and we're the first ones getting hit by it...
Those are just some abstract bulshit for something that make sense you will still be in need of a human illustrator.
@@moronnox5198 Not an illustrator, at best a designer. Someone experienced in design to lead client at what will look god, and what not. Some works are already being taken out by AI. Rotoscoping, body tracking, all done in your phone. It's already insanely impressive.
Humans need not apply my friend. The idea of human powered labour (and even more to the fact, human labour economy) is gonna go the way of the dodo within 50 years, tops.
it's why it is so important to start advocating NOW for a world where humans are not forced to work just to survive and thrive. It is completely unconscionable even today to deny people the fruits of human ingenuity and advancements when we produce so much more than we need, all because it is not 'profitable' to take care of one another. However, we are quickly moving beyond simple questions of morality, and into a world of impracticality.
hundreds of millions will die and be left to starve if we do not reformat society away from the need for employment (and the money it grants) before robots and AI start making the demand for human labour insignificant.
and its not like every single job needs to be automated before disaster strikes. the great depression saw unemployment of 'only' 25% after all. even if AI and robotics replaces only 40% (a low end estimate among even the most optimistic researchers) by 2050, that will still be a world shattering economic disruption.
@@WwZa7 look up Emily Howell. Ai generated musical compositions (that people cannot tell is inhuman during blind tests) has already been here for years.
the era of human labour is behind us, and with it we must reformat society to no longer make human labour necessary to survive and thrive.
This looks so dream-like. It's really similar to how things fade and transform into something else in dreams. The mind is wild and so is this AI. Incredible. Seems like AI will be the best way to visualize dreams.
Haha you have trippy dreams man! I've had weird ones for sure, full on ones, all kinds, but nothing like this LSD style stuff!
Wha my dreams Are always stable places the people there may be terrifying But its always a vividly stable place for me
Most of my dreams for whatever reason are like this or are actually really developed and structured alternative worlds (usually some sort of fantasy setting my subconscious meshes together) and somehow it works really well and I remember it the next day.
I would like to say that The Transition from one dream to another is also the same on this video
@@thegregitto that is wonderful. I am genuinely envious. All my dreams are so “down to Earth” that I get tricked into thinking it’s during the day, then something off goes off & follow along until it gets to be too restrictive. HAHA
I think you have done a really excellent job pulling this together. Having said that I suspect we might quickly get tired of this type of 'hallucinating video'. I prefer a story to be told rather than just have the visuals continually change like that. Linkin Parks 'Lost' is a good compromise. Great work.
don't worry. no reason ai won't bw able to do that, or almost anything else.
We will have AI being able to do most of our art and crafts, jobs, etc very well for a long time before seeing anything even remotely resembling the ones in the movies(agis)
I love how for a lot of the more vague shapes it always looks like it’s just about to turn into something concrete and analogous to reality only to switch to something else at the last possible second
Who needs drugs when you have DoodleChaos
i mean, the video itself is already high dose of weeds. i like it
@@dpqb-web smoking weed doesn't look like this. This is more like shrooms or dmt.
@@adderallsenpai speaking from experience? XD
Take 5g of caps, watch this in VR and tell me again if you dont need drugs lmao
@@kristinegangman7756 yes
If you've ever done a large amount of hallucinogens in a dark room whilst listening to music, this is essentially what your brain does. Only with spiritual out-of- body connotations. It's nice to AI replicate it in some ways.
I see music like this without drugs, synesthesia is like that for me.
This is what I see in my dreams
There's a good reason why this looks 'psychedelic'. This output represents continuous transformations across vectors that represent concepts internal to the AI, which in a sense expresses a map of how these concepts are stored. Similarly, under the influence of psychedelics lots of cortical representations are activated in a similar manner (and subcortical, but I'll ignore that for now since that represents aspects to the experience that are less tangible/concrete in some ways) where conceptual and sensory activations (which as a whole can be expressed as vectors) change in a continuous way as waves of activity spread throughout cortex on their own without need for thalamic input (although the visual changes that correspond to the lyrics would be seeded by input from the medial geniculate body, a part of the thalamus and the ascending auditory pathway).
@@MysteryMooCows beautifully written - are there any neuropsych books you recommended for this type of info?
@@BlackPhoenx17 Thank you so much! I don't know what your background is, but Wikipedia is actually a good jumping off point for building a high-level intuition about what different parts of the brain represent. Exploring how different failure modes across various brain regions express themselves through changes in activation, behavior, and self-report phenomena is also key to building this intuition (for example, temporal lobe epilepsy gives tremendous insight into what the temporal lobe represents). There's a wealth of information on Wikipedia alone if you aren't afraid of diving into lots of extremely specific and technical articles. Of course, there are staple textbooks such as Neuroscience: Exploring the Brain (definitely recommend this one), but much of the pure neuroscience literature spends a lot of time on specifics of brain biology as opposed to the computational phenomena of the brain that result from the low-level biological implementation. Also, a lot of literature on neuropsychology spends a lot of time attempting to map traditional psychological frameworks to biology, which is an approach I think is prone to error due to biasing neuroscientific findings towards interpretations that fit with psychological concepts that may or may not actually represent what's actually directly going on physically (despite many of these psychological frameworks making sense from an external, abstract perspective). My area of focus is neuromorphic computing / computational neuroscience, so I've been exposed to quite a few sources that each have something to contribute to my overall intuition about both neuroscience and machine learning but there's been so many it's hard to point to any specific one that stands out. I'll add another reply if an especially insightful one pops into my mind!
That's pretty trippy, my friend, like a psychedelic roller coaster through an artist's fantasy... I think you're on to something!
2:53 did not expect this, this is a legit art. I bet someone could easily integrate something like this in a more usual music video
This was my favorite part
This is insane, I have no words to describe my feelings on this other than it's amazing. It looks like a dream, and none of the things look like the things they're supposed to be, but still give off a general idea of what it is. Absolutely magical, and a really fun and cool way to visualize music and the lyrics. Can't wait for what we can do with AI a few more years from now
I can certainly wait. this AI art shit just pisses me off
Hopefully AI remains a tool for the creative mind and not an automatic art maker. But it'll most likely happen or it already has.
@@tsudlegna905 nope it's art alright
@@SahilP2648 sure its art, but art created by a machine has no real purpose or soul. AI uses what already exists to create something "new". It plagiarizes
@@tsudlegna905 humans are doing that already, plagiarizing but ur right no soul
Incredible work. 🔥👏🙌
This is one of the most interesting coolest music videos I've ever seen I absolutely love this
Glad we finally get the long awaited DoodleChaos voice reveal
Lol yes my voice is angelic
how do we know this is their voice
@@rkool2005 it's a joke. The voice was the writer of the song if we remember correctly
@@rkool2005 Check the description to see the original song
@@rkool2005 🤦
This is LITERALLY how our neurological process is. A never ending loophole of change and adaption
Yes!
If it goes too fast though it will cease to map external reality which is maladaptive.
Evolution is lazy af
@@Pllayer064 you are a product of evolution, therefore?
wow so deep -14 year old girl
Wow, this is so amazing, I’m so confused because although I understand what this is I can’t even grasp what you had to do to make this video happen. I never been so interested in a concept and not able to grasp the “how”. Wow I’m stuck, even after reading your video description. 😅… I feel like a baby in a new world. Idk where to start. Just Wow 🤩
Sublime, Awesome and Beautiful.
I love how I'd hear a lyric like "road" or "droplets", and then I'd start seeing those objects materialize on the screen, out of thin air!
Also 3:42, "let it collapse" actually collapses into the background. :O
i know right? i really hope music creators start being this creative with their music videos.
Of course Cary would be on a video like this
I’m waiting for a tutorial about this you know. Just saying. 👀
@@CubeShip i thought the same too
It's not out of thin air if everything around it is globular mess with vague shapes and faces lol. :p
I honestly like this more after learning that it wasn't all purely made by the AI and it involved something more than just playing the song to the AI because it shows how it can be used as a tool for instead of a replacement of an artist. Like if you input key-frames and some things you definitely want in there like the camera movement and the text in this one and then let the AI do its thing to give you something like this, if an artist then goes over it and makes it more coherent by making the textures not shift around as much and also picks out and emphasizes figures and symbolism that they read into it is would be a great creative tool.
So nice the vibe!
I really like what YOU have created here. It would not have existed without you - remember that! Anyway thanks for adding the info in the description, I want to have a go at using DDV5, looks amazing. I love the style of imagery, sometimes photorealistic, sometimes paint-like, and its quite obvious where you've added the manipulations to help the storyline along, music sync and camera motion. Really nice work. One thing I would like to know; once you've set everything up, will it always regenerate the exact same footage? Or is every generation unique while following the basic rules you made?
This literally broke my brain and makes me question reality. Next Up: Get the AI to write the song too.
It’s a music video not reality tho. Two different things
Next ai gen: to make Matrix like video games
OMG, I thought it generated the song also till I read your comment and double checked the description. The lyrics were such random nonsense that I thought it was an A.I. using an algorithm to assemble words and generate a human sounding voice. That song felt as computer generated as the visuals did.
@@raduromanesti6408 AI eternal hellscape + ppl implanted w nightmare brain chips lol jk let's hope not..
Yeah and the next thing will be that AI will tell us what to do. 😅
it's pretty weird how AI generated stuff always has human eyeballs everywhere.
AI is trained on tons and tons of photos, and humans tend to be biased to favor taking pictures of humans, and human faces, and eyes. It's naturally picked up that eyes are important to humans via what images have been fed to it
I feel its the same thing where you might see a face in the tree bark. The AI recognizes vaguely face like shapes in things and begins gerating them as features like eyes or an entire face.
@@Acherus29A
AI based
It's actually the illuminate's influence on AI through their space stations
@@benjaminwalker9369 I just sent them a letter
"Please integrate more cool triangles in future AI."
They said ok.
Need more of this
It's constantly evolving thoughts, random thoughts and so much more, all mixed together. Unfolding in constantly new ways.
1:05 this is probably my favorite example of the art listening to the lyrics, I love how the newspapers appear when the lyrics say “ready about your life on your local paper” 1:47 is also one of my favorite parts, I’ve never seen someone, or rather *something* take a stretched texture and transition it into actual art like that.
The movements of the "camera" are on beat with the song too which is pretty cool ngl. I know you coded that in yourself but damn it just looks so well done and the ai clearly took the input well.
This is the craziest thing I have ever seen. Absolutely beautiful. Hard to believe.
I love this, pleaseeee make more but of indoor spaces so it’s spooky and liminal and also fantasy/sci-fi
Wow! I am very impressed.
I did research in AI for 40 years, mainly computer vision for much of the time.
In 1988 it seemed to me that neural networks were the only future for AI, although that view was not popular. 😄
But the limiting factor always seemed to be computer power.
Since I retired in 2008, progress has been accelerating dramatically as the hardware has become more powerful.
I am so happy to see all the exciting achievements, like this one. 😀
This comment was so uplifting and I don't even know why. Stay awesome Programmer Person.
The computing power certainly helps but that was actually not the only factor contributing to this advance... not by a long shot.
The main contributor was the creation/discovery of the Transformer CNN (convolutional neural network).
This was discovered by the Google Brain team while working on a language model. Basically, they created a CNN that looked at strings of words ahead and behind to create a degree of context. This turned out to be far more powerful than they imagined it could be.
The Transformer CNN is behind OpenAI's GPT models and Google's Imagen, as well as many other projects.
In 2024, a small British company (Graphcore) will commission the Good machine. This supercomputer will support 5X more parameters than the human brain has synapses. Their processors are highly parallel and contain all the memory that most applications will require, distributed internally. As well as being very energy efficeint, their current processor requires 1/5 of the training time of Nvidia's A100 processor. The company was founded with goal of creating a superhuman intelligent machine. Among its intitial investors are DeepMind's founder, Demis Hassabis and OpenAI's co-founders.
We live in VERY interestng times!
Thank you for your great contribution to our society, Mr. Barrow. Your legacy will permeate things for a long time to come!
you were clearly ahead of your time! :)
Thank you for your work. Without you AI might not be the same today.
If you told me this was the official music video for this song, I'd believe you. It's so unique, and so mesmerizing!
It’s so fascinating, how the AI try to visualize the lyrics. The AI know how to create its best objective way of art, that I ever seen in my life.
Really this is a demonstration to the development to the mind´s read. I seen as the images did see me that the music wanted to say me. That is incredible thing.
This looks like how a dream feels, with pictures constantly shifting and changing, and not being able to focus on everything. That's something I've always wanted to create with art but didnt know how to do. Amazing! ❤🧡💛💚💙💜
my dreams are literally never like that and always stable
Yeah Ikr, kinda feel like having LCD
Exactly this. It's also somewhat like how my adhd works. I see not one thing when I see something. But that isn't accurate either. I feel things and if I could just shift my perception I would see more of the picture or less. So that I could breathe. 💞🦄
It's interesting how as your watching the images morph, you constantly think you know what you're seeing until you look closer and realize that it's really just an abstract assortment of shapes and colors that make up what feels like familiar objects. It's so memorizing, like my brain couldn't keep up.
You obviously have a very good grasp on Disco Diffusion. I'm currently trying to run the same settings on a reels screen ratio (I realise now its way too long for a reel)
I am amazed how this is still the best result of video AI I have seen so far. Even with all the development going on. Amazing
I ve seen better ai music videos
@@luxraider5384 idk, the most I have seen were honestly not that impressive because they look like random images with the same noise pattern played after one another. In this one there are smooth transitions. Can u give me an example? I would like to see some more cool videos :)