AI image generator simulates synesthesia with the Teenage Engineering OP-Z
HTML-код
- Опубликовано: 11 окт 2024
- AI-generated art is a new frontier rife with potential. But for every thorny question about copyright and the potential for widespread manipulation, generated art can also inspire wonder and awe. For example, look no further than this AI-powered experiment that creates kaleidoscopic visual landscapes for composed music.
A collaboration between quirky synth and hardware brand Teenage Engineering and design studios Modem and Bureau Cool, the project draws inspiration from the neurological condition synesthesia. This rare phenomenon leads the brain to perceive sensory input for several senses instead of one. For example, a listener with synesthesia may see music instead of only hearing it, observing color, movement and shape in response to musical patterns. Conversely, a synesthetic person may taste shapes, feel words from a novel or hear an abstract painting.
The audiovisual experiment uses the Teenage Engineering OP-Z sequencer as the music source that is then translated into AI art. In real-time, Modem and Bureau Cool’s “digital extension” translates musical properties into text prompts describing colors, shapes and movements. Those prompts then feed into Stable Diffusion (an open-source tool similar to DALL-E 2 and Midjourney) to produce dreamy and synesthetic animations.
Modem co-founder Bas van de Poel sees the experiment as fuel for artists’ imaginations. “With the project, we see the potential for musicians to explore new forms of creativity, facilitating a joint performance between human and machine,” van de Poel told Engadget.
If you’re a musician who owns Teenage Engineering’s OP-Z, you can’t yet use the extension yourself - but that may eventually change. Van de Poel tells Engadget that the companies are “exploring the potential of launching a public version.”
This AI-based project isn’t the first to bring synesthetic properties to the masses. Last year, Google Arts & Culture created an exhibition that flipped the concept around, bringing machine-learning-produced sound to Vassily Kandinsky’s paintings.
Read more about the project here: www.engadget.c...
Subscribe: / engadget
Like us on Facebook: / engadget
Follow us on Twitter: / engadget
Follow us on Instagram: / engadget
Follow us on TikTok: / engadget
The Engadget Podcast: itunes.apple.c...
More about Engadget Audio: www.engadget.c...
Read more: www.engadget.com
So Windows Media Player Visualizer?
Was gonna say that 😂😂😂😂
But with "AI" so $$$
No, windows media player visualizer looks beter 😂
Windows media player visualizers were to closer to replicating the synthestesia experience than this is.
I remember trying to learn to love the terrible visualisers in media player. Winamp really did kick the Microsofts ass with the community coming together to make some of the most stunning visualisers that I don't think have ever been bettered. But we've all kinda moved on from them. Isn't it weird how music has become so detached from the visuals a modern computer could put out. Is it just music videos are so much more appealing or what? I don't watch really any of them listening to music myself. Just a curious future that I'd never had predicted when I was deep into configuring the options of the latest winamp plugins.
I have to say, I have sound-sight synthestesia and it's...not really like this. More pulses, waves and sparks along the edge of my vision and unlike what is being shown here, it is highly reactive to sound-in fact, I think the old windows media player visualizers were closer to what I experience. Honestly, the visuals being presented here are more akin to a movies presentation of a drug trip than anything remotely similar to what I see.
I also have synaesthesia, and also thought the same thing. Way too slow and ...evolving, morphing, unrelated to the beats. For me, sounds or sections of music, especially electronic, and their colours and shapes are very important, and change as quickly as the sound changes, jagged lines and flashes and degree of randomness in position. I've thought about designing a visual language for music and DMX nightclub lighting, but for it to work it needs to be fairly universal else it'll just be correct for the designer. An example is how studies have found almost everyone across cultures connects the nonsense word bouba to a rounded shape and kiki to a spikey shape. I'm sure the same patterns are there for sounds and visuals.
👆👆 congrats 👏👏 you are one of our luckiest winner 🏅🏅 message me on the above Telgram and claim your prize 🎁🎁
I dig the songs, what are they?
👆👆 congrats 👏👏 you are one of our luckiest winner 🏅🏅 message me on the above Telgram and claim your prize 🎁🎁
preset projects/patterns on the op-z
Just noticed AI ART spells ATARI
👆👆 congrats 👏👏 you are one of our luckiest winner 🏅🏅 message me on the above Telgram and claim your prize 🎁🎁
no way they got this working in realtime.. maybe on like an a100 lol.
👆👆 congrats 👏👏 you are one of our luckiest winner 🏅🏅 message me on the above Telgram and claim your prize 🎁🎁