How to rotate sound in spectrograms
HTML-код
- Опубликовано: 28 авг 2024
- spectral rotation is possible!
after seeing the matt parker video on rotation by skewing, i thought what it would be like to apply this to spectral audio
link to that here ; • Rotation without rotat...
further points : you can achieve exactly a 90 degree rotation if you inversely match the automation of the frequency shifter to the sine sweep you generate. see this video for 90 degree rotations • 90 degree rotations : ...
practicality? well who knows, you're the creator after all, use the tools however you like!
for me it was a little experiment, a bit of fun.
you could definitely use this for some sort of audio watermark that blends in nicely with whatever you're doing
america ya :D
HALLO :D
HALLO :D
HALLO :D
HALLO :D
HALLO :D
What do you MEAN this isn't practical, you could totally do some funny sound design things with this
yea but THAAT much rotation is hard to be practical with but you do you, of course, i won't pull an audacity and stop you from doing what you wanted~
basically false noise
@@Jarran2R true
I almost fucking stopped watching the video when he said that. Jesus.
okay okay, i take it back, its not impractical, its AWESOME
Absolutely love it and you bet I will try to make this work in a musical context.
Also
Neko Koneko
oh no (happy VR cooking sounds)
oh sick haha, i'm excited to see how that'd turn out!
hi energy drink guy
virtual riot fr
Virtual riot is a azumanger fan? Yay
That is CRAZY! Honestly a cool way to "hide" music in weird ways. Instead of spectograms hiding images like Aphex Twin's face in formula or the spiral in Windowlicker it could be another song or jingle!
I saw this thumbnail and immediately thought of that Matt Parker video and now I feel proud of myself for having remembered a thing I learned on youtube
I was expecting some rotation matrix freakyness but this is actually incredible simple. Very cool!
Convolution is matrix multiplication
@@mbartelsm I guess I'm not too familiar with how spectrograms or convolving works. But coming from the background of shader/3D programming, I was expecting the X axis to be time and the Y axis to be frequency, and then a rotation matrix would be performed based on those.
Here you have some mathematical freakyness which I first thought the video was about: en.m.wikipedia.org/wiki/Fractional_Fourier_transform#Application
@@SwifterYTI mean it's basically matric multiplication but hidden I think
bro this technique is genius lmaooo i tried similar things in max u can save spectral data and then do image processing like rotation, kaleidoscopes, scaling etc
oh damn thats goated
I bought your plugin
@@mylittleheartscar ily
Yessss had many happy days with this... you can use an online wav-png converter (because of course that exists) and then just... edit sounds in photoshop. And convert them back. Haha. Blur is really interesting as a tool, it creates a kind of symmetrical delay that's 50% back in time and 50% forward in time, and its sensitive to the aspect ratio, among other things.
But come to think, that process is more like a way of acting on the waveform... rather than the spectrum.
Of all the sound design shenanigans I've seem so far, I was not expecting this! What an interesting technique
This is literally THE point of metasynth, essentially. This is useful.
is that a product?
yes it is, my god, i do not need another distraction right now
i gotta check that out
You used the Azumanga opening whattt 😭😂
I love how it's completely unrecognizeable after rotation
it feels like an eastern Rick Roll at this point
THAT CAUGHT ME COMPLETELY OFF GUARD LMAOOOO AZUMANGA DAIOH OPENING JUMPSCARE 😭😭😭😭😭
tsukurimashou!!
@@jordyandrews sate sate nani ga dekiru kana? :3
“why is this being recommended to me?”
azumanga jumpscare
“ohh”
i loved the effect of the first skew! it sounds really interesting!
"so here we have the azumanga opening theme" 🔥🔥✍✍
best video i’ve seen with someone talking over a screen recorded application in some time
The algorithms picked you up. Lucky man.
this is so nerdy i love it
I saw the title and immediately thought of the video you referenced. Needless to say, I was quite pleased to see you were doing exactly that! Cool video!
This man unlocked a new dimension 👁️
Hey, science is science. It's always interesting and beautiful! It would be amazing to watch the rotation in real time, if that's possible, while playing the original audio along with the visual. Neat stuff, thanks for sharing.
"Wow... crazy..." 😂
Wait this is such a cool application of that principle :O
Can't wait to see if people can find a use for it
Gonna make an album that needs to be rotated to be listened to
We use to call them vinyls back in the day
The moment you showed the spectrogram, I immediately thought of the skew video.
im not even a musician or anything but this was fascinating lmao
thatd make an awesome riser ngl
Very interesting! I was confused at first but as soon as you put that Matt Parker clip on screen I understood exactly what you were going to do :)
Some devious person is going to come up with a way to create a sample that sounds good _after_ you do this to it.
lmaooo
So basically the first skew is a convolution with a sweep, and the second skew is done with the frequency shifter, which works as a modulator coupled with some pre/post high-pass filters. The high-pass filtering stage must be the primary source of losses.
A possible use might be the IFS technique which iteratively applies a set of different rotations to form fractals. My experiments from 2008 shown that audio fractals can yield rather special and weird noises. =D
yeah i also suspect that its the lowpass filter when its at 180° but i tried a few things yesterday and it seems to be a different issue, since i managed to get the lowend back by playing around woth the timing but the frequencies were slightly off
There are actually fractional fourier transforms that rotates spectograms. And they can be used to rotate a spectogram apply a filter and then rotate back. Thus you apply a «rotated spectrum»
I'd be interested in how this would sound like if it's used more subtly (less intense rotation)
1:20 - that's a nice transition effect in and out of funny trance loops
Well, I made this into a VST folks that you can use on a continuous signal. Reply if you're interested, I just need to make the GUI nicer.
!
THIS IS VERY PRACTICAL WDYM
I don't CARE if it's practical, I just think it's really cool! xD
I CANT GET AWAY FROM AZUMANGA DAIO
START WATCHING THE ANIME
Really neat concept! This is probably harder, but it would be interesting to see a repetitive sample set to rotate constantly so you can hear the transform
0:58 THAT SOUNS SO COOL :0
for sound design it's really practical
This is amazing! Although it would be hard to rotate full songs or anything of length, but for single samples it must be increadibly fun
definitely possible for longer songs if you are okay with it falling out of the spectrum a little bit lol
or for 90 degree rotations you can do the whole thing pretty easily
@@idiotinium but if you cram a full song into a 1-24000 hz window, lots of it will be lost, impossible to recover. And the sample is probably going be just a very anoying noise
nah
but yea it would sound like that
I'd love to see what this would sound like if it was rotated little enough so that you could still depict the original noise through the rotation.
There's a DAW based around using image editing tools to shape audio waveforms.
And I know for a fact it isn't just a VST.
brilliant example
rotate it twice, figure out how long the sample needs to be to fit in the 20khz-20hz range, and you'll have a new instrument that changes in weird ways over time (passing over the amplitude of literally every single frequency of the song and how it changes over time at once).
This would be very useful for sound discovery.
If it doesn't work, then the convolution steps were probably wrong algorithmically. I wouldn't be shocked if converting something from 1d to 2d, rotating it, then converting back to 1d comes with unavoidable costs.
Good song choice 👍🏻
This could be a really cool puzzle in an ARG or something
Could I hear the full erosion but I only want it slightly rotated
Voices of the Void moment
Sata andagi
Sounds awesome.
You may be interested in the Fractional Fourier Transform. I did very similar signal processing for work
yeyeye i did some stuff with that and yeah its basically the same
This may not seem useful in sound editing, at least in the first glance, I think I saw a very similar concept applied in a image processing. Specifically, by rotating the FT of original image and applying a pass-filter along one axis worked better for denoising (?) than without rotation. I forgot exact details or the reference, but that seemed quite useful.
AZUMANGA OPENING THEME??????❤
pretty awesome, sounds similar to veritasium intro sound effect
video of the year
the frequency sweeps thing is actually how i made my frequency vibrato thingimajig
oh yeah azumanga
while we’re on the topic of the anime
i hate that small girl in a specific episode where she does not take sakaki’s gift and refuses
fr that was so cold
so crazy and azumangedagedago daioh
this creates an interesting 8-bit sound effect like in old game music, or other sfx. Id like to use this in mine sigilkore beats, thx yo❤
The fact that you used soramimi cake makes it 10 times more funny
if i remember how disperser works correctly, scew is basically extreme disperser.
lmao yeah basically, and linear
The front page of RUclips brought me here. Wow, crazy!
Pitch shift and a frequency dependant delay, noice
would be cool to listen to the same clip over and over again with varying angles
woow crazy
I do this all the time in metasynth but I can only get it to rotate a sound. I can’t seem to get it to ‘skewer’ something horizontally or vertically. Maybe there’s something else that does
Whoa, what if you rotate it, apply some effects do some things to it like encoding in a lossy format and then de-rotating it, so the effects would be rotated but not the original sample.
🔥
Though you’d probably get many artifacts just from frequency shifting (notice how they appear only after that and not after convolving with a sine sweep) two times.
Lu La Lu La piano wa sekai no yumesaku nohara ni melodyyyyyyyyyy
I didn't understand all of this, but would it be possible to rotate it only a tiny bit? Like skew only 1/4th as much in each direction? Theoretically it would sound similar enough to the original to be recognizable. I'm curious what that would sound like.
Wow, that sure was a sound
S tier thumbnail
That's genius !!!
Amazing idea!
that sound is so dope though
Is there an ableton equivalent to convolver that can do the sine sweep?
hybrid reverb on convolution mode, disable the eq and the attack and predelay
It would be cool if you could use a spectrogran to encode a sound. I've tried, but I don't have the right doftware lol.
thank you youtube and idiotinium
no way the idiotinium recommendation on my homepage
Rotating/skewing by a very tiny amount would be nice
lol i didnt expect to get soramimi cake'd
What happens if you make it do a 180
i have another video that explores that
Try rotating it back and see if the audio is discernible or how smushy it sounds lol
you'd lose a bunch of data since the frequency shifters are pushing some frequencies above nyquist and some frequencies below 0hz. it'd probably just sound like a mangled filter sweep
i did that in another video where i did four 90 degree rotations, check description
not practical? that sounds cool as hell
can you recover the original sound? or do you need more information to recover it?
you can
What happens when you do that but not as steep
Okay this is some good stuff
why did I recognize soramimi cake by the waveform alone?
I remember when Fruity Loops was just a sequencer 😩
was thinking it was some crazy new data enhancing technique for text to speech models :')
nope
is this not already implemented in those wacky spectrogram based music creations that were popular a few years back? with all the cubes and butterflies and whatnot?
It may still be audible at tiny rotations
before I even start watching this video let me guess how you did it something to do with sin cos tan. update I was wrong
I was thinking of a video called "How to rotate any graph by any angle" when I made my guess.
i swear i heard a sound effect like this before
This is fantastic!
so when you say watermarks, you could hide this in some audio and then reverse the skewing steps to retrieve the original audio? cool
If you do that 3 more times is it backwards?!?
someone should use this in an arg lol
he just saved his replay buffer instead of recording normaly :D
lmao yeah
if you do this with a message (spoken text for example) you want to hide, and then export the result. can someone else un-rotate it and get back the original message?
yes i explored that in my latest video ruclips.net/video/RiDIiErtK40/видео.htmlsi=8GJuWsSgCahbq6wA&t=978
is there a way to just use linear transformations on the image such that we can rotate it without using skews?
dunno but that would be cool
Au5 liked this video.
Oh may gah 😱
wait.... can you then export the sound and do the same trick in reverse to "unrotate" or "decode" it back to its original sound?
yes i made a video about that