Using Image Editing Software to Manipulate Sound
HTML-код
- Опубликовано: 11 май 2021
- I did some experimenting with converting sounds to .png image files and then editing them with image editing software!!
WAV2PNG: directmusic.me/wav2png/
INSTAGRAM ► / leviniha
TWITTER ► / leviniha
SOUNDCLOUD ► / leviniha
SPOTIFY ► open.spotify.com/artist/5hiUh... 
Видеоклипы
Woah, thank you for using my little web app in this video! I've fixed a few bugs since this video came out, but if anyone has any issues feel free to hit me up!
Yes, where can I find this app?
@@jordoneaton7083 Description man directmusic.me/wav2png/
@@jaczob666 Thank you. My screen narrator has been glitchy lately and appears to have missed that.
Do you have this up on GitHub or anywhere?
You really have to make this a VST
Ah, music to my eyes 😅
Cursed
Now we can say "I can see music notes"
🤣
@@Euphoric_Brunette perfect pitch In the eyes
OW IT SOUNDS SO BRIGHT
this reminds me of throwing pngs into serum wavetable
Or harmor
poo
Hello Dylan
how this website actually works is related to the way the golden record from voyager 1 and 2 works.
how it’s related is because both ways the record’s encoded image audio and the way the image is converted into sound uses the same encoding technique. i used to have a hyper-fixation over this, which is how i know how it worked. let’s say you input an image with a height of 432 pixels. the waveform that it outputs is actually divided into 432 parts, with each part corresponding to one pixel row of the image. how the converter encodes each part of the waveform (which corresponds to one pixel row of the image as i said earlier) is by using the crests (aka peaks or high parts) and troughs (aka valleys or low parts) of the waveform as different brightnesses. crests corresponding to lighter colors of each pixel row, and troughs corresponding to darker colors of each pixel row. so the converter scans through each row of the image left-to-right and outputs them as one part of the waveform. the converter scans through the image and outputs them as a waveform until it completely finishes generating. this is how the images are converted into waveforms.
I put random images into Audacity
The images are read pixel by pixel from left to right, top to down, like when reading text. This means that when you stretch something to be two lines instead of one, you repeat it twice. If you wanted to stretch a sound to be twice as long, assuming it takes up only one line, you have to make the line twice as wide, keeping the first half where it is and wrapping the second half onto the next line. Let me illustrate with text.
this line contains a snare:
___SNARE__
stretching it vertically gives you two of them:
___SNARE__
___SNARE__
stretching how I described it:
_____SSNN_
_AARREE___
Ooh, yeah... I feel like the colors mean frequencies or something about the waveform played at that particular time, like dark = a low sound, bright = a high sound, but that doesn't make sense when there are multiple frequencies playing at once...
@@Jopulis It's actually just the individual samples of the sound, left/right channel as red, the other channel as green. So the frequency is how fast light and dark colours alternate. And the amplitude (volume) is the difference in their brightness.
Hmm, Intersting
𝙎 𝙉 𝘼 𝙍 𝙀
I believe the way it works is each pixel's brightness represents the amplitude of a sample of audio, and it reads left to right like a book, so when he's copying and pasting vertical layers, theoretically it would be like repeating a line of text, and that's why it chops the sample rather than blurs it. I could be wrong though, but it makes the most sense to me.
Edit: got further into the video, that also explains the distortion effect, because with more contrast, bright pixels get brighter and dark pixels get darker, which should also stretch the waveform in a similar way. It's kinda hard to explain, but I can sorta visualize how it's working.
I can explain it more simply: The X axis is frequency, the Y axis is time and the brightness of each pixel is velocity.
@@farmerchuck7294 wtf is velocity
@@stxnw It's basically how hard you play a note, it's in practically every DAW and it's kinda like volume but not exactly. I'm surprised someone can watch this guy without knowing what it is, but maybe you just started watching him.
@@farmerchuck7294 so its amplitude?
@@stxnw Pretty much
Can we just all appreciate the quality of your videos
Yo you keep disappearing and appealing out of nowhere with great content 🔥🔥🔥
He is very appealing indeed!
Task failed successfully
he really makes grate con tent
Appearing
yo i keep doin your mom
PNG and WAV files are probably the best formats and they are my favorite for image and sound. WAV format is just uncompressed bytes of sound. PNG uses 4 bytes of data per pixel (RGBA), and usually WAV uses 4 bytes characters as far as I know, so it's perfect conversion.
Of course here a challenge... Make a song out of pngs if that's even possible.
i already done it
@@sergejsdarznieks321 pics or it didn't happen
It would also be cool to try to paint a full understandable picture with recognizable objects in the picture that make a song when converted to a wav file.
can we get a round of applause for the editing in this video!
You should've tried changing the hue of the image
There is a thing called databending where you open an image in a audio software and add effects it looks super trippy!
14:08 - That reminds me of scanning through radio stations sound.
1:50 why does that sound so damn good wow
0:01 omg the fucking nostalgia from the gta san andreas destination marker sound
Your content is so different from other music producers. I love that!
Now do the reverse.
In audacity, if you click "import raw audio" it will accept ANY file type as audio. Ive found using weird file types with weird data (.AVI, .blend, .apk, etc.) Gives the best results.
Good to know!
I think that the best explanation I have seen is that it reads left to right top to bottom, red channel is probably the left channel and green is the right channel. That would make the most sense to me. That would explain the popping sounds, the color of the image, and also means it would be hard to use image editing software to actually edit it due to the way it is formatted
Edit: This is almost definitely how it works. If it was formatted differently that would make editing it much easier
You just gave me the perfect tool to make weird sounds for video games, and dubstep. I can not thank you enough for this video.
You should try converting audio to PNG to compressed jpg and back. Might be interesting.
i think the weird stuttering you're experiencing, which you speculate at 3:55 is the sample rate, is due to the actual png resolution. i suspect that each one of those delay/echo effects is occurring with every pixel in the image, so if there were some way to increase the vertical resolution of the images that the converter program uses, you could have less choppy results.
what if the png resolution is the same as the sample rate
@@arcioko2142 if the .png resolution was the sample rate, either the images would be much much taller or we wouldn't be able to see all the little oscillations in the resulting waveform, like at 6:59 we can clearly see the waveform's oscillations occur more quickly than the stutter effects, and based on how many of those oscillations fit across the screen at once, we can easily see how if there was even one pixel for each oscillation, the .png would be so much taller than it is
@@wyntrr_end oh ok
It's because the audio is encoded into one single horizontal line of pixels that is then wrapped vertically. It should be read right to left, and then when you reach the end of the line on the right it continues on the next row on the far left. Think of it like reading this comment. If you did a vertical motion blur all you are doing is duplicating letters vertically across words in different lines.
Example:
This is a sentence about ducks. Quack!
Gets incoded as:
This is a sentence
about ducks. Quack!
Turns into:
Tahbiosu t idsu cak sse.n tQeunaccek !
Tahbiosu t idsu cak sse.n tQeunaccek !
Which would turn back into audio as:
Tahbiosu t idsu cak sse.n tQeunaccek ! Tahbiosu t idsu cak sse.n tQeunaccek !
Rather than:
TTThhhiiiss iiisss aaa ssseeennnttteeennnccceee aaabbbooouuuttt ddduuuccckkksss... QQQuuuaaaccckkk!!!
This is why everything got stuttery. Because he was blurring the sounds vertically across multiple rows of time. Even when blurring horizontally, the blur doesn't wrap with the pixels so the audio at the left and right edges gets messed up.
If you could unwrap this image into a single horizontal row of pixels the blur would probably sound a bit more like reverb.
@@ORyanMcEntire (with the exception of the motion blur on your ducks example) that actually makes a lot of sense. after experimenting with it a bit myself, I see that your explanation makes much more sense than what I said.
interesting that this means there's no connection between sound frequencies and the x coordinate in the image (in the sense that the lower frequencies are not to the left of the higher frequencies or vice versa)
I can’t believe I’m watching this in the middle of class
These faster uploads are amazing.
the noise added to the song when you first tried it, it sounded cool like it had a lofi-ish vibe
I would actually love to see a part 2 to this video! That was awesome! ^_^
I can easily imagine Andrew Huang making music with that.
There's a function in Serum where you can use PNG images as wavetables
In harnor in fl Studio you can do that too
Its in the paid version of vital too I think
@@noface718 you can try it in the free version i think
@@raoufbensalem3417 nope Tested it You cant
@@noface718 i think its text to speech not this
Omg I’ve ALWAYS wondered how this would work
Im surprised you didnt try using random images or doodling on the image
or pure sounds, like sine/saw/square waves
@@dacolib I used a sine wave-
I am loving the upload consistency recently! Keep up the amazing work!
10:06 "That's a bulgy boi"
Beat proceeds to shart on everything.
Hmmmmmm
This video was made with *red heart emoji*
it really was made with [ *red heart emoji* ] and it shows 😍
how this website actually works is related to the way the golden record from voyager 1 and 2 works.
how it’s related is because both ways the record’s encoded image audio and the way the image is converted into sound uses the same encoding technique. i used to have a hyper-fixation over this, which is how i know how it worked. let’s say you input an image with a height of 432 pixels. the waveform that it outputs is actually divided into 432 parts, with each part corresponding to one pixel row of the image. how the converter encodes each part of the waveform (which corresponds to one pixel row of the image as i said earlier) is by using the crests (aka peaks or high parts) and troughs (aka valleys or low parts) of the waveform as different brightnesses. crests corresponding to lighter colors of each pixel row, and troughs corresponding to darker colors of each pixel row. so the converter scans through each row of the image left-to-right and outputs them as one part of the waveform. the converter scans through the image and outputs them as a waveform until it completely finishes generating. this is how the images are converted into waveforms.
I'm still watching, but the first thing I would do is convert the sound into a png and then BACK to audio without changes to make sure it even does that properly in the first place. Shakiness of audio might be just a png compression artefact or something like that
Pretty true
I did it
It's not lol
@@Kai_On_Paws_4298 You mean it does not convert back to audio properly? :D Thought so
Definitely a lot of fun and quite useful as well. Thanks a lot! Great video.
Levi with another banger as usual
WAIT THIS IS EVERYBTING IVE BEEN LOOKING FOR
Another upload so quick??? This is great! Love the videos!
do this but try changing the orange color completely to blue or green or something. that could be really interesting
It does nothing probably
You gotta drop the full release of the first finished product at the end that was actually sounding good 🙌
I love how the song at end actually sounds pretty good lol, btw can you try making music in a video editor like premiere?
The end result had a faint Daft Punk kind of vibe to it. Sounds interresting, could be a great thing for sound design.
Puft dank
You are a madman. I love it.
Jeez man you just keep coming back with bangers
14:20 flipped all those layers and ended up sounding like a Blanck Mass song
Thanks. I'm glad someone figured this out
This is insanely cool
Thanks for this video
Helped me a lot
Very sick vid honestly 👌
dang, levi is on a roll
Aw yea i used to do this all the time as a kid. I loved using it for data moshing
Amazing!
My boy direct!
You are crazy. I'm here for it.
why is this actually kinda cool
Very cool idea
this could be used to hide a message in an ARG :D .
That what i was thinking XD
Gave me an idea
Damn, this is really cool
this is dope
now i have some sounds to use in my bandcamp experimental album!
Yo that's so cool
2:09 the best banger dubstep ever
You're a legend, you should make a skillshare course because you're amazing at this! I'd love to learn from you!
now you can save music to paper!
have you found out about blob opera yet? I spent a couple days going through a bunch of covers people made with the 'experiment'. its an a.i powered choir.
yay new levi niha video :D
This is a really cool concept. I wonder what adding like visual distortion does to a guitar like does it actually distort it?
sending stems as pngs is actually a great idea
Aw cool i will check it out
12:26 laser gun yes
4:20 (not intended) that would make a good sound for like a machine gun.
Awesome video! You should have compared the original loop to one that was converted to an image and then directly converted back into sound so you can see how much information is lost in the conversion process every time
a DAW you never thought you needed.
Now I can definitely prove I can hear images
Nobody:
3:39 Travis Scott: thats fire 🔥🔥
I’ve been looking for something like this
guy literally be making beats in Microsoft paint. i thought excel was something, but now the music community has peaked. this is the ultimate DAW
Oh hell yea, another Affinity enjoyer.
pretty cool
2 Levi Niha's is a lot of Levi Niha's
great video!
kinda inovative ngl
my friend : what songs you listen to
me : it’s complicated...
This would be a beast for Lofi hiphop
niceee
This could be crazy for making glitchy/weirdcore/hyperpop/experimental tracks
Impressive
Looks cool . i tried chopping and miss placing pieces over top each other gives cool effect if just doing vocals
Do this again, but with your knowledge from this video! This could give a unique style if mastered!
I did made dubstep glitch sounds way back in my college day's .
It was fun .
But you must use EXE files or folders files .
Something of that jazz .
This will be future music production
Photoshop is my favorite music program
So this is what they mean by hearing images. Thank you sir
- Hey man, what's your DAW ?
- Have you heard of MS Paint
I literally used this to make dubstep growls 🤣 super sick wavetables
This will be amazing for earcandy shizzle
Heeyy levi i am here to BEG YOU to do an extended version of the old outro that sounds like a distorted violin
I just love it too much
i wonder what a picture of you would sound like XD
i did this to one of my pngs and it electrified me lol
Image Synthesis. Insteresting idea