Despacito but converted to a [Black MIDI] with 4.1 million notes
HTML-код
- Опубликовано: 25 май 2018
- Using W2M, you can actually hear the lyrics of the Despacito music video (by Luis Fonsi & Daddy Yankee, not the Justin Bieber one)
I am using a program made by 梦幻no人生, a member of the Chinese black MIDI community.
Don't watch if you are prone to seizures . . . please.
The program was written in Python and uses fast-fourier transform (FFT) in order to convert the original song into notes. It is similar to the MP3-to-MIDI conversion stuff you'd find online, but this one is much more detailed and sounds much more realistic in my opinion. The program is not public and as such I must respect the original developer's wishes by not distributing it. If you wish to download the program, ask other people who are involved in the distribution of the program (like Ryan 0201 or ooo 000) and they might give you the Discord server link to download it.
Here is a picture of a portion of the MIDI loaded in Takabosoft's Domino MIDI sequencer:
i.imgur.com/CzhPhHY.png
The tracks that separate the colour of the MIDI are actually based into velocity classes, in other words AMPLITUDE.
I went into Piano from Above and changed the colours to closely match that of spectrograms, and ended up with this (this also is a portion of the MIDI).
i.imgur.com/2ylzPVi.png
Piano from Above from left-to-right goes from low notes to high notes, meanwhile a spectrogram would go top-to-bottom from high notes to low notes, so I flipped the image vertically to try and emulate spectrograms. I am very happy with the result.
I might upload more videos in the future if you guys like them.
I accept contact by email (see my channel's about tab), Discord (below), and RUclips message. Any of these three methods will certainly guarantee a response from me. If it's a little more informal, I usually read the comments on my latest video over other videos!
To become actively involved in the black MIDI community, here are some excellent ways to get started.
G+ Black MIDI Community Group: plus.google.com/communities/1...
Black MIDI Community Discord: / discord
════════════════════════════════════
TECHNICAL INFORMATION
MIDI Filename: Despacito-T5N4800L16V1.2.5.mid
MIDI Size: 23.1 MiB
MIDI Note Count: 4,134,835
MIDI Program: Piano from Above 1.1.0
Audio Source: Keppy's Synthesizer
github.com/KeppySoftware/Kepp...
Recorder: Bandicam
Codec: NVIDIA NVENC
════════════════════════════════════
A warning to all people watching my videos - if you are epileptic/uncomfortable around flashing lights, refrain from watching my videos -- I don't recall anyone actually having a seizure from black MIDI, but avoid those kinds of videos if need be.
#blackmidi
#impossibleremix
#synthesia 
Видеоклипы
![[Black MIDI] "Tau" τ/6.28 MILLION (6,283,185) ~ HDSQ | Piano from Above](http://i.ytimg.com/vi/tfrIXiemYqo/mqdefault.jpg)
I've seen people do this before, but I've never seen one that actually did fricatives right, especially sibilants.
Not just does this song have them, but they're very sharp.
How are those sounds portrayed in midi?
This is super impressive.
Ah, someone else who likes linguistics as much as I do. Although I cannot speak for the linguistic aspect of this (and trust me, I totally would) due to me not knowing exactly what goes into FFT, I can try to explain the rest.
The program was made in Python using the Fast Fourier Transform (FFT). During conversion there are a bunch of parameters asked from the user. One of the parameters is the note division. By default, it chooses 5 milliseconds (which is what I used in the video). This seems to already be much more "less quantized" than those viral MP3-to-MIDI conversion videos you see on RUclips. In addition to that, the program asks for tempo. By default, the program uses 500 BPM, which is extremely fast for most songs. The reason -- like before -- is to make sure as much data are transferred as possible in the MIDI.
The most interesting parameter used in the program is the FFT precision. The FFT size in Python is the number of bins used for dividing the window into equal strips, or bins. I got this better-explained information from a website, so I'll try my best to paraphrase: the resolution in Hz is determined by sample rate divided by FFT number (or bin number).
So for example, if sample rate was 960, and I chose FFT size 128, then the calculation would be 960 / 128 = 7.5. So each bin is 7.5 Hz wide, and you will be able to discriminate between frequency components which are at least 7.5 Hz far apart! Now, the program uses FFT size 2400 by default, which is enormous -- that means that the resulting bins are extremely, extremely thin, allowing for enormously accurate sampling. Such accuracy results in a high render time, especially for large outputs like this. Already we can see that the level of reading that this program does far outclasses those converters you find online.
Finally is the noise reduction. It ranges from 0 to 255 and represents the lowest threshold that notes have to be (in terms of loudness) before they are "ignored". In this particular video, I set the threshold very low, which is why every little sound (perhaps even the articulatory features you mentioned) was evident.
The FFT algorithm used by the developer takes the frequencies (I'm not sure if that's the right word) and maps them onto key combinations in MIDI. I noticed in the source code there was a gigantic array of floating point numbers, and the array was named "pitches". The author also instructs the user to use the SoundFont packed with the program -- so I assume that the program uses hard-coded pitch values / note values optimized only for that SoundFont. I tested the theory out by using another SoundFont and lo and behold, other SoundFonts sounded like trash with these exports.
In short, the program itself reads at an extremely minute level, picking up the details that other programs don't pick up on. It reads at that high of a level and outputs as much of it as possible into a MIDI file regardless of size. I once set a file to 1 ms instead of 5 ms, and set the FFT precision to an extremely high value and the program spat out a 21 million note MIDI. In addition to that, the other huge factor was the optimization toward the pre-packaged SoundFont. These factors were what allows viewers to distinguish minute linguistic structures like the fricatives and sibilants in the original song. Hell, I can almost hear him trill his [r]! haha
Thanks for the comment!
There is a video on RUclips that accomplishes this with a real piano and solenoids, obviously due to physics it'll never get the resolution of this black midi... Here is the video in all its glory... ruclips.net/video/muCPjK4nGY4/видео.html
Gingeas so what is exactly happening in this video? I'm confused how it different from your other despacito midi video
... I KNOW HOW!!! *Rasputin climbs out the closet with Hitler's nose hair* that's not what I thought......
GET BACK IN THERE
Markiplier has been busy making all these new versions of Despacito
Sheet Music Boss E
Well I'll say.
what are you doing here? you must be doing another "RUSH" now?
i wanna see you make a rush despacito
E
Is this what Hell looks like
Is this what heaven looks like?
No. It's birdbox
Crazy how piano tiles can actually emulate the lyrics
yeah
That would be hell hard to play
No, its an illusion. Dont trust your brain. Maybe get some couples therapy :/
@@paperholders ?
@@paperholders Not an illusion, piano keys are essentially just a simplified "which sound frequency do I want to produce" scale, but with buttons. This means most frequencies you can produce with your voice can be played on a piano and it would sound like your voice, because they work off the same principle of "producing frequencies in combination to sound like something".
As a mathematician, I find this application of the Fast Fourier Transform to be incredibly interesting. I’m sharing this around my math department at George Mason University.
that's awesome!
*DESPACITO 3 ANNOUNCED BY MATH DEPARTMENT AT George Mason University*
@Cosmic Ascendancy yes it is
You mean you found despacito 4 interesting
@@CC-hx8gj despacito-rier transform?
Despacito 3 is sounding good👌
woo
Despacito 4*
Despacito - Song on youtube with over five billion views
Despacito 2 - A Masterpiece
Despacito 3 - MINECRAFT EDITION
Despacito 4 - The ultimate despacito (This video).
Let me guess despacito 5 is FORTNITE NOTE BLOCK
@@silvertheshinysylveon6646 wrong
@@liamstudios1390 ruclips.net/video/dQw4w9WgXcQ/видео.html
this is not okay
pc31754
Was it EVER really okay though?
M lay
Lol so....your saying we go to war with Puerto rico?
FUCKING TRUEE
sounds like a badly compressed wav or sth
tin can telephone in 2018
cyberdustTV
that's basically what it is
Yeah thats about how that's made
Mathematically it is EXACTLY the same. it s the same math in both.
no bass
I don't like the song but this is wild- Lyrics played with piano notes, is that even possible?
Any noise can be emulated with enough overlapping sine waves
In theory someone could play this on a piano it would be hard tho
It is now
Mary Antonio yes but if you had 100 specially trained fast fingered gamers then you could get a crappy version of it
Jared Patane are piano notes sin waves?
Is this what Despacito looms like in the 5th dimension?
I know you meant looks but this definitely looms over all of reality like some kind of elder being that even Death is afraid of.
maybe the 4th
No, it's still 3rd Dimension.
If you want to look for the 5th, go to another Despacito Vocals In Midi video.
hey this is like a billion times better than that mp3 to midi thing
h o w
A very talented programmer + python
Sierox it's not his program, it's some japanese guy's
and no it's not for public use, you could ask him for a private copy tho (checc description)
Challenge accepted, FFT is not that hard. I’ll write one in C :D
Well with a Sine soundfont but still
@@user-cz9ss4yq4x is it done yet lol
How on earth RUclipss algorithm copyrighted this piano piece 🤯
Holy crap I can hear the voices perfectly even though I haven’t listened to the song in months! What the hell that’s so damn cool! I wish more songs were midified like this!
Just Another RUclips Channel I can hear the voices perfectly and I’ve never heard the song in my life
me too ikr
But you’ve listened to it.
there's a midi like this that circulates tumblr around december of "all i want for christmas is you" and it's terrifying
why do i hear a voice im not turning insane right? i can litterly hear the lyrics.....
That's the beauty of these conversions
TheRealMahameda the lyrics were made by the piano. *THE PIANO IS GOING TO TAKE OVER THE WORLD*
So basically your hearing these sounds and they are very close like to the lyrics, and because so, your brain can process them and put them together and so it means you hear it sounding like lyrics from the song, all because your brain is that smart c:
My ears. so distorted... *vision goes black and dies of brain melting*
2:54 ”Eating a burito”
Ok, this is a weird vid to comment this on, but am I the only one who really appreciates how intertwined the piano community is? I mean, on this vid alone, both SMB and Epre Troll have commented. I hope that I can one day walk among such legends like you guys! But for now, I only have what I have.
Yeah, I enjoy how intertwined other creators tend to be. There are a few users I count as "regulars" who comment nearly every time I upload a video -- occasionally it's a fellow creator like the people you said! and in turn I also comment on their stuff as well. Thanks for the comment!
SMB, Tom Mucenieks, BGH Music, Epre Troll, Lyric Wolf, and many others. It's great.
Anthony Benko
BGH and LyricWulf?
Ew
Now we just need mustia masta here
This is what dissociation sounds like
still sounds better than bill cosby's trial.
HEY HEY HEY!!!
Better than the original
Agreed
Yes It is
1955:we will have flying cars in the future
2019:
Yes
A technology that can replicate human voices by using piano notes would be hella interesting to those guy
It sounded so legit, even RUclips recognized it.
delet dis right now
also how is that possible
Dang this voice is super clear, usually it sounds very distorted and you can only just barely hear something if you know what’s being said beforehand.
wtf how did you convert lyrics to notes?
The program (not made by me) was written in Python and uses FFT to convert the song over from its waveforms to frequency I believe
It’s a black midi thing, you use a lot of notes to replicate words. Look up stuff like all star converted to midi or RUclips 2018 rewind to midi
skitex same way your computer does it. You didn’t think your computer was actually talking to you right? Lol.
This has to be a bigger crime than my MIDI
Just learned how to play this yesterday
GINGEAS FINALLY USED PFA
YEEEEEEESSSS
It's been 3 years
Yeah it's been several years
Gingeas
yee new synthesias look ugly
*_before this video started i had an ad about a guy dipping his foot into paint then getting figurines and dipping their feet into the paint then kept repeating it for over 8 minutes._*
*_i will commit despacito_*
This is mind-blowing. Like, it's so hard to accept the fact that it sounds so close to a human voice by just using MIDI sounds.
i dont know why but this black midi gives off a really weird nostalgic vibe
Okay, you win. I don't remotely know the lyrics outside the obvious, let alone understand the language. And yet, it's nearly crystal clear. At this point it's less an auditory illusion and straight up just making a piano speak, creepy.
Im actually surprised that so many piano keys at the same time can produce the sound of voice
So if you continuously and randomly hit the piano really fast, there is a chance it will sound like Despacito. Good video! :)
Aliens: Alright we have some recourses from Earth lets look at them
*look at this video*
nvm their technology is already way too advanced for us
the more you have the song in your head, the clearer it is. Obviously for me it was crystal clear.
Friend: What are you good at?
Me: Playing piano...
Friend: PFFFTT- HAHAAH!
Me: ..... and then making the piano sing the Despacito lyrics.
Friend: Never mind you win
ahah
@@ohboy2512 im so funny
the piano knows more Spanish than me
omg the voices sound so clear it sounds like better quality than one small step for man but with a few voice cracks but that's still amazing
this is basically how a logarithmic spectrogram sounds like as a midi. notice how the lower frequencies get messed up? this is why logarithmic spectrograms are flawed.
*_why do you type like that 💀💀_* anyways relatively recently i discovered that lower frequencies actually get blurred not because they're like a straight line getting blurred vertically, they're actually sine waves getting blurred horizontally through time in the fourier transform due to use of different windowing types or something (and if you use phase differentiation or whatever to try to clear everything up you still get that sine-looking artifact in the bass frequencies)
Everybody gangsta til the piano makes a guitar sound.
Me: *plays despacito*
Friend: *friend flops on piano still playing despacito*
Me:
just imagine a talikng piano...
and it speaks like this
the voices sound like they came from the matrix
they are calling your name, Love Whales
Keep in mind that when human beings speak, they make sounds with their mouths so yes, with enough notes, it makes sense that this is possible.
~ *Please wait as we put you on hold* ~
Even the piano roll looks extremely creepy as a Pixelated FFT Is flowing through at the moment.
I think you accidentally summoned the Luis Fonsi demon
the amount of anxiety radiating off of this is incomprehensible
So clean so perfect 10/10 good job
I wish English captions auto generated was an option on this video so we could see if it could recognize the lyrics
Its actually pretty easy
This midi conversion is the best one I've heard so far! The quality is astounding!
This 'Don't Hug Me, I'm Scared' episode is pretty entertaining
This is actually a perfect case of hearing a voice where there isn't one, the singing you hear is actually the notes on a piano.
idk how you did it, but this is way more crisp than the other ones, that just sound like piano, and you can _just_ make out the words. This, you can make out the words without even trying!
Even a centipede on speed would struggle to play this
Listen man, I’ve been here since you had less than 3,000 subs. Seeing how your videos and styles have changed has been a hell of a ride. I’m glad to see you with 150,000+ subs. You earned it man. Cheers.
As a Spanish speaker from Venezuela, this is pretty clear
I’ve NEVER seen (well, heard) any other song converted to a midi be this clear. That’s really impressive.
I DO NOT NOR HAVE I EVER MEMORISED THE LYRICS, BUT I CAN STILL HEAR THEM PERFECTLY WELL, EVEN WITHOUT SINGING IN MY HEAD. HOLY CHRIST
My friend: Hey what languages can you speak?
Me: uhh it's complicated...
This is really cool, we just learned about Fourier transforms at school. Do you think each piano key could be changed to a pure sine wave instead of a piano? I want to hear if that improves the quality
Other MIDI: barely hear the words
This: Singing Along
First one to Watch, and also, thats I N S A N E
No Your Not its says for u 1 minute ago and for other people it says 24 seconds and 18 seconds liar
Then, fuck it :/
Lol
kek
Alexi Sanchez Wait, If the other comments is in 24 secs or 18 secs ago, which means they are late, but if the comments that are longer like mins or hours or so, which means they’re not late, just my opinion :/
now this is a black MIDI conversion done CORRECTLY
Holy shit, this is the best one yet oh my god even the voice is perfect
I was expecting a piano cover... not the actual lyrics too! Great video!
This is so wired I can straight up hear the voice clearly
Me: Yo, pass the AUX cord.
Friend: You better not play trash...
Me: *plays this*
I've never heard this audio illusion so clear before holy shit.
i listened to this at around one in the morning last night thinking this was amazing but now i'm back and only down realizing that this sounds like it was despacito recorded on the world's oldest android phone
i can hear the vocals that clear that it sounds to me like the original version with a bit of weird autotune in it. Im being honest
If you can hear voices clearly it means they use way to much auto tune (you can hear the voices clearly)
Everybody gangsta until the piano starts singing despacito.
Piano: A Y Y
Everybody: hol’ up
good one lol
It was so good that a guy named Luis Fonsi copied the song!
Its so accurate i might actually think its fake
The piano very clearly said despacito
I always think it’s sooo cool when people do this
Oh wow, I’ve never been able to hear it this clearly before in any, and I’ve barely heard any of this song before
listening to the radio back then be like:
the water sound effects sounds very realistic
This sounds like the music that home phones play when you are put on hold
I didn't know you still posted videos :D
When your mom asks you to play despacito:
This was inevitable, and bloody brilliant.
o wow ive never even heard this song sung befor(ive only heard the music) that is a great job making the voices
I from now on will listen to all my music in black midi.
Finally a new version of Despacito, I was getting tired of hearing it over and over.
Luis Fonsi is trying to speak to us through this demonic piano
NOW I'VE HEARD SOME IMPRESSIVE MP3s CONVERTED TO MIDI'S BUT THIS TAKES THE TOP FOR IT ACTUALLY IMITATING THE LYRICS SO CLEARLY TO WHERE I CAN ACTUALLY HEAR THEM WITHOUT HAVING TO MEMORIZE THEM. HONESTLY IMPRESSED.
Everybody gangsta till the piano moans
Wtf. I can hear the voices perfectly and I’ve never heard this song in my life
you can just hear his voice, all distorted and shaky, as if he's trying to escape the barriers of this simple little piano app.
The more notes are player
The more accurate are the lyrics gonna be
No surprise for me
This is essentially:
Despacito With Low Quality Voices, But I Did Not Drop The File.
now do despacito 2
no
Yesn't
Sounds like really bad compression or static through the original file. It’s amazing! Ima try downloading the program to play around for myself.
It even captures their breath sounds.
How did you do this? I feel like converting a song to black midi and somehow making it this sharp requires the sacrifice of an infant and 3 goats