Speaking Piano - Now with (somewhat decent) captions!
HTML-код
- Опубликовано: 27 сен 2024
- A "speaking piano" reciting the Proclamation of the European Environmental Criminal Court at World Venice Forum 2009. Unfortunately it's all in German, but what the piano says is all English, and it's really neat to watch.
UPDATE: Astera on hackaday wrote a rough translation:
Pretty amazing, how all of a sudden the words of the Declaration become understandable to a European Environmental Criminal Court. Wien Modern was one out of ten cultural institutions asked for an artistic contribution to the event in Palazzo Ducale in Venice.
The ambitious goal was to make this message audible with musical means, without falling back to a simple setting.
Berno Polzer: I think, its partially understandable, partially not. And it plays well with the limits of our construction abilities. That is, we hear sounds that obviously arent normal Music, but neither they are language, and one could say that sometimes, a bridging happens. Personally, I think you can understand individual words even without knowing the text, and the Eureka moment happens when you see the text, and suddenly, the language is there.
Yet another bridge: Miro Markus, an elementary school student from Berlin, narrated the text for the performance: Youth as a hope for the older generation.
The Austrian composer Peter Ablinger transferred the frequency spectrom of the childs voice to his computer controlled mechanical piano.
Peter Ablinger: I break down this phonography, meaning a recording of something the voice, in this case -, in individual pixels, one can say. And if I have the possibility of a rendering in a fairly high resolution (and that I only get with a mechanical piano), then I in fact restore some kind of continuity. Therefore, with a little practice, or help or subtitling, we actually can hear a human voice in a piano sound.
Make it do the entire bee movie script.
Paco158 YES
WHAT IS THAT MEME AND WHY THE FUCK IS IT IN MY RECOMMENDED VIDEOS???
Paco158 "You like jazz?"
make it restart every time it says bee
lol
I'm sorry Dave. I'm afraid I can't play that.
im gettin mp3 to midi converter flashbacks
Oh boy I can't wait to hear Skrillex on piano!
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
For real
Dude you have no idea!! The pain!!! AAAhhhh!!
Cant wait to listen to riddim on piano
mario
One of these days, somebody should make a ghost movie that has the ghost communicating through a piano in this manner. That would be creepy.
Tekrothebountyhunter I'm working on concertion of voices to midi sounds and i wanna be a director so... maybe wait and see
Tekrothebountyhunter Or use it as the voice of a collective consciousness.
+Dominic Sosa That would be cool too.
Tekrothebountyhunter I'm working on it fam
Tekrothebountyhunter would still be better than the Super Mario 64 piano. *shudders*
since they are basically replicating the recorded wave using Fourier series, they could theoretically get it to sound like a violin, or anything weird and un piano like (within the limits of the machinery involved)
99% sure this is what is going on. They are quantizing the Fourier spectrum to the keys on the piano to get this sound.
For those who don't know what Fourier is: basically we can extract frequencies from an input, any input, and represent that input as a collective sum of those frequencies. Source: EE student.
Anyone have a sample MIDI file? An URL for downloading a .mid file would be great.
@@johnspataro1675 Interesting. So in your professional opinion, is mayonnaise an instrument?
@@davidvivsik6576 ruclips.net/video/A5jnftBQw2U/видео.html
instead of sine waves they are using something like a damped saw wave as a basis function, which is basically what a piano note is.
I For One Welcome Our New Piano Overlords
EX-TER-MINATE
NICE comment xD Made my night.
Why is everyone shitting on this? It's awesome.
TrackpadProductions it's nightmare fuel.
It would be scary if it just started happening, like you have a piano in your house and it started talking to you, but not when it is specifically planned to do it using motors and stuff.
who’s shitting on this? i’m only seeing praise
@@brumm0m3ntum94 I wrote this 6 years ago, dude, idk
@@TrackpadProductions wassu bro?
what is my purpose?
you pass butter.
oh my god.
yeah welcome to the club pal
*oh
my
god
you must be an intellectual
🌞R&M
Yeah but does it feel like I do?
It's lifeless inside, just like you.
Do ya, do ya, do ya?
yup. reddits been here
We now witness the living MIDI
we should record this and send into outer space.
The aliens will be so impressed with us.
+Richard lol
The aliens will be spooked away.
And get the aliens angry. Or terrified.
crasheit maybe just throw the piano into outer space
Nooo this isnt creepy at all
Creepiest voice ever ... would make a great horror movie
Othmane Tamri Yeah! Lets have a horror movie of a haunted piano that speaks in a most horrifying way.
Yes.
@0:07"I'm f*cking them"
Wut
She says: „einfach ändern“.
And I oop
Lol but just be rude to the language he was taught since birth
@@derdan7183 *He
i would have lost it if it said EXTERMINATE
I FOUND YOU, FELLOW WHOVIAN- 7 YEARS LATER, BUT I FOUND YOU
The fricatives are formed by a combination of the percussive action of the piano hammers on the strings and "tone clusters" (multiple adjacent diatonic notes) at the top of the piano range. The vowel sounds are created by controlling and modulating the amplitude of the "fundamental" pitch's overtones.
This is a very good demonstration of how a cochlear implant user hears maybe at beginning. The brain is learning to unterstand this and steadying the sound. I can say now, it sounds naturally...
tabs?
2:05
You made my day :D
FUCKING 2:05 FUCKING 2:05 FUCK
This is unsettling.
Thanks to the Chinese bootlegers who made this available for everyone
Make it do Scatman.
Unintentionally terrifying. O.O
Not too many people will appreciate how freaking amazing this is. But then, it seems like he may have been cheating -- I don't think the highest note on the piano can get those harmonics. Would have been better to use a male adult voice.
+Mark Rosenblitt-Janssen Maybe, considering the "sh" and "s" sounds. Those are too random to have a proper tone.
+za909returns The "sh" and "s" can be obtained too. You just need to mix many different frequencies together (hit a whole lot of keys at once). You can even obtain a "click" this way, by hitting all the keys at once. Then all these waveforms will be in sync only in this particular moment and reinforce each other, and cancel each other out in every other moment. (Discounting for the fact that the frequency scale of the piano isn't continuous, you would get just a noise instead of a click, but you get the idea.)
This "speaking piano" works based on the principle of Fourier synthesis which says that every periodic signal whatsoever can be obtained by mixing together monotonic sounds (single notes) with different amplitudes. If you can decompose the signal into a set of "channels", each of a different pitch, you can then use this "spectrogram" on a piano keyboard to reproduce the original sound.
Thanks, I didn't need sleep anyways
I'm on that fucking terrifying part of RUclips again.
Travis McBee How does this always happen? I don't even remember how I got here
This is amazing... And like Kudjo said, while we figure out actual uses for this technology, we have literally broken new ground for what is possible with sound effects. Like he was saying, this would be an absolutely incredible and creepy AI voice for a character in a movie!
We shoud make it sing never going to give you up...
your wish has come true ruclips.net/video/kIuGo2pay5w/видео.html
This has taken amazing to a whole new level!
12 years later finally in my recommendations
Gives me decopunk/steampunk vibes, I can imagine some sort of evil sentient computer communicating using this instead of a speech syntheziser
Now... If your piano does that without being hooked up to anything... You should run away from it...
the striking of the hammers on the strings and the fading of the volume creates the auditory "illusion" of fricative consonants. the tones and pitches create the rest.
I FUCKING KNEW THIS WAS POSSIBLE, I FUCKING KNEW IT
So Akira Otoishi's talking guitar is possible
Kesia G. Oliveira I came here from Jojo
This is the basis for a steampunk robot voxbox.
In 30 or so years, pianos will take over. °-°
I've never heard anything like this! Amazing.
This is really fucking cool
Richard D. James probably owns 4 of these
He used to but they upset the robot monkeys too much.
that's the coolest thing i've seen in a while.
this was posted when i was one.
amazing.
is there any more of this speaking piano somewhere?
ruclips.net/video/uBEL3YVzMwk/видео.html
The problem is that they chose a kid that can't speak proper english.
Because that's what makes it hard to understand...
0:40 Voice crack lmao
It's just puberty. Don't make fun of it.
I, for one, welcome our new talking piano overlords.
Wow thats pretty spectacular.
"And we proclaim that another world is possible."
Yes. Another world wherein pianos tune us to their liking and tickle our ivory.
Imagine if you saw this one day, doing it all on its own...
Can I take your order? Thank you, sir!
We declare that,
We are all
Responsible.
i have never been more creeped out by pianos
Beautiful, and a little chilling too!
Another world IS possible!
Thanks for sharing this amazing video
Cheers John
insanely high notes played very rapidly
And another I found:
"Until the mid-18th century electricity was little more than a parlor trick used to delight kings and amaze crowds. One such itinerant “electrician” aroused Benjamin Franklin’s curiosity, and he embarked on a series of experiments that would “snatch lightning from the sky,” opening up the new field of electrical science and ultimately making possible all of the electrical conveniences on which we depend today."
This is the piano alone. He analyzed the overtone spectre from they boy's reading, and replicated it on a piano. Quite a clever idea actually.
The Piano does not like to be interrupted.
The Piano will have its revenge.
"I'm watching you undress"
And just today i found a clip of the GameCube-Startup-Sound doing the same with the Vsauce-Intro. Our society has come a long way since then...
Someone black midi'd an actual piano
What a time to be alive
Someone tag midi makers here, maybe they'll take it as a challenge
yes, its the actual sound from the piano we are hearing - very clever!
I like how there's a foreign speaker TALKING OVER NEARLY THE WHOLE THING.
Really good job there editors.
There's GOT to be a version of this without some German lady hollering over it
The English language rules.
It does, doesn't it?
Well, a German created this, the kid is German...
But he programmed it to speak English
counter council it was created for a European climate meeting. english is the lingua franca, its the language you communicate on international meetings
Rare to see a young german boy speaking English that well.
i'm actually learning how to do this and it opens up so much possibilities for sound design ! so sick. obviously i'll use it with synths and not a real piano.
This is very cool!
This is crazy... Really cool but I am surprised it hasn't been done quite a bit.
If you listen without looking, it makes no sense. Then go back and read, and you will hear it. But, at least for me, once I've heard it, I can understand the same words again later without the text.
Best Application
"Close Encounters of the Third Kind"
This is SICK!
This is un settling
They’re becoming self aware
Briefly, a voice spectrograph has been recreated by piano.
Oh yes! That would be awesome.
It would have to be pulled from the sequencer the guy showed (it looked like it maybe could be exported as midi). Essentially, the engineer took the sound and "pixellated" it to our equal temperament tuning system, and exported that data to a processor that then told the piano how to render the information. It wouldn't be too hard to get sheet music from there, especially if they're using MIDI as the language. The question would be how useful the sheetmusic would be metrically.
Very exciting.
FTW: the composer fed this into Melodyne and then exported the polyphonic midi file which he slightly tweaked using his own ear and then plays that back in his sequencer through his disklavier
"dude, the piano is talking to me about the enviroment"
This is so freaking awesome! Glad my EE120 professor showed us this link.
Allright, I tried my best to match up Astera's translation with the speech to make some subtitles. I got kinda lazy around half way, but the subtitles are there.
"Let there be light."
my mind is blown.
Ned! They're comin' right for us!
DUDEEEEE Imagine if someone could play the piano and make it talk like that. That would be great.
Imagine that thing inthe dark in your living room
How the hell does this only have 2million views?
This is simply amazing! :D
Lo más asombro que he visto
"We declare that we are all responsible"
Hey but...
"WE ARE ALL RESPONSIBLE"
"WE ARE ALL RESPONSIBLE"
And your ears start to bleed and "WE ARE ALL RESPONSIBLE"
And then you die and you hear "WE ARE ALL RESPONSIBLE" for the rest of eternity.
I still don't get why they didn't get a kid that speaks decent English in the first place. Makes it more impressive
This is extraordinary!
This is in theory a modernized Vorsetzer (a keytop device to play a piano invented around the turn of the century prior to the internal mechanized player piano). It is remarkable to hear with this modern technology and solenoids the human voice through the piano. But I still bet it would play a great performance of a player piano roll MIDI :)
Its like the voice of a collective consciousness. Like the Borg.
Close your eyes,... the words on the screen force you to hear it within the sound
In the future I want a talking piano that will greet me and my family when we come home. "HhHEeEELllLlloooo."
"We are all reshponshible..."
So we have Yanny or Laurel, and a few other minor similar sound illusions. The talking piano needs to one day be as popular.
i 've never seen it before, even thought.
thanks for sharing/
This makes me think of the Machine diplomat from the end of the first half of the Second Renaissance short in the Animatrix.
Sparky knows a thing or two about these