See invisible motion, hear silent sounds. Cool? Creepy? We can't decide | Michael Rubinstein

Поделиться
HTML-код
  • Опубликовано: 22 дек 2014
  • Meet the “motion microscope,” a video-processing tool that plays up tiny changes in motion and color impossible to see with the naked eye. Video researcher Michael Rubinstein plays us clip after jaw-dropping clip showing how this tech can track an individual’s pulse and heartbeat simply from a piece of footage. Watch him recreate a conversation by amplifying the movements from sound waves bouncing off a bag of chips. The wow-inspiring and sinister applications of this tech you have to see to believe.
    TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and much more.
    Find closed captions and translated subtitles in many languages at www.ted.com/translate
    Follow TED news on Twitter: / tednews
    Like TED on Facebook: / ted
    Subscribe to our channel: / tedtalksdirector
  • НаукаНаука

Комментарии • 255

  • @lisaboulton2887
    @lisaboulton2887 9 лет назад +38

    It would be interesting to see if magnifying the image of people in comas might lead to finding signs that indicate the patient is actually still "in there" somewhere.

    • @warpspeed8305
      @warpspeed8305 4 года назад +5

      fMRI or BCI. With BCI it's even possible to communicate with patient. There was some video on this subject.

  • @DEO777
    @DEO777 9 лет назад +86

    If this technology was available in the 80s and 90s, we could have detected that Milli Vanilli was lip syncing and saved the people from buying their albums.

    • @MrVinceq
      @MrVinceq 9 лет назад +11

      Lol, it scarred you deeply ?

    • @DEO777
      @DEO777 9 лет назад +5

      David Munoz Milli Vanilli did more than just lip sync, they never sung the songs ever.

    • @codebeat4192
      @codebeat4192 6 лет назад

      Haha, good one! bullseye! haha.

    • @EnriqueHJ
      @EnriqueHJ 3 года назад

      Jahahaha

  • @MuadDib1402
    @MuadDib1402 9 лет назад +5

    This kind of thing is the reason we watch TED talks. Amazing.

  • @MedEighty
    @MedEighty 9 лет назад +1

    I saw the talk about this a year or two ago and I was very impressed. Now I'm impressed all over again.

  • @E-99x
    @E-99x 4 года назад +2

    This will be ground breaking for solving crimes that were committed where surveliance recorded situations regarding murder, rapes, and abduction where the camera had no sound.

    • @xponen
      @xponen 2 года назад +1

      it cannot be used with camera that don't have HD and high-speed/high-frame-rate function, so it cannot be used for old surveillance footage.

  • @elloboblanco9111
    @elloboblanco9111 9 лет назад +2

    WOW! I'm blown away with this... the speech recognition from objects is awesome! Technology really is becoming incredible.

  • @mamundavidebneahameddornse7407
    @mamundavidebneahameddornse7407 9 лет назад

    This is brilliant use of creativity! Hats off to the team that made this possible! (y)

  • @yurikolovsky
    @yurikolovsky 9 лет назад

    Amazing!!!!!! Best TED talk in a while!

  • @Deusmecumest
    @Deusmecumest 9 лет назад

    Wow, Wow, Bravo. What an amazing breakthrough. What a amazing limitless application of science.

  • @codebeat4192
    @codebeat4192 6 лет назад +2

    In one word: Speechless.
    Amazing. Mind Blowing.

  • @Kaizerg
    @Kaizerg 9 лет назад +17

    Note to self: Don't talk about important things in a room with empty chips bags laying around...

    • @warpspeed8305
      @warpspeed8305 4 года назад +2

      If subvocal recognition works with video -- note - don't talk to yourself :-) even if you don't open mouth.

    • @brentfisher902
      @brentfisher902 4 года назад +1

      If you tell about an important gory political event, it might never be able to happen. Loose lips sink ships.

  • @FranktheDachshund
    @FranktheDachshund 2 года назад

    Recovering sound from video is just amazing.

  • @luis96xd
    @luis96xd 5 лет назад +1

    Wow, this technology is so amazing! Thanks for this video!

  • @tarassu
    @tarassu 9 лет назад +2

    That same sound extraction technique was used in science fiction movie "Eagle Eye". I was pretty sure that extracting sound from vibrating water in glass was somehow even possible. Now I see the result.

  • @nubeslocas
    @nubeslocas 9 лет назад

    Best idea I've seen in years!!! Awesome!

  • @sandrisaug
    @sandrisaug 3 года назад +2

    To recover a sound from video you need to take that video with hi-speed cameras with frame rate at least 12000 hz.

  • @RSP13
    @RSP13 9 лет назад +2

    Talks like that make me love TED

  • @amortalbeing
    @amortalbeing 3 года назад

    Magnificent work. loved it

  • @fidelio1991
    @fidelio1991 9 лет назад +38

    Science gets more and more stunning. I dream of incredible possibillities in 100 years and on...

    • @MedEighty
      @MedEighty 9 лет назад +14

      This isn't science. It's engineering. As in, the application of science. There's no new science here. It's an application of known science in inventing new and impressive technology.

    • @matbroomfield
      @matbroomfield 9 лет назад +4

      I think that George Orwell's vision of the future will not be a fraction as bad as the real future.

    • @5to22a
      @5to22a 9 лет назад +1

      Mat Broomfield
      Unless we get rid of the state, then things will be awesome.

    • @fidelio1991
      @fidelio1991 9 лет назад

      MedEighty
      Doesn't really matter... i mean every aspect of progress happening in these days. It's a real pleasure for me to be part of an age, where humans once may be able to fight cancer or other dieseases and fly to other planets and settle down... that's what I'm talking about. Nobody would have thought this to be possible 60 years ago.

    • @fidelio1991
      @fidelio1991 9 лет назад +2

      becool365
      -.- It's clear to me, that most of the things have been thought about way earlier, but the speed with which inventions are made, is admireable... Dreams are no longer just dreamed but made or will be made possible to become reality (sorry for mistakes - I'm not a native speaker)

  • @HangOn2seconds
    @HangOn2seconds 9 лет назад

    This is amazing!!! I wonder if the video has to be hd quality?

  • @olliloco
    @olliloco 9 лет назад

    Thanks for sharing.. And darn good work.. :-)

  • @FELICIENRo
    @FELICIENRo 9 лет назад +1

    BRAVO and thank you.

  • @Chronomatrix
    @Chronomatrix 9 лет назад +5

    Mind blown, this is incredible.

  • @rickysukhi
    @rickysukhi 9 лет назад

    so fascinating !

  • @MarkKislich
    @MarkKislich 9 лет назад

    Very HIGHLY interesting..
    Shared left right and center.

  • @Bluemoondm1
    @Bluemoondm1 9 лет назад +20

    Pretty incredible. Will make people even more paranoid though (maybe rightly so?)

    • @MedEighty
      @MedEighty 9 лет назад +8

      Shhh! Close the blinds. Someone might be listening. :D

    • @shadowx089
      @shadowx089 9 лет назад +7

      MedEighty The vibration from the blinds would be the speaker.

    • @Bluemoondm1
      @Bluemoondm1 9 лет назад +3

      Given the right light, the window itself would probably be an amazing speaker

    • @MedEighty
      @MedEighty 9 лет назад +2

      shadowx089 You're right. Bluemoondm1, if you want to say something, just text it or send it by brain waves.

  • @kulovsky1
    @kulovsky1 9 лет назад

    This is so awesome!!!!!!

  • @BEPrimAnim
    @BEPrimAnim 9 лет назад +1

    This gives me an idea of a microphone made of some material super sensitive to motion, so it can record the sound in nearly perfect quality. This is like something from a sci-fi movie!

  • @Anakele20
    @Anakele20 9 лет назад

    I'm in awe. This is so incredible. I'm just stunned at the brilliance...between this and sending signals via lasers...this is an exciting time to be alive.

  • @heyolast4464
    @heyolast4464 9 лет назад

    Amazing!!! just WOW!

  • @katiekawaii
    @katiekawaii 9 лет назад

    Incredible. Absolutely incredible.

  • @acekel7040
    @acekel7040 9 лет назад +1

    Awesome video just one question how would this technology work in environments such as outdoors. For example does wind obscure an objects reaction or light may be modified by angles of sunlight?

  • @TheLazyKey
    @TheLazyKey 9 лет назад

    I'm gana have to try this out...

  • @DmitryShevkoplyas
    @DmitryShevkoplyas 2 года назад

    Brilliant!

  • @ShaiBarack
    @ShaiBarack 9 лет назад

    Fantastic!

  • @AaronHendu
    @AaronHendu 3 месяца назад

    I have been messing with increasing color saturation in my photography to extreme levels, revealing a the full spectrum of intense coulor hidden behind the neutral exposure of our vision. Even a bland nearly gray scale scene is full of color variation and intensity. It is quite unteresting to wonder how other eye systems are able to interpret the same scenes.

  • @AlexDings
    @AlexDings 9 лет назад +1

    I haven't seen anything this brilliant AND this creepy in a long time. One should be very careful in saying that something will change our world, but I think that's quite possible to happen here.

  • @wyrwshwsrey463y
    @wyrwshwsrey463y 9 лет назад

    thats absolutely brilliant- science is so awesome

  • @IdioticPlatypus
    @IdioticPlatypus 9 лет назад +4

    i bet if we pointed this at stars and star systems, we can enhance how much they wobble so we can see which ones have planets without having to watch them for months.

  • @Telleryn
    @Telleryn 9 лет назад

    Wish they'd provide some relevant links in the description

  • @saxyboyraw
    @saxyboyraw 9 лет назад

    this is huge. it basically gives everyone a sixth sense worth of information on everything ever video recorded.

  • @AtamMardes
    @AtamMardes 9 лет назад

    Interesting. Laser devices already exist that convert vibrations from a window into audible sound. The video sound detection and laser sound detection can be utilized depending on conditions. The laser detection system can be used to detect sound from the window where windows are covered by a curtain where video cannot see the potato chips bag. The video sound detection system can also be used to detect sound out of curtain vibrations.

  • @jhe9521
    @jhe9521 Год назад

    would've been cool to see HOW crisp packet movement was translated to sound ~ all else was explained wonderfully, but on that we had to take a leap of faith...

  • @potemkin505
    @potemkin505 9 лет назад

    Best Ted Talk I've seen

  • @sidneyhart6221
    @sidneyhart6221 9 лет назад

    Thanks science dudes. This is truly awsome tool.

  • @sallysassa
    @sallysassa 9 лет назад

    That's brilliant. I see many applications. Just wondering if Steve has a tooth issue lower left jaw at 1:31.

  • @mastereymaster8180
    @mastereymaster8180 4 года назад

    Amazing technology wow

  • @3dsman
    @3dsman 9 лет назад

    Very cool!!

  • @joshjeggs
    @joshjeggs 9 лет назад +1

    most of the sound clips were unintelligible if you didn't know the original clip. but this is still stunning Would love to go back to those scilent black and white videos and recover some remarkable insights.

  • @buddy77587
    @buddy77587 9 лет назад

    Fabulous!

  • @JackassJimbo
    @JackassJimbo 9 лет назад +15

    This is amazing, cant wait to see what this will develop into! I really wish I could live several hundred years sometimes just to experience what the future will be like :/ Hurry up science, I dont have forever you know!

    • @v-22
      @v-22 8 лет назад +3

      Just so you know, if you live for the next 50 years, you will have forever.

    • @nikkibridgewater4223
      @nikkibridgewater4223 2 года назад

      Well you dont have to long none of us do hope your right with jesus christ everyone needs to repent if they didnt already

    • @eeyoresbutt3747
      @eeyoresbutt3747 2 года назад

      @@v-22 Explain your statement please.

    • @v-22
      @v-22 2 года назад +1

      @@eeyoresbutt3747 In 50 years, things will have progressed to the point where we should have achieved immortality. Life expectancy is going to increase exponentially, until it reaches infinitum, death will be optional. Printed organs, nano bots, crspr, being uploaded to some virtual reality, this is just the beginning.

  • @250108
    @250108 9 лет назад

    This is totally amazing.

  • @vaibhavshoran
    @vaibhavshoran 7 лет назад

    amazing!

  • @madmark458
    @madmark458 9 лет назад

    Super amazing you might be able to get back your relatives speeches as well. amazing

  • @YosuaSimanjuntak
    @YosuaSimanjuntak 9 лет назад

    This is waaaaay tooooo coooool!!!

  • @Kris_A
    @Kris_A 9 лет назад +11

    This is all very awesome, it really is; in trustworthy hands.
    But in the future... when those armed robotic drones are hunting you down for a parking violation or stealing a can of beans to feed your starving family, and you hold your arms up and go *shhhhhhh!!!!* And in a quiet whispering voice you tell everyone to "stay as still... and as *quiet* as you can"...
    ...The machines will see your slightest movement.
    The machines will tell that you aren't *reeeeaally dead* as you fake it on the ground.
    They will magnify your every sound, and can see you piss your trousers at a mile away..
    The machines will see all, and you will not escape.
    Or something like that.
    If that doesn't frighten your pants off, I don't know what will. :)
    Sidenote: I keep making these quips about this kind of thing, and non of them are actually funny because of the cold and unfortunate reality opening up before our very eyes. There are some great robot killer terminator film concepts in there though :P

  • @ybefutile
    @ybefutile 9 лет назад

    Amazing.

  • @nikhilkumarm7445
    @nikhilkumarm7445 9 лет назад

    Awesome ...

  • @HangOn2seconds
    @HangOn2seconds 9 лет назад +1

    Where is the link TED?

  • @ShoaibKhan
    @ShoaibKhan 9 лет назад +1

    Reminds me of the movie "Eagle Eye" where an super smart AI 'listens' to a secret meeting by just observing the sound waves produced in a glass of water placed on a table.

  • @Infertilityandmepodcast
    @Infertilityandmepodcast 9 лет назад

    Amazing

  • @bruney6
    @bruney6 9 лет назад +1

    Wow!! So cool, do you think the NFL could use this to watch players before the ball snaps to uncover what is the likely play they will play based on their micro actions?! :)

  • @ICOD73
    @ICOD73 9 лет назад

    8:59 that girl looked too amazed

  • @rorychin8670
    @rorychin8670 4 года назад

    Amazing technology! Out of curiosity, has anyone used this on supposed paranormal entities captured on video?

  • @Dishmab
    @Dishmab 9 лет назад +2

    This is really fucking amazing

  • @Mink0twink
    @Mink0twink 9 лет назад +3

    I want this tech in realtime goggles, oh the possibilities.....! lol

    • @warpspeed8305
      @warpspeed8305 4 года назад

      lie detector built inside google glass or something similar.

  • @sam-zy2dn
    @sam-zy2dn 4 года назад

    I wonder how the filter setting are selected to reduce the noises. Also what are the nature noises that he speaks about . Is it like noises due to movement of camera or what?

  • @JohnBastardSnow
    @JohnBastardSnow 9 лет назад +1

    This is extremely impressive. I've heard of people using infrared cameras as a remote lie detector to assist capturing facial micro-expressions (Paul Ekman aka Lie To Me style). And that was YEARS ago. In the future, an average Joe will be able to gaze into your soul. They will see your involuntary muscle micro-reflexes. They will know your pulse, your breathing rate, perspiration. With the addition of molecule sensors, they will be able to perceive your biological processes; imagine small amounts of molecules smelling as distinct as an onion breath or as hydrogen sulfide. I think that interesting social patterns can arise, when your body will give more honest signals than your words or appearance; and when you can perceive so much more.

  • @avedic
    @avedic 9 лет назад

    Sometimes I'm so happy to be alive now. We don't realize just how lucky we all are to be born at a time where we get to come of age....the same time the human race is exponentially coming of age. We get to live during the elbow of that curve....the _most_ exciting time. Also the most potentially frightening and stressful time. Lots of challenges ahead. But, human's innate desire to learn, connect, create, and dream is what gives me my sense of long-term optimism & hope.

  • @rogue_spirit
    @rogue_spirit 7 лет назад

    The second part about sound is the same principle in the movie Eagle Eye when the computer records the Defence secretary discussion from the vibrations in his cup of coffee :)

  • @uub249
    @uub249 2 года назад

    amazing technology..

  • @ihategoogle2382
    @ihategoogle2382 9 лет назад

    This reminds me of an episode of Fringe. Gosh I miss that show!!

  • @Mastikator
    @Mastikator 9 лет назад

    This is beyond science fiction!

  • @venusmarina
    @venusmarina 9 лет назад

    Super!

  • @woobiesftw
    @woobiesftw 9 лет назад +2

    I imagine this is how fictional cyborgs like Seven of Nine and RoboCop monitors another character's heart rate and stuff.
    If they turn this technology on every piece of silent historical footage, we might learn some very interesting and shocking things.

  • @IreneEnriquez
    @IreneEnriquez 9 лет назад

    Cal Lightman would love this technology. :D

  • @MaxLohMusic
    @MaxLohMusic 8 лет назад +1

    12:40 mind = blown

  • @steffahn
    @steffahn 9 лет назад

    I would like seeing actors playing dead bodies breathing, moving slightly or showing pulse.

  • @christophhenninger6440
    @christophhenninger6440 9 лет назад

    My first thought about the audio-thing was: Hey, we could use it to see what those referees are talking to the players.

  • @RunescapeGod
    @RunescapeGod 9 лет назад

    All I know is that with this technology those "ghost hunter" shows will be permanently put to rest or will become very big.

  • @itsjustmedanny
    @itsjustmedanny 9 лет назад

    The possible applications will lead to incredible discoveries! Paranormal activity anyone?

  • @religiondestroyer
    @religiondestroyer 9 лет назад

    wow!

  • @Cars701
    @Cars701 2 года назад

    Skynet will love this. Thanks

  • @TheHellz0r
    @TheHellz0r 9 лет назад

    This is amazing......but I see it becoming very sinister, very quickly loooooooooll

  • @nikhilpghag
    @nikhilpghag 9 лет назад

    Wow. Sheer Briliance.

  • @alekseyalexej9665
    @alekseyalexej9665 3 года назад

    Where can I get software to enhance the visibility of motion in the frame? (required to solve technical problems)

  • @jamesdonaghy6758
    @jamesdonaghy6758 4 года назад +4

    Bet the 3 letter agencies LOVE this ; )

  • @mardoksan
    @mardoksan 9 лет назад

    Ход мысли разработчиков впечатляет! Далеко пойдут!!!

  • @misbahashraf961
    @misbahashraf961 3 года назад

    Plz describe how image processing can b used in silent sound technology
    ?

  • @knolly57
    @knolly57 9 лет назад

    Listen in on the people in the Space Station just by pointing a telescopic camera and hear them talking - without the need for radio.I suppose to make it 2 way, the Space Station crew would need a camera of their own - so Hasselblads are out.

  • @sentmode
    @sentmode 7 лет назад

    Use this camera and video tape those moving relics in Egypt.

  • @truedeadandlife
    @truedeadandlife 9 лет назад

    Omg. The world has changed, biggest innovation since THis!

  • @Mike165987
    @Mike165987 9 лет назад

    what kind of video quality is needed in order to extract the information needed for this software? Do they all have to be high FPS films?

  • @Chineseguy001
    @Chineseguy001 9 лет назад

    Is there a VLC plugin?

  • @pocketmarrow
    @pocketmarrow 9 лет назад

    I see so many applications in animation.

  • @kingofmaiars
    @kingofmaiars 9 лет назад

    Oh boy. "Samaritan" will definitely want a piece of this technology.
    I see this advancement implemented to the story of POI.

    • @pseudonym4893
      @pseudonym4893 9 лет назад

      I think it has already been used in POI by The Machine in earlier episodes. I also saw it in the movie Eagle Eye and thought it was total bullshit, but boy was I wrong.

  • @fudanchu8436
    @fudanchu8436 9 лет назад +1

    Wow, covert operations will *love* this tech - if they don't have it already.

    • @kessu83
      @kessu83 2 года назад

      since the 70s they can even read your PC screen with just an antenna on another room.

  • @breaneainn
    @breaneainn 9 лет назад

    You could process scenes in movies and recover the directors cues and instructions.

  • @Skandar0007
    @Skandar0007 9 лет назад

    I've seen it, like 1 or 2 years ago

  • @battleax9789
    @battleax9789 9 лет назад

    I'd like to see this done on someone strength training or an mma fight or a car accident.