Это видео недоступно.
Сожалеем об этом.
MIT Computer Program Reveals Invisible Motion in Video | The New York Times
HTML-код
- Опубликовано: 12 авг 2024
- Finding the Visible in the Invisible: A team of scientists at the Massachusetts Institute of Technology (M.I.T.) has developed a computer program that reveals colors and motions in video that are otherwise invisible to the naked eye.
Related article: nyti.ms/Vab8Kl
Subscribe on RUclips: bit.ly/U8Ys7n
Watch more videos at: nytimes.com/video
---------------------------------------------------------------
Want more from The New York Times?
Twitter: / nytvideo
Facebook: / nytimes
Google+: plus.google.com/+nytimes/
Whether it's reporting on conflicts abroad and political divisions at home, or covering the latest style trends and scientific developments, New York Times video journalists provide a revealing and unforgettable view of the world. It's all the news that's fit to watch. On RUclips.
MIT Computer Program Reveals Invisible Motion in Video | The New York Times
/ thenewyorktimes
"Maybe if we took a photo of Steve without his shirt on..." extremely long pause.
They are using Matlab based on the code they published on their website and they make use of pyramid image processing from a Matlab/C library called matlabPyrTools. The OpenCV library provides some similar functions.
Proof that even simple ideas can be absolutely brilliant!
It's awesome that they made the code open source.
adrian5b MIT always almost open sources their projects. That's why I love them as a programmer.
The problem with the software is that you need to set the frequency you are looking for before you apply the filter to the video. For example you need to set the frequency to 1Hz (~60 beats per minute) to see an adult heartbeat. If you want to see a babies heartbeat you need to set it to 2Hz (~120 beats per minute). Therefore you couldnt really use it to see your heartbeat change before and after exercise without manually changing the frequency.
This is amazing. You can detect the frequencies of vibration in solid bodies with this!
"Citizen, show me your identification."
"Hold on a second..."
"Citizen, I'm getting a high rate of pulse and an increased sweating warning. Please put your hands up and face the wall."
listen i couldve done nothing wrong and if the police came up to me and said show me your identification and imma still get nervous ;u;
thanks for clarifying.
This is absolutely amazing. I love clever, creative people.
Great work....
This is really neat. I can see how some people may worry though about false narratives that may give false impressions. Like if someone's being interrogated, they may be nervous someone will think they are lying when they're not, they may be actually lying, they may just think the interrogators hot...multiple factors that don't necessarily point to guilt. So many better thought out applications less primitive surely, great job overall! I had wondered how to turn a monitor into camera or mic based on the fps/EM distortions, a variant of this may help.
You're on to something there! This could be awesome when applied to astronomy!
Nothing new under the sun!
Thanks. I would expect the NY Times to include this in the video description also. But I guess they were just too busy including a ton of links to their other content elsewhere that they couldn't focus too much on the video itself.
This sounds awesome and I was first kinda skeptical that this was too good to be true. The pulsing man felt strange and more like a cool effect, but the video of the baby and the EKG is pretty surprising. The other subtle motions though look pretty amazing, almost like a cinemagraph GIF. The source code released free is cool for people to try out, I hope to see what can be made along with more of this new technology in action.
So simple, so profound. These guys are heroes.
Right. It's a colour variation to show movement (a larger shape takes up so many pixels but the edges of that shape change colour when moving) or to show colour changes in themselves (pulse). Once that's noted, they exaggerate the changes and movements or colours change more and you see them better.
Very simple and innovative. thx
the snippet of video showing the exaggerated eye movement really reminds me of the voit kampf test
This is fantastic, I would love to see a speeded up video of plants with this technology applied to it!
Win of the day, thanks
Incredible!
Interesting new findings will be discovered using this method.
Switching from chaining simularities to differences, compare into contrast shows what has already been there.
There will still be slight movements in one's body due to the heart pumping that may be detectable on certain parts of their body. Although I'm sure such detection would require higher quality/bandwidth video and optimal conditions (stationary person)...there must be a better use for this though...
hey you shaked smartly, congratulations
Thanks. I'll try to compile and run it myself. This thing, on first observation, looks pretty damn cool.
Mind blown!
It's all neat in the video but i bet it requires hard work to master it so it works under various lightning, video cameras, stability of video etc.
Not exactly open source - it's only for non-commercial purposes. But it's still exactly how science should be - open to the public, and to other innovative people to work on.
Same thought here. The applications are boundless.
The breathing baby (and the eyeball clip too) was motion-amplified instead of colour-amplified like the faces.
This is a brilliant application of image processing!!!
I guess this would work in reverse, letting you dampen signals, you could treat large crowds as a field of particles, constrain individual motion to extract information about attractors and to see information rippling through the group?
vibration of the pixels from the image or video + spectrum variation of that particular pixel.
Brilliant.
Mind blown.
If you plan on making it open, at least use something like numpy where anyone can then run the code without needing to buy an expensive program. I was really hooked on matlab in college, the moment I left and had to buy it I started learning python and using scipy, and I'm pretty much able to do whatever I did in matlab with that.
Wonderful discovery
This is amazing!
This is a big breakthrough in medical monitoring!
Amazing !!! I can not believe that they're putting their code as an open source data !!!
True, I must have got messed up...
But I agree with you.
I've never realy looked at this stuff, since it never made sense to me.
Could you do a sweep of frequencies and look for the largest response?
Cool development for sometime now
Agreed.
this is fantastic
Amazing! There are so many intelligent and innovative people in the world.
woot for useful research
holy crap that's ingenious
Brilliant.....
Yes, it is Matlab. You can get the code from their web site.
Brilliant and wonderful. WELL DONE! =)
Very interesting. And they are doing exactly the right thing in making it open source. That's the way of the future in my opinion.
Yes they do. Though IR is inherently deficient - take for example ambient heat issues (summer time, people sweating). add the fact that you cannot actually see peoples facial expressions - all you get is a heat mapped colorful smudge - it just goes to show how mind blowing this technology really is so.
This would be perfect for reading increased pulse in people who are going through security, thus identifying possible threats. It would also work well during political speeches like an on the fly polygraph.
Godspeed gentlemen. This is just amazing.
Please use this on the O.J. case!!!
Well, think about it this way. If you look at one pixel over time, it changes colour as different parts of the image move through it. So if you exaggerate that colour change, you make that movement appear faster.
Would love to see this technology used on Humboldt Squid!
They say a picture worth a thousand word.. But with this technology I think we can bump it up to a million
This is amazing
Can this be applied to BP? Looks like they have Pulse and respiration down. Let's brainstorm a bit. They will start Star Trek medical beds with a camera the size of cell phones that can take your vitals. The bed should be able to take your temp with an IR sensor similar to handheld models.Needs a touch screen built into bed controls and to monitor. What else can we adapt the new medical beds to do?
agreed!
So you can magically see things that others can't.
I wish there was a button on youtube to enable this in any video. That would be sweet!
these were my thoughts exactly... when a person lies blood flow changes, Pupil response change, even certain facial muscles move that normally don't. Or at least personally I know mine does I can feel it.
Yup!
Yeah, Usage looks very broader.
Looks a ton like Matlab being used in cell mode. Has Matlab fonts, colors, syntax ...
Very interesting application
brilliant
totally rad
amazing
Amazing
Do you know what they are using to track the pulse of the baby at 2:05 in the video - where it says "Estimated heart rate"?
How can someone actually dislike this video; what do you want?! We could go back to the middle age in regards of technology if you want!
This could be the reason of the uncanny valley. It may be that we are perceiving things in that we can't see or understand and difficult to replicate
I feel tremendously inadequate.
There were couple moments where they showed the Matlab code on screen.
I'm pretty sure that was their main motivation.
Great.
Yup
Finally, something that could one day actually make Google glass worth getting.
Wow.
airport security! Gauge heart rate and eye moment!
Principle of Vibration - Kybalion (1908).
The Principle of Vibration embodies the idea that motion is manifest in everything in the Universe, that nothing rests, and everything moves, vibrates, and circles.
I am wondering if they could have published this?
INCREDIBLE
You probably wouldn't have to... since you are already gathering data for the color of every pixel, and adjusting that, you already have all the data that you would need.
You could, for example, set a threshold, say 'anything over XX difference' or 'the top XX% of responses', and you would already have your set.
Why is there no link to the project page? It took some searching around, but YT won't let me post URLs...
very cool
That too.
They are using C or C++.. It's cool there is an open source computer vision library if people are interested in playing around with algorithms like this called OpenCV.
More like Geordi's visor. Tricorder-like tech is in the works too, odour based, mainly.
he said the this is a still pic of Steve how can there possibly be variations in the pulse in a still image ?
i cant wait when its used in movies
THIS IS AMAZING!!!
0:43, what monitor is that on the table, kind of looks like the Wacom cintique or whatever but yeah, anyone that knowns?
I wonder if they could pick up the parallax of stars in a time lapse of the night sky. That would be awesome.
My right ear enjoyed this video.