Eulerian Video Magnification
HTML-код
- Опубликовано: 22 май 2012
- The video accompanying our SIGGRAPH 2012 paper "Eulerian Video Magnification for Revealing Subtle Changes in the World". Read more about it here: people.csail.mit.edu/mrub/vidmag/
Наука
Наука
![Eminem - The Death of Slim Shady [Album Trailer]](http://i.ytimg.com/vi/X0HIrS6kUYI/mqdefault.jpg)
i can not believe this was 11 years ago. it seems so practical to extract the vital signs of a human with a camera
Not only that. The motion amplification is used at huge industrialplants to controll vibrations on machines and tubes which would destroy them over time. And as a control mechanism in research to card out wrong meassurements through visual evidence.
Really cool tech
Especially with today's level of camera.
The speed, the quality...
It makes the technology this video was made with seem older than dinosaurs.
probably a deep learning algorithm can extract it, with the added benefit the neural network would teach itself what image processing needs happening
They do exactly this all the time. A pulse oximeter, the little thing a nurse clips onto your finger at the hospital, uses a photodetector like a photodiode, (basically a 1 pixel camera) to detect changes in brightness of red and infrared light that is passed through the finger, which provides iformation on both heart rate and the oxygen levels in the blood.
So you see, we've been using camera to detect vital signs for many decades already. Jist not cameras in the way most people thing of a multipixel array of photodetectors with a high resolution.
There are actually projects on RUclips where people will make say, a 24x12 array of photodetectors and literally build a homemade digital camera. It's pretty neat, and shows how a single photosensor is just a 1 pixel camera more intuitively.
@@camus83489Especially for important things it is better to have an explainable algorithm. Machine learning is not a solution to everything.
This is freaking insane. Great example of technology becoming so advanced that it seems like magic.
It's worth noting, factory engineers use this technology to detect broken machinery. Something can look completely still in real life and with 20x motion amplification when functioning normally, but a loose bolt will make the whole thing jiggle.
This paper is 11 years old
It's math...and not very complicated. The challenge, at the time, was having it run in real time.
stay in school kiddo :)
@@Dr.W.Krueger it's not just math because this existed 200 years ago and computers had plenty of power when the video was made.
The innovation was finding useful ways to apply math to seemingly completely unrelated topics
Why isn't this a more widely known about and used technology?
This is mind-blowing, and I feel like it could have plenty of applications.
Like what?
😂@@JesusProtects
@@JesusProtectsnewborn children and monitoring their vitals visually from home, checking industrial machine vibrations so you know the machine isn’t going to break, and any other area of use where small changes over time can indicate a larger problem.
@@JesusProtectsThere were many mentioned in the video. You don't have to ask, just use your brain
because the video has to be really stable to get stuff like veins pumping
The motion amplification looks like the stuff magic is made of. That's just genius.
The retina could create a similar effect. If you look at an unchanging scene with perfectly fixed eyes long enough, your vision will fade till you can't see. Small parts that are changed will then stick out.
That's not exactly real useful in the real world.
I believe low dose of psychedelics can do the same. Operative word is low dose.
high doses too ;P but for real, maybe any alteration to our sensory perception (such as huangs mentioned one) is due to some natural chemical change in our body. And with psychadelics, which simply inhibit reuptake or stimulate the release of dopamine serotonin and norepinephrine, those effects are just produced at an "unusual" time which make them more noticeable and classified as tripping when in actuality we are ALWAYS tripping haha @@DCrypt1
I have indeed experienced that. Looking at a fixed point intensively. (Not on drugs. No eyes problem). The scenery would switch to a a different visual frequency, what you call fading. But I didn't see this as an improvement in details. Actually if you were to create even the slightest change in your eye moving it, everything goes back to normal.
@@alanmlkbanda I guess it's more like long exposure photos (useful for imaging distant planets or what not) where the image becomes more defined and details that are not clear right away become apparent. But with our eyes that kind of overexposure just washes out the image creating that "fading" effect. (?)
One of the coolest uses for this technology was a company that would go into industrial buildings and film the equipment, then amplify that footage and find which machines were running rough, needed to be stabilized, or were the cause of vibrations throughout the building. Groundbreaking stuff.
Could you provide some more information/sources about this? - It sounds like a fascinating read
@@racnoff6726 Sure, they dont allow links (even internally) so search for Miscellaneous Motion Amplification here on the tube.
I've seen a video where this method was used to show minute vibrations in a factory. It looked insane as the machinery and supports twisted and flexed. It clearly showed where all the stresses were being applied by the vibrations, and could protective solutions could be put in place. It is included in Steve Mould's video:- ruclips.net/video/rEoc0YoALt0/видео.html
This video uses a different motion amplification algorithm
Thank you for reminding me of that link, such a beautiful video!
Unrelated, different approach.
Still Dre Day Das, Ak Das
all the people who are saying how different these approaches are must be working for the company featured in Steve Mould's video... the two approaches are functionally identical.
Nice, and 11 years ago!
dude, this is a big milestone for image processing
Man, those low sci high fi writers were really on to something with those "Enhance image!" lines.
When i was my kid, that scene in blade runner blew my mind. There was nothing like it at the time, now your smart phone can do things 1000s of times more complicated 😅
Wow, the use cases of motion amp. and color amp. is insane!
I mentioned this technique in a comment a few days ago and it is really cool that RUclips suggested this video again!
This is wonderful! This can literally change the world!
absolutely. I've seen some really amazing image enhancement programs and software over the years, but the cost of these things is far beyond what the average person would spend for a single piece of software.
Software doesn't cost anything to distribute or replicate. Once a software is made there is no additional cost for distribution.
Also there is no such thing as a ''single piece'' ''of'' ''software''
People really need to stop thinking of software as ''individual units'' as they can be replicated practically infinitely.
People are too retarded when it comes to technology. I wish smartphones were never invented. Y'all ruined the internet.
@@RobotronSage no shit theyre talking about how much it costs to buy
This can be used to detect vibrations and vibration-related problems in industrial systems
Yes! and you can hire these services from RDI Technologies Inc., I-Care, RMS Ltd, GAMT, Erbessd-Instruments, among many others.
All you need is a camera and the software / algorithm. Nobody needs to pay some company to do it for them. Stop scamming people.@@AlphatecEngineering
Like literally you're trying to gatekeep some open source software making people think you're the only ''company'' who it is available to? Stop pretending like you made the software and own it. Why aren't you explaining that people can do this themselves with a camera and software, both of which are readily available.@@AlphatecEngineering
Looks akin to how motion vectors work in NVIDIAs DLSS 2+ very cool to see the history of this method. Motion artifacts remind me of low res ray tracing artifacts.
Imagine AI knows your vital signs just by looking at you.
Scary.
I was thinking this was some crazy brand new development, and then I saw this is from 11 years ago, insane lmao
wow it's already been 11 years? it feels like yesterday since i saw this first demonstrated. time really is merciless.
This is so crazy, but so awesome at the same time.
amazing stuff, will play around with the open source code; so cool
I was beginning to think the field of imaging software was getting stale, but my hopes are back up now
Where can I download this software?
See link in video description@@Rybz
Can't believe this was 11 years ago
An 11 year old video appeared in my video today. Glad it did... this is a very interesting topic, well-covered in the video.
this is incredible research
Amazing! please release this library in the openCV one :)
so amazing how you can track the hearbeat simply from a video
This was really cool and interesting. Thank you!
This is amazing
Added this to my public RUclips Museum playlist
This project deserves special atention.
Amazing job!
This is like audio transient shaping, but video. Neat!
Fascinating. I want this.
👏🏻 👏🏻 👏🏻 amazing work!
This is awesome!
thanks for posting man, good stuff
There are people in the world who do this.
Great work, 2021 a live camera system is available . convelouting a 3x3 array over a bitmap . heady days.
Wow. Fascinating stuff!
Fascinating!
this is insane!
Brilliant!
This is neat!
this is so cool
I see the beginning of a new RUclips meme. Once the code is released, I'm sure that the site will get flooded by videos that apply Euler magnification to just about anything. Looking forward to that!
Very interesting presentation. Well put together too.
thats badass
Wonderful technology that these days is doing a great job of finding vibration problems in industrial plants.
outstandin
Pretty amazing!
Amazing.
Amazing
That is AWESOME
Steve Mould made a video about this technology application. really awesome.
great video
Fantastic possibilities to monitor patients non intrusive.
amazing
my mind is blown
amazing!
Technology is so fascinating...
Nice work !
Very cool concept!
So many applications. Perhaps even analyzing things like heart valves. Maybe CT or ultrasonic imagining?
Very interesting. I had no idea what the applications might bew even after I sort of grasped how the video was being filtered.
Why am I only seeing this now?
This feels like a summer of math exposition video
Ah this is really clever. Different levels of high pass filters to exagerate subtle motion. This would be cool for mechanical engineering like in factories or stress testing machines! Lot's of possibilities to try this on out on.
So this was the precursor to the motion amplification cameras of the last 10 years. Awesome.
youtube algorithm decided it was time to suggest this video 11 years later...
I love this technology. It is like super human vision.
bom trabalho
Bravo!!!
Curious about the differences between the visual HR monitor and the machine monitor. Machine monitor stayed pretty constant at 150-151 while the other one varied between 148-156.
Inaccuracy in the visual process? Or is the machine monitor actually flattening out variations for a smoother reading?
very interesting indeed
11 YEARS AGO
How have we not seen more of this in modern implementations? lol
Well done guys, this is like black magic
this was 11 years ago wow
Yeah man.
superb
i wonder why this is taking off more so now. but this is some fascinating stuff.
This is why I love computer science! :)
This was 11 year ago!😮
I bet this is a big noble prize candidate
Steve Mould has a video about similar technique. I'ts called "Reveal Invisible Motion With This Clever Video Trick"
Wow, this is fascinating. I can see the government using this to their advantage...
Enhance!
Wait so that super secret method that the "inventor" in Steve Mould's video wasn't actually secret at all and he just found an old idea, not even his own, and is trying to sell it?
Less surprising than I might hope.
That`s is cool ... and it`s so useful
It only took RUclips's algorithm 11 years to get this knowledge out to the public lol
very clever
The implications this research has not only for parents but for security and the medical field is great. Amplifying subtle motions to be more exaggerated looked like something kinda cool until you showed the video with the baby's heart rate and the baby breathing. Good research project.
How sharpness adjustment really works..
Does anyone know if this has ever been practically used in the medical field or if there are any devices being developed based on this technology?
Interesting.
cool bro
would this need some sort of special highdef camera?
I wonder if this could be used in astronomy and telescopes to get more information out of them
kassie2k4 That is a good question, perhaps the stars emit light at certain intervals this may be able to intensify that.
there should be interesting applications around exoplanets and/or exomoons... perhaps near-earth objects as well.
Genius!!!!
Wow!
ENHANCE!!!
I bet there is a way to do this with sound too...