Hands-On with Lightform Projection Mapping!
HTML-код
- Опубликовано: 5 окт 2024
- Projection mapping is one of the coolest visual technologies that so far has been out of reach for consumers. Lightform is hoping to change that with its projector-mounted scanner and software. We get our hands on the Lightform device to see how it maps objects and environments in front of it--like a replica movie prop--and go through the software to learn how to create striking augmented visuals on top of the real world.
Shot by Gunther Kirsch and edited by Norman Chan
Subscribe for more videos! www.youtube.com...
Follow us on Twitter: / testedcom
Get updates on Facebook: / testedcom
Tested is:
Adam Savage / donttrythis
Norman Chan / nchan
Simone Giertz / simonegiertz
Joey Fameli / joeyfameli
Kishore Hari / sciencequiche
Sean Charlesworth / cworthdynamics
Jeremy Williams / jerware
Ariel Waldman / arielwaldman
Kayte Sabicer / kaytesabicer
Bill Doran / chinbeard
Gunther Kirsch
Ryan Kiser
Kristen Lomasney
Set design by Danica Johnson / saysdanica
Thanks for watching!
I love how the tested person presses for tech details really respectfully. It makes sense the person from light form wants to talk in plain terms but I’m sure others agree it’s really appreciated seeing the specific nuances
For those curious, it's $699.99 for the Lightform LF1, and $1499.99 for a bundle kit that includes the Lightform LF1, a 1080p projector, and some other things like a tripod.
That is a great price point for small business commercial use.
I'm guessing that if you get the free version of the software (which they keep talking about) and use your own webcam and projector and computer to drive the software this could be very cheap :)
I want!
Rejinx during the night time have it project a advertisement/logo onto a big glass window on the store front
Could be great for a amusement park or anything like that
I'd love to see medical uses for this - a surgeon could see an xray or MRI superimposed on the body, so they could see exactly what's underneath before making incisions. Blood work and other scans could automatically update colors as they work.
This is without a doubt one of the coolest things I've ever seen.
Really want to see this upgraded to incorporate real time tracking for moving subjects
You should check out the video Box on the channel Creators, it's made by Bot & Dolly. It's not quite RTT, but a very well choreographed video.
can't wait to see this combined with eye/head tracking via ar glasses so that the projections can be in response to where you look, and perhaps the projector/sensor array being worn. Saw some research being done along these lines years ago, not sure where it is now. This would enable high resolution graphical overlays that are shared between the user of the AR system and bystanders, while having the lenses/LCD displays flipped up or somehow removed from the users line of sight, allowing a clear view --- as needed. The user could then flip the displays down and have the projector turn off, while having graphics (of a lower resolution) overlayed as in a traditional AR system. XR (extended reality) I guess is the class of device this would be.
As someone who is studying projection mapping its interesting to see where the industry is headed and I'm terrified that with this product, my job will become obselete. :/ curious to see how it handles curved and complex-curved objects.
your job is safe. no "pros" will use this. this is no match for D3, VYV ect.
This makes light mapping so much easier. I can't wait to get my hands on one of these to enhance my technology classroom. Thanks for the video showing the great light mapping technology.
I can imagine presentations and instructional activities, once it becomes truly real-time interactive. Projection on white globes could be used to display geographical or planetary information. Projection on blank human figures could show anatomical details; a larger than life torso could show an operation with depth of field as opposed to flat video imaging. Architects could project renderings of a finished space on an empty room or large space. This will only get better.
To what end though? "Projection on white globes could be used to display geographical or planetary information." That's essentially an inverted planetarium. Those have been around for decades now. Operating Rooms have observatories for teaching, and any projector "could project renderings of a finished space on an empty room or large space". The only practical use for this tech is to make a store's sign more eye-catching, and Amazon is killing the retail store. It could do some cool shit in a nightclub too I guess. But I don't see this taking off. I wouldn't have a use for it in my home.
It's used extensively in artistic fields
It has already gotten better using HTC Vive tracking.... ruclips.net/video/2gkidC6hTlY/видео.html
David would be proud now all he needs is tilt shift and deep learning! This is so cool!!!
Sometimes I just can't come to grips with the world we live in and am left in awe. This is absolutely incredible.
Dang, wish I had this when I was a kid, I could make the floor truly Lava!
95TurboSol Apart from directly below you! Although the top of your head would be lava in that instance.
Even better, you can do it now as an adult!
I don’t see many consumers adopting this, but I think we’ll see big companies using this in really innovative ways
We already pre-ordered the Lightform complete kit a few weeks ago and can't wait to get our hands on it (Have to wait until Nov 2018)... Now , gotta have the Zorg ZF-1.
Wow this is amazing! !! The possibility for retail application is mind blowing, you could grab the attention of people with this and boost your sales. Or attract attention to a car in a car show, and have everybody looking at your display to the exclusion of all others.
This is BEYOND awesome! Lots of great possibilities for marketing, special events, DJs, weddings, AV gaming, etc. Great price point too!!!
real-time projection mapping with automated edge-detection, etc. will be game changing for this tech.
Wow! That subpixel accuracy is bananas.
Very cool, I've been interested in projection mapping for live music applications for a few years, but it always seemed very complex or expensive, will definitely look into buying one of these Lightform devices!
You can see a projection mapping performance every Tuesday around 8:40 pm in downtown Redwood City at the Courthouse Square. Excited to see this tech in consumer hands.
For my job I have to use multiple projectors to create 4-5th dimension simulation with projection mapping , and you can loop gifs onto the objects that are scanned that creates awesome effects
I just got one, i can't wait to use & review. thanks for your video
Receive it yet?
Why are we hand mapping with a pen tool? I thought the entire point of Lightform was to have it done automatically. What am I missing?
There's still depth information that you can use to apply the shaders to, even when you adjust the map manually.
Processing is the same whether you are dealing with a 1 foot cube or a large building. The 1080p projector is the limit. Same number of pixels for both. It's just that the graphics will be really chunky on the massive target.
This is so cool! Cant wait to see where this technology goes. Great job Lightform!
Incredible. Tested is keeping us up close and personal with a lot of cutting edge stuff. More please, more!
I hope that there will be live tracking marker support soon, so that say you have a picture frame on a stage, and you could put your power point on that picture frame, and while you are delivering a talk you could pick up that frame and walk around and still change your slides... for example, I could see other uses for 3D objects and props that you could use in a live show if they could be trackable.
5:10 His head says no, but his mouth says yes...
Yea I noticed too.I guess they are not there yet but hope to be there in the future?
his mouth says yep*
His head is right, his mouth tried to dodge and spin it. Like he mentioned before, it works with "normal throw" projectors, so anything that is too wide won't work at all, and anything that is too narrow will have low resolution.
Professional versions of this kind of system generally decouple the projector(s) from the camera(s); they construct a 3D model of the scene (from multiple cameras and / or LIDAR data), then you select which image you want to appear flat from where (i.e., you define the intended viewer position), and it calculates the deformations necessary for each projector. This means the projectors and cameras can have any focal distance and don't need to be at the same location; if there's no coverage you simply add another camera. Here, you are limited by the camera they chose to use and by its fixed position relative to the projector.
.... Norm is just straying from the use case which he is unable to respond too without being like, dude I just told you it has to be mounted on a projector. He never even says yes, he just goes back to the topic at hand. He needs more practice in peopling for sure.
Despite that glitch, robots have still come insanely far. I think in a few more years this android model will pass the Turing test.
The prices seem a little steep, but I’m absolutely in love with the software and hardware and would love to get my hands on even in lx 1
This tech is very interesting. I could see adapting it to taking scans of objects and producing 3d maps of them. I could also see tech like this used in robotic vision to replace things like LIDAR, if you could speed up the process and switch to using dual cameras instead of the projector system. Maybe use a near IR projector and camera paired with a pair of visual spectrum cameras so that the robot can see different colors and has a map of the 3d space to work with for planning movement. Very cool tech. This does have a little feel of being an ad, but the tech is unique enough that it is also interesting.
You could also have interactivity based on events rather than physical input. For example, rather than having a dial that changes the speed of an animation or changing color, you could have a change happen when you get an email, text, reminder, or something else. Or different animations altogether to indicate various real-world events. Pretty cool!
It's 2018 and Jamie Heynaman still doesn't have a channel following the raising of small birds in his mustache called "Nested"
or a finance advising channel called "Invested"
The bird is the word.
"Permanent onboard storage. Unlike an SD card that can fail over time."..
Only has the onboard storage that can fail over time then? And unable to be replaced.
go look at people saying "what's wrong with the raspberry pi" and you'll notice the SD card is a big gripe. people with it was more reliable on-board storage. You're still connecting to the thing with a cable regardless.
WOW... just wow... The world will soon start to become slightly more beautiful.
its called spatial scanning, the software madmapper has it for example, useable with any canon dslr and any projector.
Actually, the scanning of lightform is not used to get an auto mapping. You have to draw each point of your object...
Extremely cool. Spoiled by him using his buzz words like compelling and Magic. Save that for wholesalers, retailers or press releases so it makes them look stupid instead of the creators.
Photography and film are always linked to magic tricks. It's the roots of it.
Nothing goes better w/ tested than a cup of Joe and morning blue summer skies
Looks awesome! You should put the link to their website in the description
I did not see them select the viewer position at any point, so it looks like this doesn't compensate for actual curvature and 3D shape, it's just a masking system for procedural effects, and they don't even trust the automatic masks (he did the gun totally by hand), which makes it very "meh". Everything it does can be done easily and interactively by hand (I've done it myself for several live shows, drawing the masks and effects while seeing them being projected, which is much more accurate - I _did_ have to render the effects as movies, but once that is done you can play them off sub-$50 hardware, no need to leave a $700 device connected to each projector in the show).
It doesn't even seem to have any sensor inputs to change the effect based on external events (like people stopping in front of it, or objects being moved), so being able to render the effects in real time is kind of pointless. It's effectively just recalculating the same frames over and over. Waste of power.
I guess this might find a market in shop displays, but it's not powerful enough for professional installations (also, the cost scales very badly with multiple projectors, since they expect you to have one per projector, whereas other systems use a few Kinects or webcams to cover the whole scene, and can then control dozens of projectors) and it's kind of pointless for home use.
It seems like they have spent more time getting the web frontend working rather than the actual computer vision stuff. It really should be possible to get a much better masking direct from the device. It may depend a bit on the scene though.
Putting an arbitrarily shaped object on a shelf close to the wall is kind of a hard case to detect if you have limited depth resolution. It will be hard to get good detection of the edges of the object as they blend into the wall.
Could you share the other systems that use kinects or webcams to cover the whole scene?
i also would like to know how this can be done more cheaply. I don't mind spending the time to manually set up the mask. What is the equipment and procedure?
This looks amazing! will be buying it one day certainly
This is crazy awesome could use this in music shows
Like all things tech, there is a place and an application for this. Yes it is low rez, and yes there seems to be plenty of hand work to address mapping, but it does capture some depth information in the scanning according to the Lightform rep. That speaks to potential as it evolves. He also mentioned the availability of warping grids for pre-distortion on complex surfaces. Something more advanced (expensive) existing solutions of course do now... but for $699, it has its place.
1) Don't overlook the fact that there is no such thing as projecting black... so there will be an additive amount of light outside of the areas masked and projected that will show the extents of the projector, regardless of what is used.
2) Closer the projector is to the receiving surface the better the results too I would imagine, as you would be using more of the available resolution of the projector. Ideally the extents of the projector should be coincident with the boundaries of your receiving surface, otherwise you are loosing resolution.
Thanks for sharing this overview, looks fun!
Interesting video, thanks! This guy named Maxin10sity has done some astounding visualizations, projected onto large buildings.
that's really pretty fucking good. With all the lighting on this video shoot it looks ok but not so 'wow', but you know that's gonna look great at night in a store window or whatever
Software looks great!
An alternative is Madmapper which is very like this software, maybe a bit less plug and play especially with the camera, but also cheaper in some ways :)
I will defiently try Lightform out some day!
madmapper had this basic setup for like 6 years now right? even with the same scanning algorithm
you still need your computer to run madmapper though. With this you can set it up, then just leave the LF and the projector.
Or you can simply use HeavyM ah ah Lightform software is close to the idea of HeavyM I think. Simplify the video mapping.
It's amazing how many comments have been made about how this can be done easily by, coders, hardware gurus, undergraduates. What about, soccer moms, waiters, ditch diggers, and junior high art students?
Everything is easy for experts in the field. This device trades complex features for ease of setup and use. In other words, as stated in the video, it makes it accessible to the average person.
I. Fucking. Hate. Cynics.
Its not exactly rocket science to do this, and they are charging 799 for a device which's harware is less powerful than a phone. And they are calling it magic and shit
I wish I would be a team member of Tested, I would gain so much knowledge
With MadMapper and a Camera is possible to achieve the same thing since 2011ish
It must be such a burden being as cool as you
I would love to see this for menus in shops or more practical uses
This technology could be used to project any fantasy into a white Zentai suit. That could be used in a special place for games in augmented reality, escape rooms, etc.
Tiago Oliveira this will not work since it is not realtime scanning a small movement will cause every masking to unmatch. This only work with infrared realtime scanner.
yep.
It appears that lightform is closing shop. Just came across this video three years later and was hoping their solution had improved.
I LOVE how lightform closed and the support is zero now
Very cool. Would like to see this in a theatrical application!
@2:53 that Las vegas sign is amazing
I am very excited about this tech.
I need this for my acid/shrooms trips.
LIVE FOREVER AS YOU ARE NOW!
I love theses shows, and they are free.
Late to this party ... aside from the bigger nut to crack - "tracking moving objects"( mentioned in video ) this needs precision (4k, 8k...) and most importantly real world input - this means when I put my finger on a real physical object(or special laser pointer type device) it should scan back to software and allow me to only work in 3d and minimal to no computer screen etc.
Use case for me would be in construction : projecting stuff for customers or management etc. Could be used as multiple laser levels , map multiple holes for drilling (as opposed to lifting a cupboard in place to mark holes for drilling).
For those curious, you could probably do the same thing with a RPi and a 1080p webcam paired with a projector. Good Luck!
Expand on this please?
this is too cool!
I LOVE THE INSERT COIN SHIRT. AWESOME VIDEO TOO,BIG FAN.
Holy buckets of flaming shit balls Bat Man I want one right now!
That's one hell of a comment! I love it !
madmapper has had the scan capability since version 1.0 - with a canon dslr
Oh my god the last bit with the laser cut globe! Its like dark magic! Lets have it dynamic track the glove so I can hold it and move it around with projection! And also real-time scan my body and have occlusion so no projections on my hands
this is the coolest gadget i have ever seen.
Dude answers every question by first saying "Yep"
For example:
Norm: "Where are you guys at in terms of the software and also the hardware?"
Lightform guy: "Yep. So we launched three weeks ago..."
Mark Thomas Yep. The other guy says “Correct”
- so what happens when you move objects?
- Correct. You have to redraw it.
This thing is awesome!
and very good vid on it, I understand how it works and what it can do, thanks Tested!
Imagine having this on an ironman suit replica! Not sure if it would go through glass but CAN YOU IMAGINE! it would be like that scene from iron man 2 when he wakes up his workshop. Add a clap turn on mechanism and you are half way there. If I was rich Id have the coolest house ever haha love the video.
oh man VFX artists have been doing this since 2002 its soo easy!
Seems there are a lot of people thinking that this would only be really good for commercial or retail use. I could definitely see home users buying this as well. $700-$1500 might seem like a lot, but how much do some people spend on Christmas decorations on their home? (and that's jut one holiday,this could be repurposed for Halloween,4th of July or whatever you want)
Been wanting to projection map the whole front dash of my car with a pico laser projector. This will make it soooo much easier.
I have no need for one of these but I want one desperately!
Would love to see more projection mapping stuff, especially in a project setting! Unfortunately i cant justify $700 for one, but all you really need is a projector and software anyway XD
Try HeavyM ;) :)
this is awesome! i already know what I would use for!
I’m surprised they aren’t trying to integrate this with after effects or c4d somehow? I’m an animator and that’s a major major deal breaker
Maybe they are and I missed it?
Yeah, or make it possible to export scanned objects and import animations or even particles. Maybe it’s possible, but it’s probably limited because they do it with shaders?
Ryan Luse , that’s exactly why I watched the video. I want to map my house and love the way this maps but want to use my After Effects, Photoshop, and Cinema 4D content.
Maybe you can but would love to see the integration.
there needs to be a platformer game to play on shelves or anything. That would be crazyyyy
I know if I buy this it will be fun for a week, then just use it to project the time
Sync this with some electronic music and you get the perfect party :-D
Is that a... *Zorg ZF-1* on the background?
Edit: Nevermind, they acknowledge it on the video.
For those who want to know, this is the weapon developed by the Gary Oldman character from Fifth element, it's the coolest shit, it has a lock on feature for homing bullets, rocket launcher, arrow launcher, net launcher, a flamethrower (my favorite) and some sort of freezing gas called the ice cube system.
"Now a real killer, when he picked up the ZF-1, would have immediately asked about the little red button on the bottom of the gun." :D
Adam has been working on the ZF-1 for years now. There are a few videos of it.
ruclips.net/video/j_n8p22ku0E/видео.html
ruclips.net/video/MuNMeLwXPeg/видео.html
lol yeah and they even focused on the button in this video
I knew I was beyond repair when I instantly identified the weapon from the partial view at the start of the video.
That guy could not stop saying "yep" lol
I don't feel this is a finished product. This can be improved in many ways, but it's still cool as hell
Cool. It would be awesome for B&M retail
Constructively, informative.
If the object you scan is symmetrical you could give the appearance that is spinning or flipping.
This would be great for streamers and gamers, imagine utilising it so that you have a live twitch feed on your wall or a games HUD next to your tv not on it, or a games map etc
very cool , but what about burn-in. the projector is only using a concentrated part of the beamer. wont this lower the projectors life a lot , also seeing that most effects are quite bright. seems a more appropriate technique for laser projectors.
With a bunch of these devices you could easily look like you live in the future, with a ton of objects that has diffrent shades of colour using the software.
That's very, very cool.
A ton of people are able to do this and could probably make it very easily and sell it much cheaper. What is supposed to make of this entertaining and interesting?
maybe i'll wait for the LF2.5, it should come out in time for christmas.
Damn, I wish this would work with CNC routers and modern digital sculpting apps like ZBrush or even Silo to be able to digitally carve found materials that aren't flat like cut logs.
HeavyM is software that does just that. Lets anyone projection map onto any surface they like.
this was pretty awesome
*******would love to integrate this into my backyard amusement park!!*******
Very cool! Thank you for this review!
I like that, that guy has the 5th Element gun up on his board with the red button and all. If you push it does it self destruct? Hehe.
So, can Lightform track and project onto moving objects or only stationary ones? It would be cool if it did.
This is awesome