Realtime 3D geometry video scanner
HTML-код
- Опубликовано: 11 сен 2024
- This is a high-resolution, real-time geometry video scanner that simultaneously acquires, reconstructs and displays 3-D geometry at 30 fps with a resolution of 640x480. More info: www.vrac.iastat...
This is very impressive! One thing I've always noticed that bothered me about most MoCap systems and 3D scanners, has been the lack of the 'wobble' in the face. The almost indistinguishable twitching in facial movements. It all seems too smooth!
people have mentioned the high poly count these sort of applications produce as a reason they couldn't be used in games, when actually the program Meshlab will (for free) do a texture accurate edge decimation to produce a high quality model at whatever poly count you'd like. It intelligently allocates whatever poly budget you give it to encode the most data possible. Meshlab does amazing things top shelf 3d software doesn't even attempt.
AWESOME THIS WILL HELP A TON! for movie games and what ever!
This requires a lot of expertise on both hardware and software. It was not easy for non-experts to reproduce: even my students couldn't. That's why it is so expensive and unique. Another problem is that the new projector has different operation mechanism, which makes it impossible to implement the same technique. The good news is that we are working on something that will simplify the system development. Once we are successful, we'll open, and the hobbists should be able to reproduce by then.
over 300,000 points per frame, at over 180 fps.
So that's basically a 640x480 video recorded at over 180 fps.
Or the equivalent of HD 1920x1080 video recorded at 30 fps.
It's probably take up less data though - since it's probably replacing the colour data with depth data instead (with probably only 640 or so "colours" or depths).
video game developers need this!
Animation of lines constructed into a video file. Consumer grade DLP projector is used to project this animation of lines over the subject. Camera records this line play on the surface of the object. Program calculated the deformations made to the lines by the object it's projected over. Program detects and calculates the shape by examining the live stream or video of the deformed lines. Converts them to a point cloud which is converted to mesh. Please teach the hobbyist how to make this. Please
This is good work
very cool!
This "complicated modification" sounds a lot like the removal of the color wheel...
update: you'll learn more about the technique by googling: "fringe projection"
I am very happy to see the vidoe after you give This is a high-resolution, real-time geometry video scanner that simultaneously acquires
What accuracy are you talking about? For static objects, it is much easier and and the system can be much cheaper. For large object, I guess it is difficult to finish in a single scan. But you can certainly use a mature merging software to put together once you scanned all area of the object. The weight for the stationery simple is only few pounds. It should be easy to use and transport. Our software allows "button clicking" measurement, should be simple enough.
@ALIVEWORKS The camera + frame grabber I used cost more than $7,000. If you only capture still object, my technology should not be the best choice.
It depends on the spinning speed of an object, if it spins at more than a few hundred rpm, even my system won't to able to capture it.
LCD projector won't be cable to do it. It must be a special DLP projector, and modify it in an unique way. Otherwise, it won't work at all.
Hope these give you enough information to start with.
A question! What's the size of all this stuff, sensors and computer? Would It be possible to install everything on a drone, maybe ti scan in small details rock walls?
wooooow
There is very little info on his it actually works in this video.
So i googled for "3d fringe map" and found some explanations of how the technique works. It seems to be quite common.
The "Kolibri Cordless Sensor" is one such device. But i doubt it's the only one.
So... what exactly is unique about this video? It seems to be old technology.
looks nice although it seems to trip at times.
@szhang77 This is pretty incredible stuff, when you say Cambridge do you mean in the UK?
why is it not able to scan the entire room (like an eye does) ? just because of hardware limitations such as (resolution,refresh rate,framerate,focus of the camera etc) or are there any other obstacles?
awesome
What kind of GigE camera's did you guys use for the realtime liquid 3d scan system? They look like Dalsa's. AVT GE680 was used for this system, correct? It looks expensive. The Dalsa's look cheaper. I'm not so much interested in animated 3d live capture. I'm hoping for still & spinning 3d object capture. I'm hunting like mad to find as much information on these systems, see if there's a consumer build alternative. A HitachiCP-X275 XGA LCD was used for the liq sys. So it's good enough right?
We are selling it. The current price is around US$50K.
yes you can but you cant scan the low poly you have to make the low poly by yourself.....
yes there is a program that crunsch your poligon amount down but that works whit cars and objects not human or animals
Congratz!! its not just a great idea but also very well executed. Probably you had changed the colour subpixels (RGB) in the projector in order to enocde a grayscale image at a 3 times greater.resolution.
Are you able to set up multiple camera to be able to capture a whole person?
@liiton stero matching cannot do this resolution and speed for sure
To me, It is a very simple stereo matching system......
Does that mean actors haven't lost their jobs to computer graphics, but rather got new kinds of jobs?
Except they'll only be paid to do a face once, I guess.
damn robber!!! 50K? thats why people use pirated software in the first place, it looks just a like a videocam inside a shoe box
So depressing to see these exciting ir 3d camera capture system, and still no Average Joe "Cost friendly" versions exist for the Hobbyist. David Laser is ok, but the resulting mesh's are very poor in quality, and it's a P.I.T.A to retopo and clean them up. I really wish you guys would make a "How To" build your own forum/ with some open source software to show enthusiasts like myself how to make and program them. It's criminal that systems like these sell for 4 figures or more. :(
so I've got a question: the triangles were actually moving and it didn't seem that every frame a new model was created (what i thought when i clicked the video), it looked more like the system could actually tell what parts of the just scanned model were moving and thus moved the belonging triangles.
yeah it's not a question sorry :p
Each frame of video was independent of another, and elements of the model weren't referencing elements from any other frames. It might be most accurate to say that the depth data of the video was being projected out of a planar object, onto which the color data was also projected. The points may have appeared to be stuck to particular features of the face, but that's likely just because there were *so* many points it would be difficult to know which point was which from one frame to the next.
Some day, this tech will replace the need for motion capture pajama suits =). Long way to go still tho. Can you imagine a VR addon that scans ur actual body into the game for use. Can you imagine looking into a mirror or looking at your hands in VR and have them actually look like you!
we be just like photoshop cleanup of photo textures. photo bump-maps
If a convenience store is open 24 hrs a day, 7 days a week, 375 days a year why do they put locks on the doors? lmao!!!!!
I love structured-light 3D scanners : ) *****
I wonder if you'd be willing to share the phase unwrapping algorithm you used. Is it running on a GPU for speed, or is it just very efficient?
WOW is cool
I wonder what progress they made in 6 years.
can you make it not so creepy?
2:07
Does anyone want diarrhea more like..
It show artifacts. lol!. If video game developers use to get 3D hi-resolution models we're certainly gonna need a seriously beefy computer to run a game or application this demanding. The time the game devs save scanning models with this they will spend it optimizing and lowering the detail in the models. This is more suitable for ... movie 3D rendering.
WAT A SMILE
"what a beautiful smile" yeah i almost got a heart attck by that face 1:43-145
If we took Leonardos brush and said: now we only wanna buy art from a machine you know - that would be sad. I can see many advanteges with this technilogy - as long people can define what to use of it. My point is, we sould think about these thongs before we get to excited of the technology - yes, its truly is amazing, no doubt of that - but are we willing to supstitute and stop the "human progress" over the technology no matter the cost?
Why? If you get chance visit cambridge, I can show you our system right away. We demonstrated our system in SIGGRAPH 2006 Emerging TEchnologies. If you knew somebody atttended that conference, he/she should saw our system.
Mr. Song Zhang
Harvard University
its a fake ,isnt it
i have a 3d scanner that is just decoration and cost 3times more 150$,how it work you can see in my clip "3d face scanner"
this is just a "maybe sometime in the future it will work" clip,isnt it?
So are you selling this thing or just bragging about it?
How much?
Has our 3d scanner solution found a market ? Have you had contacts with industrials to sell this 3D scanner and the software ? If you do, do you have any brand and link to provide ? tks
hmm looks like someone tryes to change how we look at fine art in games an 3d movies - I dont think meny artist would like to be replaced and do the cleaning of these captures lol Its simply too eazy to use real life actors - this is not for 3d movies - its for "3d scanned movies" ;) its nok art to scan things its replication, end of story
If a convenient store is open 24/ day 7 days/week 365 days/year, why do they put lock on the door =))
you kinda scared me, though :(
So its safe to say point clouds is misleading.
yeah it is safe :) these are actual polygons. so I've got a question: the triangles were actually moving and it didn't seem that every frame a new model was created (what i thought when i clicked the video), it looked more like the system could actually tell what parts of the just scanned model were moving and thus moved the belonging triangles.
Does anyone know a projector company who would like make a special DLP projector for all of us at reasonable low price? If you, by chance knew one, please let them contact with me. Everyone can then enjoy playing with this technology once they provide all of us low cost special projectors.
BAD ASS
This guy is worried that Leonardo will use this machine instead a bush. One hes dead. There will be no other Leonardo. I see a true artist must only use ash from a fire to create all great art. An artist can't even use color, Right! A great artist will be seen though what ever they do or use.
cant to much poli
could it see facial hair ?
Max Headroom
Eat your heart out
would be a nice xbox kinect :p
This is human progress. Your worried about art being replaced lol. You must get excited of this technology, it leads to better technology. Everything is just a step. All you need to do is worry if its for bad reasons or good. Such every thing is a tool, its how we use it. What the hell. What human progress are you talking about?
funny )
Кто зашел сюда потому что увидел 3d Ленина?