How Holographic Doom Works on a Lightfield Display!
HTML-код
- Опубликовано: 28 авг 2024
- We test out creating holograms from our phone portrait photos and playing holographic Doom in the Looking Glass Portrait lightfield display! Now that this display is shipping to crowdfunding backers, we get our hands on one to test out the software for importing photos, OBJ models, and even unity games. Here's why this device finally feels like the kind of tabletop hologram we've seen in movies and science fiction.
Learn more about the Looking Glass Portrait at lookingglassfa...
Shot and edited by Norman Chan
Join this channel to support Tested and get access to perks:
/ @tested
Tested Ts, stickers, mugs and more: tested-store.com
Subscribe for more videos (and click the bell for notifications): www.youtube.com...
Twitter: / testedcom
Facebook: / testedcom
Instagram: / testedcom
Discord: / discord
Amazon Storefront: www.amazon.com/...
Savage Industries T-shirts: cottonbureau.c...
Tested is:
Adam Savage / donttrythis
Norman Chan / nchan
Joey Fameli www.joeyfameli.com
Gunther Kirsch guntherkirsch.com
Ryan Kiser / ryan.kiser
Jen Schachter www.jenschachte...
Kishore Hari / sciencequiche
Sean Charlesworth / cworthdynamics
Jeremy Williams / jerware
Kayte Sabicer / kaytesabicer
Bill Doran / chinbeard
Ariel Waldman / arielwaldman
Darrell Maloney / brokennerd
Kristen Lomasney / krystynlo
Intro bumper by Abe Dieckman
Thanks for watching!
I love that one of the first things people try with new gadgets is making Doom run on it.
With 2d monsters! 😂
Almost all consumer tech gets tried out with porn but RUclips wouldn’t allow it.
Either that or a Turing machine
Well... way back when, I loved my MetaByte card -- it has stereo drivers so that you could run any 3d game in shutterglass 3d. 'twas amazing (you should see HalfLife)...
The bad part about this LookingGlass is that it needs that quilt and there's no "I know it's gonna suck, but let's render an OpenGL quilt here." (The resolution isn't too high, but you gotta render 48x perspectives per frame (!).
Unity is where it's at right now...
These would be really cool in a gallery for 3D artists to display their work.
As a 3D modeler I deffinitly feel drawn to this, so 100% agree
I guess it is kinda off topic but do anybody know a good website to watch newly released movies online ?
@Bentlee Fabian Thanks, signed up and it seems like a nice service =) I appreciate it!
@Ares Spencer You are welcome =)
Finally the future is near where we won’t look dumb trying to look around corners in shooter games.
I can still put the extra oomph in my punches or just make that jump if I just mash them buttons harder.
@@burtenplays Good advice but don't forget to shout "hi-ya" if you really want to juice those punches.
_'We'_
Got a mouse in your pocket or something?
Always disable 3rd person on your servers... Ban the dweebs!
When he peeked around the corner in Doom, without moving the controls, I lost it.
Thanks for letting Norm get his hands on your unit, Jeremy. It was fun to watch what he did with it.
😂
Make it a touch screen with haptic feedback and you've got the next gen of smartphones. Imagine pushing a button on screen, feeling it click, and seeing it retract. Popup messages would actually "pop", etc.
you could just make an app that does the same anyway
15:08
Wow that's incredible. Imagine 10 years from now all content is shot with 3D capable cameras and then consumed via 16k ultra high resolution television screens.
I got the Lume Pad, made with Lightfield technology and it makes picture and videos into 3d on the fly. Plus you can take 3d pictures and videos with it. I will be making 3d video games for it.
It is incredible how well the effect can be demonstrated on camera.
Love your face. Best of luck!
I previewed an early concept of one of these back around 1995 when working at an optical device company. The developers had the concept down and used a CGA resolution display to show a 3D molecule model. It was pretty cool and I wondered why it never really took hold since way back then. I wonder if its some of the same folks.
Great tech, I could see this scaled up to consumer TV'S in a decade and even having TV shows and Movies shot with depth cameras. Fantastic stuff
The company already sells a 4k monitor version but you have to contact them to get the price so... Costly. The benefit being that even higher definition means the glass element is thinner.
@@TalynStormcrowthe 65” is aimed at enterprise priced $50k. They have 16” oled version coming soon for $3k. The next generation of the Portrait is called the Go. Screen is a bit smaller but higher pixel density and much sleeker form factor. It’s $300 but you can get it for $230 early bird next few days shipping in June. This stuff really has to be seen in person to appreciate.
So like, a bigger 3ds top screen? Neat
bruh 😂
In case you’re here only to see Doom itself running: 15:00
It's just like the future version of a plasma ball. "Very cool uncle... what else does it do?".
I want 2.
As a 3D monitor and VR user to this day.....
***Early Adoption sweating intensifies***
This makes me wish games gave support to export your player or game models, with animations and stuff.
Because imagine exporting your Destiny character in their outfit, with gun twirlling and shooting animations against some backdrop (or any RPG or MMO with player fashion/customization). Then rendering it on your lenticular frame as like a movie slideshow. So as you walk by your little character is dancin or shooting on your shelf or desk.
I feel like having just one of these with customised animated content playing on it would be super super cool, alonside say figures on a shelf, or even as desk dressing like I mentioned.
I wonder if we can display 3D photos taken on the 3DS here.
It took fifteen minutes for you to get to DOOM!
...But it was pretty cool. Thumbs up
Gotta get that watch time, y'know; they can't just show you headline content right off the bat; most people would leave after seeing what they came to see and nothing more.
@@ChozoSR388 I skipped through the whole thinking looking for DOOM. I would have watched the whole thing if it'd actually been about DOOM.
This will be amazing with a properly rendered real time AI face or body to interact with them closer in the future. How to sell the idea? Your own holographic Cortana. You're welcome Microsoft.
This does like a great piece of tech - curious where it will go in the future. Could you try an animated film poster? I know there are people making some cool animated art prints, like the one for The Lighthouse.
An entire book that tells animated short stories on every page is what I’m envisioning
they have a 32 inch 8k one for businesses
Finally Harry potter video photos are here. Been waiting for this. Can't wait till its cheaper and just for 5-10 second clips. Maybe Vine could put out a version.
I love that Doom has become a measuring stick.
Very straight forward explanation.
Summary: it can run DOOM. Anything can run DOOM. I bet scientist will figure out how to play DOOM with our blood cells or even atoms. Who knows?
It takes 16 billion crabs to run DOOM
@@TheAstronomyDude A dude gutted a pregnancy test and put in a chip that could run Doom.
It's not running doom, it's displaying doom being ran. :D
That will put a whole new view on powerups
Interesting tech but I can’t say It’s a must have yet.
Just looks like a large 3DS screen.
Kinda what I was thinking.
Pretty impressive, can’t wait to see later iterations
Now I want a no-glasses 3D display for my PC.
Looks like they have a 15" and 8K screen on the site too
I've had this for a while, just running the default gallery. You did a much better job than they do of making it seem accessible and usable.
I'd have that display Doom demos all day
Imagine a racing sim rig with this tech used for it's display
This display technology will be used in upcoming smartphones and other devices most definitely. Very impressive.
doubt that…LG already experimented with this technology…not viable for the masses and everyday use. It’s a gimmick.
For some reason I really want to see Ridge Racer Type 4 running on this thing.
I think a Tempest style game like Thumper would be cool too.
If you made the background black and turned off the lights bet it would looked super cool. Would make for a nightlight display.
If it was a cube you could walk around and view from all sides...we could play Doom on that too.
Side scroll games would be so cool on this display.
Haven’t seen future tech like this since the 3DS…
You can't really tell over RUclips but this thing blows the 3DS out of the water
except this is a light field display it looks effectively like a window to an object people can see from different sides
Yes, the 3DS! I was thinking the same thing! Lol
@@TIDbitRETRO did u see my comment
me too am waiting for mine from the kickstarter campaign^^ cant wait to see my 3d models and photos on it
This would make the coolest gaming monitor
Phones are gonna be crazy in the future
This reminds me of the 3DS, just with a bigger display at a higher resolution. It's probably the same tech, it's just you are moving the depth of field with software than a manual slider like on the console.
the slider on the 3DS also just sets a software value that basically squashes the into-screen direction by some amount before it renders.
The difference is the 3DS is only 2 views (ie: stereo) at any one time - this is up to 100 views all displayed at the same time. So its significantly better and different tech
This is very exciting technology. Not ready yet for the dream of a fully 3d tv that includes perspective changes when you move but surely that will come. Being able to look around the corner in Doom is the most compelling thing i saw here. That's an actual addition, something you couldn't do before (out of vr). I suppose that could be mimicked with a camera adjusting your pov when you move your head but I've not seen that done.
If they ever make a TV with this kind of technology (which I strongly doubt) it'll be even more of a passing novelty than the 3D TVs you saw all over the place a few years back. A TV is something you watch from a decent distance away while completely stationary. Everyone would get sick of moving their heads around to see the effect after about five minutes. This would be useful for things like digital billboards though.
It's done now with stuff like Track IR. But the big thing is going to put these in VR Goggles so your eye can just interact with a light field not a flat image behind a fresnel lens.
I’d buy it for DooM alone but I’m still paying for physio on my thumbs since smashing it on the snes in ‘96.
Gamer hands club. ⚡👐⚡
I would have loved to see this work with Light Field pictures from a Lytro camera. We did print some poster-size lenticular prints using pictures from one and the results were impressive for the time. Since the first two cameras never had video capability, I doubt it'd look as good as any of those short clips do.
You really should check out the luma pad. It uses light field tech, in a tablet, and supports unity too. :-)
Doom demo is neat, but the hand and pistol look weird when you rotate the view.
i can´t wait for stuff like this to work in HD
It's not just a "lenticular" display, which is very old tech. No, it's a light field, which means that even with one eye closed, you will still be getting depth information in terms of focus. You should try adjusting the focus on your camera while a still image is being displayed. You'll see that while foreground images get blurry, the background will come into focus. That's nothing that any lenticular display could ever accomplish. It's also why light fields are so promising for VR and AR applications - they make it so your eyes can actually focus naturally on objects like they would in the real world.
I ordered two of them, they were suppose to ship two months ago... I hope they show up.
Doom. I love how it's always Doom.
I can totally imagine the year 2100 and the first thing they demonstrate in full dive VR is Doom.
It reminds me of looking glass in the newer Prey game. I'm sure this tech inspired the developers in the first place but most players probably never heard of it until they played the game.
Looks great for music visualization.
I was thinking, "that's a nice price!" at around 250. And I like the idea as well, but when I looked at the extra options I noticed I could add credits... ? Then I figured, it actually is costing credits (money) to convert a 2D picture to 3D. So... in fact I'm buying a product with an added subscription. That's a no-go in this case, it's not THAT useful to me. I would've bought it for 500 bucks without that.
And again... this cost is not mentioned by Tested. Just like the Star Trek built, not a good move (unless I'm missing something completely).
(Norm here) 2D to 3D conversion is not necessary for portrait mode photos. It’s an extra service to add depth to older photos and not something I tested or plan on using, because of cost
@@tested Ohhhh okay. That's cool Norm. That makes sense!
Yeah, the credits aren't necessary for providing your own 3D content or 2D content you convert with your own tools. Only for having them convert images for you. And I'm pretty sure anybody willing to grab one of these at this early stage is savvy enough to do it themselves.
@@tested Ah ok so I missed that, wasn’t very clear to me on their product page. But thanks for that info, I’ll be standing in the corner now. :)
What would be a cool idea, would be to take standard "3D" images - images taken at 2 separate viewpoints like how 3D cameras take their pictures/videos - and use AI to interpolate the rest of the frames needed to display this with all 48 pictures. There's new AI being showcased now that can make even a SINGLE 2d image 3D in a way(2 minute papers has some recentish videos about a couple of them!). There's a LOT of potential here if the average joe can put their pictures on here and have them turn 3D
a head cam while using this would probably be a good demo
Do a review of this in VR so we can see the effect!
Bruh I thought the looking glass idea and even the name was only a thing in Prey. We are living in the future goddamn
Gonna need a far bigger screen before this becomes truly useful
*changed brighter back to the intended word bigger
they have a few models included 32 inch 8k one
How can you tell how bright it is when you're looking at a screen through a camera lens and another screen?
@@pumpuppthevolume Yeah I just had a peruse on their website and your right. But that display probably costs more than most people’s home TVs.
@@AsherBC well it's for businesses museums and so on ...not sure if it's ready and u need a really powerful pc if I remember right
@@AsherBC Yep. That is the madness. There is a semi-trend of people making gaming tables for roleplaying that use displays for "maps", and more. Thing is, there are like 3 options - 1) a costly, heat generating, TV, stuffed into the table, 2) Some of the new 7 color e-ink displays, and 3) some version of this volumetric stuff. So.. The first, like I said, is power hungry, and generates a mess of heat, so.. would work, but, not optimal. The second, if you are stinking freaking rich, you "might" be able to have them make a custom size, for some insane price, that would fit the table, otherwise, there are lots, and lots of 5" displays, but designed in such a manner that they can't be really tiled, even if you could afford to buy something like a 30"x30" grid worth of them (though, imho, for most cases, this would be the optimal solution, if you could get the damn things). And, 3) A large enough volumetric display to fit in the same profile, but.. that actually would take up as much, or more, room than option #1, probably also generates heat, and uses a mess of power, etc. Its also, as you say, expensive as hell, but at least "on the market", more or less. Its only advantage is that you could use 3D.
But, basically, all of the options are.. either not yet available at a sane cost, or not available at all, or.. just costly, either in starting cost, or in cost of using them "after the fact".
Honestly, I would much, much, much, prefer the e-ink solution, for two reasons- 1) it would work like existing battle maps, so you could "add" all your 3D tiles, figures, etc. on top, and it only uses power, other than the computer needed to update the display, and that could be a freaking thin, low power, tablet, only when you update the display.
But.. unless you have a wad of cash, none of them are "feasible" for normal people "yet", with the semi-exception of the "put a TV in it" one, and.. yeah....
layered light, imagine a giant cube or rectangle in front of you soon.
I can't seem to find this "viral" video of Doom playing on it.
Me either.
Turns out someone remade the first level of doom and coverted it to 3d, and then attached the api, and that's what's shown here. Not actually Doom...
I’m still waiting for mine to ship, I can’t wait to mess around with it
Same, I get why it got delayed, but I wanna play with it!!!
Ah so the looking glass tech from the Arkane game Prey is real now 😁😁
Very neat device. I love og Doom. I have PC version and on Switch.
You have got to show us that keyboard Norm. 😁
The Nintendo 3DS does something similar. This product is expensive as hell.
Hope to find a used one on Craigslist...
The 3DS uses a simpler, narrower FOV stereoscopic screen that is really a 800*240 res.
similar in the way a viewing a zoetrope through a slit is similar to watching a tv. this is leaps and bounds over the 3ds ability to imply depth.
This would be an amazing way to digitally distribute 3d or 2.5d assets. Figurines, shadow boxes, interactive art would all be amazing to see, especially if a touch screen could be added for interactivity. A collection of 3d modeled Gundam with touch controls to manipulate the view would sell me on a slightly larger and higher resolution version of one of these.
I'm not too keen on crypto nfts, but this might be a perfect use case for bringing them into the real world. An open source community for these devices and truly decentalized storage might make for an interesting future.
I think it's something that I need to try before understand it's capabilities. But it works in portrait and landscape orientation? And the parallax makes this work for people with less than 2 eyes as well?
The effect is mostly inside and not outside?
It would be fun to use something like this with a Leap Motion. But having displays for one eye each like VR and some AR ideas seems to be the better approach.
But I doubt it would scale beyond this form factor since the parallax will be less.
What would be most interesting to me is how one could hack it. Like going beyond just the intended use of parallax and maybe take an artistic approach where some vires change the scene. Since you don't need a realistic model or animation. You could make all kinds of optical illusions where looking at a window straight let's you see through and any kind of angle blocks the light.
I believe their demoed a scene with a magnifying glass which managed to stun a lot of people.
The portrait (the main unit in the video), from my understanding, only works in portrait mode. So the display has to be vertical and you have to move your head left and right.
If you move your head up and down, or turn the display side ways and move your head left and right (which is the same optically as moving your head up and down while vertical), you do not get a parallax effect.
"The parallax makes this work for people with less than 2 eyes as well?"
The parallax will be visible by someone with 1 eye if they move their head. However I assume the effect they observe will be similar to what the camera is seeing in all of these videos, and thus what a user sees on a normal 2D video about the product.
"But I doubt it would scale beyond this form factor since the parallax will be less."
"Looking glass factory" have two larger models, one at 15.6inchs and the other at 32inchs. I can not vouch for the 3D-ness of these models due to parallax, but people in the RUclips videos I've seen looking at these displays seem impressed.
"What would be most interesting to me is how one could hack it. Like going beyond just the intended use of parallax and maybe take an artistic approach where some vires change the scene."
This should be relatively easy to do. One of the files you can upload to the looking glass portrait is a "quilt". It's just a collection of views from different perspectives. It's really easy for a user to understand and you can easily modify it to get the effect you want.
A previous display by Looking Glass definitely worked with both up and down as well as left and right movement at the same time, completely unlike any lenticular display I've seen. When I saw it I made sure to test this. I wonder if this newer version got simplified?
i just want this to be enlarged enough so i can watch youtube vids on
Regretting not backing... it was out of my price range. As a passive device it was too expensive. If I worked in 3d rendering, or engineering, it is an absolute no brainer.
As far as I know, it can work as a realtime display when connected to a computer (through Unity3D or Unreal Engine).
In standalone mode however, the integrated Raspberry Pi 4 can only show pre-rendered scenes.
It's a bit small for work I think (they have much bigger displays available, but costs several thousands dollars) but I'm curious to experience it for real and see what I can use it for (I'm a backer, can't wait to get mine !)
The looking glass is a _lenticular display_ (horizontal parallax only), not a light field display (full parallax / 6dof). It doesn't even produce consistent shapes like a volumetric display. (with lenticular displays things morph / flatten as you move around)
Don't get me wrong, it's really interesting in its own right, but I'm pretty tired of inferior technologies being upsold as something they're not. (it's not a light field, it's not volumetric, and it's not holographic)
To elaborate a bit: Different "3D" displays have different _dimensionality_ in terms of positions and angles.
A volumetric display is 3D. (3D position + 0D angles) It can accurately replicate shapes, but no view-dependent effects.
A lenticular display is also 3D, but a different kind. (2+1) This adds _some_ view-dependent effects / parallax in one direction, but sacrifices accurate shape outside of a sweet spot.
Then you have light fields, which are 4D. (2+2) Through the magic of optics, this actually gives you 3 directions of parallax (not 2 like you'd expect) with both view-dependent effects _and_ accurate shape.
That’s a great way of explaining it!
how about a 3d video demonstrating this?
good idea!
Can we get a larger one of these please for a pinball machine size.
Wow DOOM really does run on everything
"jiffy" is peanut butter
no, it's actually jif.
www.google.com/url?sa=i&url=https%3A%2F%2Fwww.amazon.com%2FJif-creamy-Peanut-Butter-16%2Fdp%2FB00DX53P4M&psig=AOvVaw2-ZPEb8-oZMR36JoTQWIw7&ust=1623650723430000&source=images&cd=vfe&ved=0CA0QjhxqFwoTCKjLj7j4k_ECFQAAAAAdAAAAABAD
Wait... would this make it less stupid to lean in front of a screen to try and peek around the corner?
You should try to use 3DS games on the screen since it already has depth info
I really want to see tilt brush drawings in it!
If someone was able to just sell a high definition lenticular lens that people can put on top of their own screens in combination with the software I think this technology would get ahead much faster due to everyone trying their own approach at making it better.
That belongs in a indie arcade.
Dug around on their site for a bit, looking for an answer. I'm on a PC, running linux. They mention many open source software programs but never clarify if their holosuite software is windows only. I suspect so, but I'd like to hope they support the open source community they draw upon.
cool stuff I don't see to many casual consumers buying this. Maybe I could see this tech being used in Theme parks like Disneyland or Universal on attractions.
Galaga!
LoZ, Lego Star Wars, Sim City, Worms, Left4Dead, and SKYRIM!!
*So that is a microlens array or only a vertical lenticular lens? And WHAT is that thick clear plastic part for? Is that literally only clear plastic acrylic with mirrors on top/bottom/sides laid on top of a microlens array and the LCD? Thanks in advance for correct answers!*
With the new phone lidar cameras you could FaceTime a hologram of your face in real time through one of these, like in starwars
Doom is at 15:00 if you want to skip the recap of what every other video has already shown.
This technology is really cool, but what are the realistic use cases that VR/AR doesn't do better? Digital picture frame is really the only thing I can think of. Even a shared experience (multiple people around a table) is going to be more versatile in AR with the added benefit of 360 degree viewing.
We can play doom using gifs, potatoes and even calculators, yet this still amazes me. What can’t doom run on.
Great video Norm but re holographic gameplay, Dejarik level holo-tech, is the holy grail of Holographic gameplay :)
Now I want pie.
Can't wait to get mine. They just delayed the second batch again due to the chip shortage. 🙁 My understanding is you can develop Unity/Unreal apps to run on it from a connected PC... (oh, Norm covers that later in the video.) _That gives me so many ideas._ ...besides just using it alongside Blender.
Can you make a little 3D demo to get a little better idea of what it looks like in VR?
Something to mention if individuals want to play with lenticular displays, go grab a used Red Hydrogen One. While the Hydrogen Network is gone and the LeiaLoft software is severely limited, it is able to take 3D video and photos.
I use mine as a 3D picture frame. Not bad for a $150 phone refurb'd. ;)
I have a theory that Red had wanted to use these as a 3D viewfinder for a line of Red 3D cameras but 3D died in popularity and the phone was way delayed so they gave up.
interested in your storage area? ikea cubby shelf and sterilte containers
$250 US for a 3d lenticular animated display is not too bad. The hardest part will be getting your own images onto it and making it actually look good. Its rough at the moment, so unless you take light field photos or work in 3d cgi it just wont look quite right.
What keyboard is that?
Norm has a whole video where he builds that. It's very fancy.
I kinda want this
is the array of images it presents horizontal only? or is there a vertical component (can you move your head up and down as well as side to side)
Unfortunately only horizontal!
@@tested interesting, do you know if that is any different for the 8k model they've shown? a few years back there was a lightfield vr goggles demo that was given at siggraph that used a very similar rendering method
@@tested ruclips.net/video/deI1IzbveEQ/видео.html
so its not quite ready yet for facetime/zoom
Ehhh. Too blurry to enjoy. I look forward to seeing this refined in 5 years.
You're not realizing that your looking at a 3D thing through a 2D screen
@@WillTesler and most of the blur looks intentional.
This would be amazing in an HMD
15:00 for Doom
when does the 4k 8K 55" TV versions come on with movies to support it or AI 3D Scaling