Apple's New Camera Could Revolutionize 3D and Vision Pro
HTML-код
- Опубликовано: 9 июл 2024
- Apple has taken a bold step back into the camera industry with a twist, unveiling a collaboration with Blackmagic Design at WWDC24 to produce a groundbreaking professional digital film camera. This new camera, based on Blackmagic's URSA Cine line, is designed specifically for immersive stereoscopic video capture, signaling a significant move towards advancing Apple's Vision Pro headset and broader video production technology.
The Vision Pro headset, despite its high price tag, has been praised for its media consumption capabilities, creating an opportunity for Apple to integrate this new camera technology into its ecosystem. By providing a lower-end entrance into 3D video capture with the iPhone 15 and a high-end solution with the URSA Cine, Apple is positioning itself to dominate the 3D content market.
As Apple continues to innovate and integrate these technologies, the future of 3D content creation and consumption looks promising. Whether for cinematic experiences, sports events, or immersive storytelling, Apple's vision for 3D technology is set to reshape the landscape of digital media.
Join our RUclips channel by clicking here: bit.ly/3asNo2n
Find us on Instagram: bit.ly/3PM21xW
Find us on Facebook: bit.ly/3t2Huvb
Find us on Twitter: bit.ly/3wQfXzA
Find us on TikTok: bit.ly/3wNsBOu
Get the latest stories: interestingengineering.com/
Support IE for high-quality journalism: interestingengineering.com/su... 
Наука
Zumindest hat apple für einen enormen Schub für die VR gebracht . Bin von der 3d Möglichkeit der Vison Pro begeistert
Great video! I have at least 20 years of 3D photography experience. Part of the challenge of seeing 3D is some people’s eyes are not perfectly matched. That’s where careful eyeglass design can help. So a local ophthalmologist (eye doctor) and optometrist (eyeglass maker) can truly be your best friends!! Apple Inc and other companies probably know this factor. To put it simply: If you learn how to fine tune/adjust binoculars to give great telescopic vision, then you are on your way to new 3D viewing technology.
i am not sure mass audiences will be up for those hurdles.
great video edit thankss
ChatGPT is so obnoxious. So many words with such a little point.
Wow wow I love these camera it good for 3D wow.
Stereoscopic is not the way forward. You really need some level of 3 or even 6 DOF for it to really be revolutionary.
This will require the adoption of multiple light field capable cameras / or other tech ( Gaussian splatting maybe? ) covering each shot in a film for it to be a breakthrough in immersion.
Once this happens you would literally be able to enter the scene in a movie and move around in real time choosing the angle / perspective you want to watch the film at.
Light field cameras are difficult to pull off at any reasonable resolution due to the additional sensor space the sensor pixels need for gathering the additional information per pixel. The reason this tech mostly died is because of "Deep" equivalent tech used in VFX. While Deep used markers on sets along with a stereo cameras to generate a near perfect depth map for real world scenes, there have been additional advances in visual processing that can reproduce near identical maps on the fly with just stereo camera imaging, and even to a lesser degree with a single camera viewpoint along with AI; however, with AI in the picture it's only a matter of time before a model exists that functions in conjunction with stereo optics to produce an equivalent map on the fly. It's quite possible Apple and Blackmagic will be collecting that kind of information with that camera, because the camera will have gyro information along with known relative positions of where both the sensors and the lenses are and how they will perceive the environment. Basically there is a good chance this camera will have the ability to gather light field equivalent depth information with out any of the limitations of light field already; however, until we have this in our hands to try out it will be difficult to say for sure, except that Blackmagic is making an update to their editing software DaVinci Resolve specifically designed for this camera, and DaVinci Resolve Pro has a built in Neural engine, and can already generate single camera depth maps fairly effectively, and also has deep processing in it's current iteration. So this next step shouldn't be much of a leap for them. The big question is if the Vision pro's eye tracking can dynamically manipulate the depth information based off there eye positions and movements and dynamically adapt the users focal point and relative blur for dynamic focal plane shifting like our eyes actually do. They have done it for the physical direction already, but if they can do it to this next level then they might really have conquered the last reality breaking aspect of the stereoscopic 3D experience. only time will tell.
@@billyoung9538resolve is great but my experience using depth maps created in Resolve and other ai technologies is only able to produce depth maps capable of maybe 10-15 degrees max of movement before the image falls apart.
While companies like Lytro failed I still believe light field technology has a future if picked up and further developed at some point. If not then multiple cameras that can create images designed to be processed though Gaussian splatting could provide very high fidelity motion picture capture. It would just be a lot of work given the present day state of the technology.
I just don’t see stereoscopic revolutionizing anything at this point. It’s been in use in entertainment for a century and it never really catches on.
@@billyoung9538 Great comment. I'd also add that the iphone pro models have a Lidar scanner, which projects numerous lasers to create a 3D depth-map of a scene. This could be useful information for the iphone's spatial video if they were to try to give the video limited 6DOF.
@@joelface Lidar is getting better, but it's biggest limitation is distance. Most consumer level Lidar systems are only good out until around 20-30 feet. Past that there are just not enough "rays" reflecting back the the Lidar to give accurate depth. If one is interested in the mirrorless camera & cinema camera world DJI recently released one of the best Lidar systems for focus pulling to date, but it runs into this same distance limitation. This is why phase detect autofocus is still considered better in well lit situations. Neither are perfect, but both these technologies can be useful towards aiding in build a more accurate depth map. That said I doubt either of these are going to be use in the Blackmagic camera because they've never used that type of tech in their cameras in the past, and typically it takes a few iterations to perfect it.; however, we know very little about exactly how that camera is going to work yet. I think Lidar and phase detect AF information might be more useful on phones for accurate close up information..
Great technology for certain fields. In the consumer field there is no real need (they will create it) and looking through this thing for hours will harm you eyes and makes you dizzy.
Excellent 👌👌
Seriously, we’ll eventually have “Apple Sight”
Which will be a cybernetic enhancement surgery.
Where you (actually thankfully) don’t have to replace your current eyeballs, (unless you want to?) but the enhancement will instead be connected from the advanced optic to your neural visual processing centers.
Valerie Thomas from NASA!
Everyone will have one by 2030
Your videos are way too "styled". The wiggling color shapes serve no purpose any are just annoying.
This is very 90s style.
the video states right that all approaches of 3D never endurance long, but is claiming that the future of Apple will be in 3D. Won't happen! I'am working in the VR tech and know that just taking two camera pictures are not enough. you cannot move you head, just turn. And that always feels unnatural.
As the Vision Pro is targeted at windowed viewing, it's likely that their approach to 3D will continue to be more like traditional 3D cinema, basically shown on a large screen.
@@InterestingengineeringofficialSo will fail just like 3D cinema did too. Basically people don’t want things strapped onto their faces, until they overcome this then it will fail time and time again.
@@MrSeanroberts1969and that’s exactly what Apple is trying to change and it’s very likely that they will succeed.
Since they’re very good at “normalizing” devices…
@@JoshSher_ Dream on, Apple are very good at re-marketing other companies ideas / products and calling it new. It's all a spin but people soon get bored of that especially when they try and charge then $3500 for a dev device that can do less than a $1200 macbook. Apples problem is they have become complacent and run out of things to copy, sorry i mean innovate so they are throwing things at the wall to see what sells. Vision pro will be dead in 5 years max.
@@MrSeanroberts1969 you mean die like the Apple Watch or the AirPods? it’s still very early on… it’s still a Pro version, they will release cheaper versions.
It’s not obvious yet how it will find the way into our everyday life. If it’s through home office or movies or games or all of it. Or maybe in a way we don’t know yet…
But yes, let’s talk again in 5 years. I’m excited to see what happens (not denying the possibility of it dying, but I’m optimistic)
With a 3d-conversion software you don‘t really need a 3d-camera. The results are good right now and will be much better in the future. 3d will return, because it‘s so simple to create and it looks fantastic!
Just get BRAW in FCPX plz
or hear me out, we forget trying to sell your overpriced AR goggles and just add ProRes Raw to Resolve.
Read the TOS for this thing. It’s unbelievable even for Apple standards
what do they say?
iCame
Black magic design IS NOT A HIGH END MANUFACTURER!!!!! --- Arri - Red- Sony(Venice2) ARE !- NOT BMD that really rattles my cage
They make affordable high end cameras. they probably could (and should) make a 50k cine cam that rivals the Arri/Red/Sony without any of the problems that are usually associated with Blackmagic but i dont think they want to. They are very much in the game of bringing thehighest quality possible for the lowest price.
@@vicious12394those of us who are not inside the the monkey cage, sorry for rattling your cage. I have shot footage that you could not tell what camera I shot it on . Red is no more, Nikon is pulling the chains now
High end has nothing to do with price but yeah sure let’s go with that logic
I thought they discontinued the 3d Goggles?
You can't even name them right
their products are already problematic and unreliable i dont think i want their cameras
Awesome!