Comparing Spatial Video and Immersive Video on Apple Vision Pro

Поделиться
HTML-код
  • Опубликовано: 26 сен 2024

Комментарии • 94

  • @sfkeepay
    @sfkeepay 7 месяцев назад +12

    Wow, I really have to disagree with your assessment of spatial video. I can’t argue for the narrow field of view or the odd choice to blur the borders of spatial videos. But after using the AVP to capture two brief spatial videos of living subjects and viewing them with the AVP, I was blown away by the “almost there” realism I was seeing. The first video of me reaching out to pet our dog was jaw dropping. The second of me discussing the headset with my mother-in-law was so realistic it had me, for the briefest of moments, oddly displaced in time.
    I’ve been using VR for years so this isn’t mere newbie dazzle headed for rapid disenchantment. And though I concede your command of the technology and level of sophistication is self-evidently greater than my own, I am more than happy with this first-gen experience, to put it mildly. I suppose where we choose to focus, literally and metaphorically, also plays a large role in the delta of our reactions as well, but I maintain my enthusiasm.
    Disagreement aside, this essay of yours represents very solid, informed and worthwhile content, easily earning my subscription. Excellent work, and I’m looking forward to more.

    • @SpatialInsights
      @SpatialInsights  7 месяцев назад +3

      This is why it's great to have somebody like you comment. I've heard of other people having a great experience like you. It's good to share our experiences and compare notes. I'm starting to look into possible reasons why it works so well for some people and is not impressive for others. I hope I can find some answers and make a video on that in the future.

    • @sfkeepay
      @sfkeepay 7 месяцев назад +3

      @@SpatialInsights ,
      I confess it hadn’t even occurred to me that there may well be one or more relatively obscure, underlying causes for the difference in how folks see that content. So, instead of, or in addition to, a persons’ previous experiences - and current standards and expectations - perhaps something in how our physiology interacts with the technology? Boy, wouldn’t that be fascinating?
      Thanks for taking the time to reply!

    • @Instant_Nerf
      @Instant_Nerf 7 месяцев назад +2

      @@sfkeepayI believe it’s because some of us love sci-fi… Star Trek.. this device is bringing us closer to the holodeck. My opinion. Some don’t care about tech… and how it works .. they just want it to work. And for the end goal the AVP is not there yet. But we see the future with this device .. getting even closer .. it’s in our grasp.

    • @sfkeepay
      @sfkeepay 7 месяцев назад +1

      @@Instant_Nerf ,
      Another idea that I didn’t think of…and you’re right that it brings a holodeck that much closer.
      I’m starting to wonder, though, if a holodeck is really where we’re heading. It seems to me more likely that we’ll manipulate our senses rather than mastering electromagnetic fields to create solid objects. I don’t think this is a good thing…it seems probable to reduce or altogether eliminate our connection to the real world, including, maybe, our own physicality. An implanted synaptic transceiver will provide an entire reality, divorced of maybe all struggle, striving, hardship, or genuine accomplishment. A holodeck is a much more balanced and grounded approach; I just doubt we’ll have the patience to wait.

  • @mrpmj00
    @mrpmj00 22 дня назад +1

    Yep. Apple Vision Pro is on a another level, kind of like how we went from corded phones to desktop pcs, to analog wireless phones, to flip phones, to smart phones.
    - I can imagine air traffic controllers and the military will find the Apple Vision Pro useful to show many screens simultaneously that are 150-400 inches each...that's a lot of information.
    - Current F16 figher helmets are $400k each with just a HUD, whereas the AVP could be incorporated into a helmet for far less than $400k.
    - Infantry soldiers wearing a helmet with the AVP.
    - AVP's passthrough is 120 degrees which allow real world interaction with the firearm, target, throwing/catching.
    - I want to get the Apple Vision Pro, it's not that expensive compared to a great home theater, and people don't realize that it's got eye tracking (no mouse cursor), an 8k screen, many many 300 in screens, 3D camera, spatial audio speakers, creates an Imax or the biggest commercial theater screen size even when you're sitting in a tight coach airline seat.
    - the eye tracking (replaced a cursor) us a game changer.
    - way easier to develop than Facebook Quest.
    - AVP is not constrained to a box game model like the Quest, instead the AVP world model is infinite.
    - air traffic controllers can see the perspective of a commercial plane pilot landing.
    - The AVP's many many virtual 150in-300in screens can replace a commercial airline cockpit's many physical screens, and that physical space can hold more important physical equipments.

  • @bobbyDig
    @bobbyDig 6 месяцев назад +4

    I've been shooting VR 360 and 180 for years. My RUclips channel is filled with them. When I saw a Spatial video, it was a game changer for me. My content comes alive not just get bigger. The winner for me moving forward is Spatial Video. It gives me the realism that I wanted in my work.

    • @SpatialInsights
      @SpatialInsights  6 месяцев назад +2

      It's interesting to see how different people react differently do it. I have to wonder how resolution, framerate, and window size effect our opinions.

    • @bobbyDig
      @bobbyDig 6 месяцев назад +1

      @@SpatialInsights I am happy with the resolution, frame rate, and window size. Not an issue. Also, I know it is going to get better in time.

  • @hasanaydn1116
    @hasanaydn1116 7 месяцев назад +2

    Great explanatory video. I don't understand why not more people are interested in this aspect of Apple vision pro, instead they talk about openin safari, browsing web. Things you can already do pretty well with other devices, without weight on your head. To me, the most intriguing aspect of a VR headset is fully immersive, 360 videos, preferebly 3D. I look forward to first ever 360 degree, 3D Hollywood movie, that I will live through for 2+ hours.

    • @SpatialInsights
      @SpatialInsights  6 месяцев назад +2

      Using VR or immersive video to share experiences is really what I'm most excited about, too.

  • @OpeningsOpenings
    @OpeningsOpenings 7 месяцев назад +3

    THANK you for this review. The best detail I’ve seen here so far.

  • @christianlamb
    @christianlamb 11 дней назад

    Solid vid!! ❤ thankbyou. Seems things have evolved a bit since this vid. There are some budget friendly 180 3d video cameras now and quest 3 now plays spatial vids. I love viewing 180 immersive vids on quest 3 like Daivid Attenboroughs nature vids and The Faceless Lady horror show is fantastic.

  • @therestorationshop
    @therestorationshop 5 месяцев назад

    I see the "windowed" spatial videos as being previews and once you're sure you have the right one you go into full immersion.
    I agree with you that the Immersive Videos are incredible. Really good stuff.

    • @SpatialInsights
      @SpatialInsights  5 месяцев назад

      Not bad. But, with more time, I've found that widescreen spatial videos shot on the iPhone look pretty bad in that immersive mode. But square spatial videos shot on the Apple Vision itself actually do look pretty good in the immersive mode. We have more info in another video - "3D Spatial Video - Easy Tips for Apple Vision Content Creation"

  • @KevinPrimus
    @KevinPrimus 6 месяцев назад +3

    This was great. Just subscribed. Looking forward to future videos from your channel!

    • @SpatialInsights
      @SpatialInsights  6 месяцев назад

      Thanks. We definitely have some ideas for more content on the way.

  • @michaeldibb
    @michaeldibb 2 месяца назад

    The Qoocam EGO is a 3D stereoscopic camera ($300) that can shoot 1080p 60fps video and 12k 3D stills. Its compatible with the Apple Vision Pro

  • @BPMa14n
    @BPMa14n 6 месяцев назад +1

    Good explanation personally I heard of spatial video so I grabbed my quest 2 in the native RUclips app and found some great spatial videos people uploaded with their iPhone as well as some immersive 180 vr videos from professionals very hd and amazing. This is good for the industry and hope to see some cool content in this channel to watch in vr

    • @SpatialInsights
      @SpatialInsights  6 месяцев назад +1

      I look forward to when we can share and view VR content on RUclips for the Apple Vision like you can for Quest. We have ideas for actual VR content we want to produce.

  • @Zaburi
    @Zaburi 7 месяцев назад +1

    Great info! Thank you! I have been trying to find a way to watch my VR footage and you helped me. Best wishes.

  • @kristong
    @kristong 3 месяца назад

    Thanks for sharing. I just started playing around spatial video and watch them on Meta Quest 3. I feel like the spatial video's only advantage at this moment, is that we can shoot it with an iPhone, a device that's already in everyone's hand. Otherwise, if I am a professional content creator, I would just go for VR180 and shoot with a dedicated camera. Spatial video is just like a "lite-version" of VR180, with less FOV.

  • @theden0minat0r
    @theden0minat0r 7 месяцев назад +1

    I was delighted to find your video. You did a fantastic job! I appreciate your efforts to create content in this area. I share your frustration with the lack of consumer options for high-quality VR180 and 360 video. The current 4K and 5.7K cameras are not enough for content creation. They are close to being immersive, but the resolution is too low to produce clear and sharp videos. Everything looks blurry and faded at those resolutions. I have been longing for a native 8K VR180 consumer video camera for years. I think 8K will finally deliver the immersive video quality that online viewers expect. I heard that Canon is developing a camera that might suit this need. There is also an interesting project by a RUclipsr named Shawn Ide Studios, who has built a 3D printed camera rig with two Go Pro Hero 10 Black cameras mounted vertically with max lenses and media mods. It seems to work very well, but I don't know what software he uses to stitch the two 4K videos together.
    ruclips.net/video/QdMCecyZWqA/видео.html
    ruclips.net/video/2B0jX912Lfw/видео.html
    All the best!!

    • @SpatialInsights
      @SpatialInsights  7 месяцев назад +2

      Thanks for the links. I'm very interested in checking that out. I'm anxious to have a camera that is affordable and works out of the box. I plan / hope to test some options and share what I find back here. I'm not 100% certain, but I think that a high framerate (60fps+) may be just as important, if not more important than resolution. That's not a firm conclusion, but I want to look into it. I do think the next year in this space will be exciting.

    • @danieljackson6787
      @danieljackson6787 5 месяцев назад +1

      Check out Mistika Boutique for VR180 (and other VR formats) for post production.

  • @MarlonBos
    @MarlonBos 6 месяцев назад +2

    Thanks for the insight on IV! I've created this subreddit to find out everything about IV that's available, especially trying to decipher the workflow, camera system used, and post-production, etc.
    r/AppleImmersiveVideo

  • @BigStereoVR
    @BigStereoVR 4 месяца назад

    You can shoot immersive 180 video, with a pair of gopros. NLE programs with ai models have excellent upscaling and HDR conversion these days.

  • @stephenbard1590
    @stephenbard1590 7 месяцев назад +1

    This guy bypasses iPhone and the AVP Itself in favor of the Canon Dual Fisheye: ruclips.net/video/BHtKOxGEiAw/видео.html

  • @mr152
    @mr152 7 месяцев назад +2

    Thanks for all the great info. Also, another video player I prefer for spatial video and VR180 video in my Quest 3 is 4XVR.

  • @bujin5455
    @bujin5455 7 месяцев назад +2

    If you go with the Canon solution, make sure you get the R5C, and not the R5, or R6, etc. The 5RC supports 8K60, which is what Apple shot in, without time limits, and it will not overheat.

    • @SpatialInsights
      @SpatialInsights  7 месяцев назад +1

      Thanks for the advice. For me, or anybody else who may be thinking about that solution, this is important information.

    • @HolzmannMedia
      @HolzmannMedia 7 месяцев назад +1

      I have the Canon R5C with Dual Fisheye Lens. 8k Resolution is not what I am expected. Your viewing frame in the center of VR180 will be less than 1080p. That looks ok in a Meta Quest headset, but I assumed that it will not in the AVP. I am from Europe. Actually no access to an AVP.

    • @HolzmannMedia
      @HolzmannMedia 7 месяцев назад

      @@bujin5455 - 8k is not per eye. With the Canon solution you got two circles for both eyes in your 8k frame (8192x4230). You have to stich each of these circles to a 4096x4096 frame.

    • @HolzmannMedia
      @HolzmannMedia 7 месяцев назад

      @@bujin5455 - in the center of each 4096x4096 frame per eye is the viewport of your headset.

    • @bujin5455
      @bujin5455 7 месяцев назад +1

      @@HolzmannMedia 1080p at what size and what distance? This is all about pixels per degree (PPD). The 8k is being spread over 180 degrees, so that gives you a PPD of 43, the AVP's PPD is about 34, so 8K is definitely more good enough. Though 4k would not be sharp enough to provide full quality, as it would only have a PPD of 21.

  • @pumpuppthevolume
    @pumpuppthevolume 7 месяцев назад +2

    they don't fill your fov with the video because the hardware used to film it is not good enough for that ...res would look even worse

  • @ziliangchen03
    @ziliangchen03 3 месяца назад

    Qoocam ego seems to be a good cheap option

  • @emirgulerhan
    @emirgulerhan 6 месяцев назад +1

    such a good video

  • @ExplorePOV
    @ExplorePOV Месяц назад

    Hey I've just stumbled across this video and see it's from earlier this year - really interesting though in what you were saying about there being no way to distribute or view content on the Vision Pro - these were all the problems I was facing at the beginning of the year and so I decided to just make my own app. My backgrounds in videography so I had zero coding experience but was just really keen to find a way to share my content with the world. I launched Explore POV on Vision Pro earlier this year, offering 16k immersive videos - think riding a camel in the Sahara desert to hiking in the Swiss alps. It all started as a passion project but people seem to like it. The apps had over 25,000 downloads and 100s of 5 star reviews. Would love to hear your thoughts if you haven't already checked it out.

    • @SpatialInsights
      @SpatialInsights  Месяц назад

      I’ve definitely seen Explore POV and I love it! You make great videos and I think you’ve found a great way to solve the problem with distribution. For the past few months, I haven’t been able to do any work on this channel. But, I have some projects in mind. Please let me know if you have any interest in collaboration, discussing workflows, or comparing notes on projects. Vision OS 2 is coming soon and I’ve got a lot of ideas.

    • @ExplorePOV
      @ExplorePOV Месяц назад

      @@SpatialInsights Thank you, it's so cool to hear you've seen Explore POV! Feel free to shoot me a msg when you're back working on the channel with what you want to collab on.

  • @Jondaveqqq
    @Jondaveqqq 3 месяца назад

    Can you use this device to upload spatial videos to the quest 3 and if so how do they compare to the spatial videos on the avp?

  • @dlep2004
    @dlep2004 3 месяца назад

    thanks for the video, very well researched and put together. A quick question here, have you managed to try any of those immersive video workflows (not spatial). I'm blown away by apple's demo immersive videos, and want to create my own. But i would like to know a proven workflow (say from Canon's dual fisheye lens to vision pro) before making an investment in those cameras. thanks!

    • @SpatialInsights
      @SpatialInsights  3 месяца назад

      I have not done that. My mission with this channel is to talk about production methods that are affordable and accessible. I think there’s a lot of potential and I’m hopeful that more cameras are coming soon. The Canon dual fisheye kit is exciting. But it’s a $6000 - $8000 investment. And from what I’ve seen there’s no way to share those VR 180 videos on RUclips in a way that people can easily view them on the Apple Vision at full quality. At WWDC yesterday, Apple mentioned a new VR camera coming from Blackmagic, which will probably be another big and expensive option. More info coming later this year. I’m more excited about their announced partnership with Vimeo, which may give us the sharing platform we need.

    • @dlep2004
      @dlep2004 3 месяца назад

      @@SpatialInsights thanks for the reply! Agree that both the EOS and Blackmagic are too expensive for an average consumer. Good news is Canon just announced a more affordable one, R7 (~US$1300) with a new apsc VR lens (around ~1300). Looking forward to this new option

    • @SpatialInsights
      @SpatialInsights  3 месяца назад

      @@dlep2004 Are you referring to the Canon lens that was announced at WWDC yesterday? According to the information I’ve seen, that is not used to shoot VR. It’s designed to shoot “Spatial” video. Apple’s format for 3D video. Not 180 or 360 VR. The Blackmagic camera is for VR.

    • @dlep2004
      @dlep2004 3 месяца назад

      @@SpatialInsights that, but also another 3.9mm dual lens (looks like the 5mm something two years ago, different from the one from the keynote), is for VR, 3D 180degree (transformed from 144 degree originally from the lens), for apsc camera.

    • @SpatialInsights
      @SpatialInsights  3 месяца назад

      @@dlep2004 Yes! Wow. I just saw that last night. That is very interesting. I'd really like to try that.

  • @JavierYunes
    @JavierYunes 6 месяцев назад +1

    I've been recording VR180 with a insta360 evo since 2019. I think the spatial video looks amazing and pops out of the screen when filmed correctly. I disagree with your perception of them. Maybe because I'm watching then on a quest with a bigger window. The field of view of a spatial video shot with an iPhone compared to VR180 is crap though.
    Watching VR180 on RUclips is not great. The compression is very visible. But it's easy to access.

    • @SpatialInsights
      @SpatialInsights  6 месяцев назад +1

      Yeah, I'm really hearing more and more that some people are very impressed with spatial video and some are not. It's great to hear different perspectives.

    • @JavierYunes
      @JavierYunes 6 месяцев назад +1

      @@SpatialInsights can you do a comparison between watching a spatial video on the quest and the AVP?
      Is there any difference? If you take a step back on the quest while watching the video, you get a better 3D effect but a smaller screen size.

    • @0LoneTech
      @0LoneTech 5 месяцев назад +1

      A downside to the Insta360 Evo is that it doesn't record continuously. Every once in a while, it takes a break while switching output files, about 8 seconds long. If that was documented it wouldn't be so bad, but Insta left it as a trap for their customers, and then have the gall to tell us it's a feature after they've chopped holes in our recordings. They're not going to fix it, and it's left me with the feeling I should expect random breakage from any product of theirs.

    • @JavierYunes
      @JavierYunes 5 месяцев назад +1

      @@0LoneTech I've never noticed the 8 seconds. I've recorded long files without hiccups. I do think the company sucks for their lack of support to their products and the awful apps.

  • @steveallen8987
    @steveallen8987 6 месяцев назад

    Vuze xr 3d seems good

  • @immerpsive
    @immerpsive 7 месяцев назад +3

    Hello, I am creating VR180 Video with 2 Gopro12 (8K 30/60fps) Total budget under 1000 USD ;)

    • @SpatialInsights
      @SpatialInsights  7 месяцев назад

      That's interesting. I'll look into that. I'd really like an out-of-the-box solution. But, it could be fun to set something like that up.

    • @0LoneTech
      @0LoneTech 5 месяцев назад

      If I understood correctly, the Hero 12 has wireless timecode sync, which can assist somewhat. I don't know if it manages continuous sync like a genlock though.

  • @Instant_Nerf
    @Instant_Nerf 7 месяцев назад +1

    Why not VR 360?.. low quality?

    • @SpatialInsights
      @SpatialInsights  7 месяцев назад +3

      I'm not a fan of 360 for a few reasons. First - it's much harder to shoot. Either the videographer is in the shot, or they have to start the recording and walk away. Also, in filmmaking for storytelling, there should be an area of focus. In 360, you could have a story being told to the north, while the viewer is looking to the south. But, 180 feels like you're looking in one direction with an incredibly immersive field of view. Having said that, apps that support 360 playback usually support 180 as well. If you prefer 360, many of the same production techniques should apply.

  • @Agata-Wow
    @Agata-Wow 6 месяцев назад

    Nick, is there any change to get in touch with you personally?

  • @bobcubsfan
    @bobcubsfan 5 месяцев назад +1

    I don't like the square format for videos

    • @SpatialInsights
      @SpatialInsights  5 месяцев назад

      With some more time, I've found that the square format spatial videos do look pretty good in the Immersive viewing mode. It might be worth trying. We have more information in another video "3D Spatial Video - Easy Tips for Apple Vision Content Creation".

  • @PSYCHOV3N0M
    @PSYCHOV3N0M 3 месяца назад

    If you're using an iPhone 15 Pro to record 3D videos, you're doing it wrong.
    Recording 3D videos with the Apple Vision Pro offers greater depth which blows the iPhone 15 Pro out of the water.

  • @yountune9799
    @yountune9799 3 месяца назад

    Check with the porn industry. They have huge amount of immersive video content. Ask them what camera they're using. Their standard file is mkv for the immersive video with either file naming conversion or metadata. I think Windows apps like Power Director has VR support. Turn flat videos into immersive video but I don't think you get the 3D effect.

  • @bobcubsfan
    @bobcubsfan 5 месяцев назад

    The blurred view is really terrible.

  • @Bil30321
    @Bil30321 5 месяцев назад

    How does this video look in Apple Vision Pro immersive?: m.ruclips.net/video/gw4AuT2PD34/видео.html. It cost nothing to make, using Blender 4.0 and free SketchFab animation.

  • @pumpuppthevolume
    @pumpuppthevolume 7 месяцев назад

    look up Hugh Hou

  • @stephenbard1590
    @stephenbard1590 7 месяцев назад

    You are trying too hard to make this "spatial video" thing work as constrained within the Apple ecosystem. Obviously the poor "depth" of the 3D taken with the iPhone 15 Pro is completely unacceptable. You can get much better 3D with the $350 QooCam EGO than with the iPhone. 3D videos taken with the AVP itself almost need a head tripod to be stable. So, if you want to be a professional 3D videographer doing "immersive videos", the best results require no overpriced Apple products at all. You need one of the VR 180 cameras you mentioned and you can easily view every type of 3D format on the Quest 3, where it looks 98% as good as on the AVP. Obviously, 99% of the people viewing your 180 immersive videos will be doing so on a Quest headset, and a few will even be using the incredible new Lume Pad 2 glasses-free 3D tablet!

  • @sharonb.9128
    @sharonb.9128 7 месяцев назад +4

    Are you associated with any product or company in direct competition to Apple? I believe you must mention any sponsors or affiliations in your video. You seem to have an agenda here.

    • @IamNiggler
      @IamNiggler 5 месяцев назад +2

      He's on the payroll obviously

    • @j.a.1873
      @j.a.1873 4 месяца назад +1

      There’s no need to be associated with Apple’s competitors to speak facts. I love Apple but unfortunately the AVP has a long road ahead. It’s limited, expensive and heavy. He’s just sharing real facts and hopefully Apple improves the product in the future. The Spatial Videos are not even 4K unless you record them with third party apps

    • @sharonb.9128
      @sharonb.9128 4 месяца назад

      @@j.a.1873 this AVP was intended to be the beginning of the process, not the end. Apple did not stumble into this like some want to believe. It’s not heavy relative to many other headsets. Even if it was, it’s not a fatal flaw and a different band will quickly remedy the problem. This device has a limited supply. It comes with a high price tag to control demand. Companies do this all the time with limited, cutting edge technology. Apple released it mainly so enterprise and developers can begin designing their spatial computing business models. And it’s happening.