How To Try Apple Vision Pro Spatial Videos Right NOW!
HTML-код
- Опубликовано: 15 ноя 2023
- I show you how to capture and view spatial videos for Apple Vision Pro using an iPhone 15 Pro and a Quest 3.
Download my spatial video clip of Ruby here;
www.dropbox.com/scl/fi/9t7r9v...
Download my spatial video clip of the Quest 3 here;
www.dropbox.com/scl/fi/rjfsg2...
Download Test Flight from the AppStore here;
apps.apple.com/us/app/testfli...
Download the Spatialify app here;
testflight.apple.com/join/EEF...
Let me know what you think of this glimpse of Apple Vision Pro's spatial videos in the comments below...
Thanks for watching []-)
VR HEADSETS:
Meta Quest 3: bit.ly/3SCGtWF
PlayStation VR2: amzn.to/48RAFQx
Bigscreen Beyond: bit.ly/3IiI3cz
VR ACCESSORIES:
VR Cover: bit.ly/3okrLmq
ProTube: bit.ly/2sujHb3
FOLLOW ME:
Subscribe: bit.ly/2VeBqfJ
Memberships: bit.ly/2MVWxRl
Discord: / discord
Twitter: / vr_oasis
Instagram: / virtualrealityoasis
Facebook: / virtualrealityoasis
Website: virtualrealityoasis.com/
Email: contact@virtualrealityoasis.com
#AppleVisionPro #SpatialVideo #Quest3 
Наука
Wow - that video looked WAY better than I imagined it would with the limited distance between the two lenses used to capture it. Thanks so much for taking the time to post this one Mike!
Thank you mate. I’m glad you enjoyed it []-)
That spatial clip is truly impressive.
I just watched the video on my Q3 and i was blown away, this is incredible, as a filmmaker i really see how this will change videos and movies forever
Nice. Glad you enjoyed it mate. This medium has so much potential in the future, especially as it will be accessible to everyone and you no longer need a dedicated (and expensive) VR camera []-)
Why? It’s just a 3D video.
@@TonyHogarth yes, but seen in a vr headset is far far superior from just seeing that at the movies, also now you can shoot them with a phone, i mean, just wow
@@eliapavoni2275 I like the idea of shooting quality 3D vids with my phone but I’ve been shooting full 3D 180 degree videos for the last two years with my Vuze XR which are far more immersive.
@@eliapavoni2275 FYI, There was LG Optimus 3D, a smartphone that could capture 3D video.
Actually, every 3D videos can be seen in vr headset. People watch 3D movies together on apps like Bigscreen
Just tried it. I don't think this is what Apple's spatial videos will look like. This just looks like regular old 3D movies. Feels like wearing 3D glasses at the movie theater. I think Apple's version will have more depth. I think they'll use the lidar scanner to make objects in the video actually 3D.
The problem is that the accuracy is quite low compared with image files. Modeling isn’t an option and Apple has yet to use AI in rendering
I think they’ll look just like this for now, but perhaps with more parallax included that isn’t able to passed to an SBS file on the Quest 3. Will be exciting to see how this improves with future iPhones!
but the low quality is telated to iphone 15 camera or the fact its played on quest 3? i am buying iphone 15 to record all videos in 3d from now on! I would be happy if quest 3 is enough to enjoy 3d videos.
They don’t use LiDAR in the captures
Did you watch it ona Quest 3 or a Quest 2?
appreciate the uncompressed video downloads, the quality is super impressive!
Nice. I’m glad you liked them mate []-)
This is awesome! I can’t wait to try it tbh
Thank you for the video!! Looked amazing!
I was curious if those videos would work on a quest. Thx!
Just got round to watching this and downloaded your clip of Ruby. Very cool. I'm tempted to switch back to iPhone 😁👍
Great! thanks for sharing the video of your beautiful dog!
Great demo videos! Once you can record and upload all your videos to youtube like this in this quality it's going to change the way things are reviewed going forward. I noticed the further away I watched the video the better the 3D effect looked. Also, you can tell your dog is extremely well behaved.
This is the best tutorial for watching special videos on my quest 3. Thank you’d! Cheers from Minnesota!
Great video Mike - thanks for putting this together. Just tested on the Pico 4 and works / plays like a charm. Sure beats my old Lenovo Mirage 180 camera output.
that is so cool. thanks. I'm actually blown away at the video quality. Most real-life 3D videos I've viewed on the Quest 3 aren't as sharp.
Thanks for uploading the video! Your dog is much calmer than mine. The stereo separation is really good, even in the back of the video near the fence. Perhaps Apple is doing some image processing on the phone to increase the "IPD" of the cameras? Just wondering how the 3D videos from the Iphone compare to those captured with the Vision Pro who's cameras are further apart.
Man we need 360 spatial video. Insta360 really need to get something going
It made me smile with joy. Thanks for sharing this!
This comment made me smile. Thank you []-)
Hugh Hou showed how you can upload those clips directly to RUclips although it's even more hoops to jump through. Also can record in 3d directly on Q3 although from what I saw in his clips it looks better on iPhone despite being limited to 1080p.
You can enable 3D video capture on Quest 3 as well with some dev settings if you haven't tried it yet. Someone made a video about it recently.
Thanks Mike.
This is great.. thanks for sharing.
Could anyone provide insights on the best methods for sharing videos of this nature? Also, does anyone know if RUclips is compatible with this file format and offers support for it?
Hey Mike, Greetings from Fullerton, California! As a long-time Oculus-Facebook-Meta VR Headset User moving up to my Quest 3 in mid-January, I'd really like to see you using your Quest 3 to record full side-by-side 3D videos too. A few other folks here on RUclips have been doing this, and the results are awesome. So how would you feel about checking out the techniques being used by others to record their stereo 3D video, so you can make some for a Quest 3 to Apple comparison? Meta originally said the Quest 3 would only do 2D videos, but actual Users are recording 3D videos thanks to 3rd-party apps and Sidequest; so I know you will be able to do it too! I'm looking forward to your experiences! Your follower, Will Hart
Really blown away with the quality, we use a Insta 360 Pro 2 at work and the 180 degree and 360 degree 3D video from that is amazing and a lot more immersive but not as sharp at any resolution you can play on a Quest. It could be a really interesting space coming up with this shooting style of more traditional cinema format 3D content, the flat 360 degree cameras (no 3D) and then the fully immersive 180 and 360 degree 3D content if the "Apple effect" kicks in and makes these formats more mainstream!
I think just being able to shoot footage like that of your dog, a relative, something on a holiday or an important moment in your life (like your wedding or a birthday) with the device you always have with you and being able to view them years later in full 3D is very powerful. I also hope Apple themselves make it easy to export for other headsets and don't try and lock this to the Vision Pro only. At least we already have devs with solutions if they do.
Did you not notice that it’s an mp4? And that the conversion tool used makes it either sbs or over/under, like ALL 3d players use already? Not to mention that if it was locked down, you wouldn’t be watching this video right now…
@@michaelburns4020Hi, maybe locked down was a bad choice of words, it’s more that the native MV-HEVC format they’ve gone with currently isn’t supported by Meta headsets or Adobe software so the recordings need to go through a third party app to get to the MP4.
If you’re working with lots of clips from an event that just adds a lot of time to your processes and also adds another app into the mix where, if it’s anything like other similar services you could end up paying a subscription or for tokens for conversions in the future.
Hope this clarifies, I think my original comment was pretty positive about the tech and the job they’ve done with immersive 3D from two lenses that aren’t in the traditional “eye distance apart” config you need to capture 3D video.
Try 4XVR Video Player for playback on Quest 3. 👌
Elevating the camera's distance enriches the spatial video experience. Given the compact camera layout on iPhones, employing the Apple Vision Pro with cameras positioned farther apart will significantly amplify the 3D perspective.
Hi Mike, Thank you for the amazing video. It was really educational.
Do you happen to know how to make the edges blur like the samples in the Quest3?
We really appreciate it. Thankx again, cheers!!! 🎉
watched this video on my varjo aero using virtual desktop spacial on, over under mode and for me the clarity was decent with the fisheye set to about 75 degrees anything biggers was just too blurry. so while the 3d works for me the resolution of the iphone cameras arent capable yet to give you a good immersive video maybe in about 3 generations or so I can definitely see this being the future of recording video on iphone when they get dual 8k cameras
it was so cool felt like i could touch it
I haven
I haven't used my Quest in months, maybe over a year. I couldn't figure out where the file was saved on my headset and when I finally found it there was something about permissions and needing to download an app on my phone and honestly I was already exhausted by the process so I gave up. I'm loving the reactions. I'll have to take everyone's word for it. I'm really looking forward to the Vision Pro.
Works great on my 3d tv
I really appreciate this
I appreciate this comment []-)
I'd love to know if you'll be picking up a Vision Pro to either own or just review. Seeing your take on this headset would be super interesting.
Thats a funny thumbnail, fair bloody play to ya lad!
It worked great. But I noticed a different in quality if watching on Bigscreen. It was better on the meta standard app. Good doggo, a great actor.
That is pretty cool man. I just tried it. First time I've h ad my Q3 headset on in weeks!
There’s some great games coming. Assassins Creed and Arizona Sunshine 2 []-)
If you decide to throw it away just let me know where is your trash bin in advance
That'd a pretty cool feature. I wish I had one of the new iPhones to try it out. I'm very curious to see how one of my neopixel lightsabers would look.
Maaaan wishing I had an iPhone for the first time thanks to you 😂
The spatial videos were definitely one of the features that interested me most about the Apple Vision Pro. Also curious if other brands' future headsets will adopt a similar type of technology, particularly as there becomes more focus on MR and other use cases for these devices outside of gaming 🤔
headsets that exist today are already capable of viewing 3d videos, the format isn't new. the vision pro's only addition to the feature is the ability to shoot these videos on the headset itself. The main area apple is innovating on however is making this format much easier/accessible via making it one of the main shooting modes on iPhone
It is possible to see this kind of video in a normal and very basic VR viewer where you put your phone into it to see videos?
Thanks for sharing, is there any way to do this without installing risky software on my iPhone? Perhaps a desktop program that can convert files to over under?
Yeah, I’m sure that would work mate. I just tried to keep the process as simple as possible []-)
wow, thats cool
Can you make a tuturial how to record spatial video on iPhone 15 pro with new ios 17.2 and play it in 3D on quest 3 please!
Cool videos and thanks for sharing. Ruby was best doggo.
Did find it a small bit underwhelming as Apple had over advertised the way it would work. With the way you can look at objects from different angles but instead it gives a kind of fake moving effect when looking around which i think also made the spatial video feel like a lighter effect
None-the-less it is super impressive for the first consumer version and that this is done on only one phone cameras. Im sure this will only get more advanced in the future.
What are you talking about? 2 cameras are used, not 1.
@@michaelburns4020 i said one phone cameras... as in one phone with cameras ... i didn't say one phone camera
even 3d movies have same moving effect, since its stereoscopic 3d and not scanned 3d
Is there any way to look at all your normal videos and photos from iOS on the quest
Please provide more spatial videos for download
I have subscribed to your channel.
In these two videos for some reason the bottom one has more blurry background, I think the quality of 3d videos would still always be better with dedicated double camera setup, rather than yet another apple proprietary locked format as they always do
Dear Mike, could you help me get my iPhone 15 Spatial Video (FSBS) on RUclips? I don't know how to inject the metadata which I probably need?!
Which takes better 3d, iPhone 15 pro or quest 3?
quality really good, but for me it did not automatically play in correct format. (i got two images one above the other) and had to tell it to go 3D side by side
what’s the difference between spatial videos and stereoscopic 3d videos that’s been around for ages? aren’t they just the same thing? if so what’s with this new “spatial” terminology?
It’s the same thing []-)
@@VirtualRealityOasisI keep telling these cringe people from Macrumors but these people don’t listen to me
@@VirtualRealityOasis🤣🤣🤣
It's the exact same thing. 3D video ended up failing and being called a gimmick, so Apple didn't want to associate itself with a failure, even though they can't seem to figure out how to make an actual new phone.
I did hear that a mod is being made so you can capture spatial videos / 3D video from the quest 3, that would be a cool feature to have. But still great vid.
You can already capture standard 3D video like this on Quest 3 by sending some ADB commands to it:
adb shell setprop debug.oculus.screenCaptureEye 2
adb shell setprop debug.oculus.capture.width 3840
adb shell setprop debug.oculus.capture.height 1920
adb shell setprop debug.oculus.fullRateCapture 0
adb shell setprop debug.oculus.capture.bitrate 40000000
And also turn on Image Stabilization in the recording settings.
Is it possible that there is also LiDAR data being recorded here that isn't being transferred over in the process you've used here? LiDAR can theoretically generate a 3D model and it would be completely BONKERS to me if these spatial videos didn't use that feature at all.
Firstly you and I are pretty much twins and it terrifies me. Thanks for your hard work in this space! Asking the below of several people so apologies for the wash rinse repeat.
Question for you and your audience!
It feels to me and i am probably wrong, that we are in an interesting spot with VR/XR/AR/180/360/Spatial, where across the board we are are starting to see some issues with adoption resulting in a plateau in quality content videos, gaming or otherwise. Without going on a rant, I feel that the apple vision pro's success or failure might be a turning point either direction.
Spatial video is great but do you foresee Apple or Android including a competitive/quality 180 or 360 video solution in their upcoming phones and would that coupled with an affordable headset or display conversion (think better google cardboard) without undercutting the AVP be the way to go?
Is there anywhere I can go to download a bunch of these directly to my Quest 3 headset to test, ideally just from the browser in the headset?
That save me money to buy a vr camera, thanks!
Hi Mike, love your content been a watcher and subscriber for a long time. Do you think you can you watch these spatial videos on a Valve Index or other steam based headsets?
Yes, you should be able to watch them using the DEO VR app []-)
What about the built in SteamVR media player? @@VirtualRealityOasis
The app just converts it into normal flat SBS 3d video
For those who don't have a VR Headset to view it in, the 3d video basically looks like the Nintendo 3DS stereo viewing mode or watching a 3D movie with the glasses, however it is much more clear since you're already wearing a headset thats splitting the displays for each eyes instead of on a flat screen where your eyes need to be in the right position. For it's actual usable applications, not too sure how broad this will be as media has to be created for this medium. There have already been a lot of movies that were either re-rendered in stereo or some that were entirely shot in stereo that could easily be converted for usage on the headset, however a lot of these are from a time period where 3D movies/media were a craze and you'd have to go to a movie theater and put on a pair of glasses. This trend has more-or-less died down, so this might be an opportunity for it to resurge once these headsets become way more mainstream.
that was pretty impressive, especially since I viewed it not on vision...question, can you edit a spacial video and export it with the same spacial information or is it just for viewing individual clips?
The app beta is full, does anyone know of another way to get it?
Can't wait to see all these terrible tiktoks and trendy dances get the James Cameron avatar camera treatment 😂
Yess, trendy dances, indeed.
my wife does not have that update, how do get the beta mike?
3d video of doggo? I'm in.
so these clips are just up/bottom 3d videos, with better quality?
Ruby is famous now 🎉
So in the Apple clips they imply that you can 'look around' objects in 3d, dynamically, by moving your head position. Is that actually how this works or will it be a 'static' 3d effect on the video? Surely to achieve that dynamic 3d effect there would have to be some sort of generative shenanigans to infill those areas 'behind' objects. I can see it being really cool if they pull that off well, but I'm guessing it doesn't work like that when viewed on meta headsets?
No, it’s static and what they show is borderline misleading. Unless there’s something I haven’t seen yet ]-/
@@VirtualRealityOasisin that case their promo of this feature was a little misleading tbh, cool feature nonetheless, but more of a gimmick than a game changer it might seem
Just to add, in the Spatial video clip, it's also capturing Spatial Audio and plays back in the Quest 3.
How much is a 3D camera?
cant install test flight because i need a invitation code... thanks a lot m8!
Why do you think Apple spacial videos are over/under instead of side by side?
Can anyone advise where do you get a redeem code to try it out please - nothing in email and can’t open the app without it…
Is there an unconverted spatial video available? I'd like to see if 4XVR can handle it.
There's an open standard associated with it but I doubt 4xvr supports it already
@@quidnunc01 It supports both MVC 3D video and HEVC encoding, which (IIRC) is what Apple's Spatial video is using. Which is why I think it might actually be able to handle it.
I know this might be a very silly question Mike. But can I use Virtual Desktop on Steam - using the 3D side by side and other options - to play it in my standard Oculus Rift Headset?
P.S. Even if I can't, thanks for the interesting video... [8]-)
You could as long as you can play the video top and bottom it’ll play correctly []-)
Awesome. And thankyou for the info, Mike
@@VirtualRealityOasiswhy does it need to be top and bottom? All of the current 3d/180° content I watch, are in sbs format. Then again, I watch using Skybox VR video player app.
The thumpnail is funny as f😂😂
Spatialify beta is full 😮
The dude legit captured, converted and watched the video, and in the end asked what I thought… dude I want to know what YOU thought, is it a good quality 3D or not? because the cameras are so close its kind of crazy that they actually were able to generate a realistic 3D effect
How is this different from the experience of watching 3d videos on RUclips in the Quest 2, which we've been able to do for ages already?
The fact you can capture these videos on a phone instead of a dedicated and expensive VR camera []-)
I copied .MP4 file to Movies Fold, but can not see it on quest
So this new spatial video thing is basically iPhone captured 3D videos?
Yes.
Watched the spatial video... I'm sitting and waiting obediently
I can understand why Apple makes the edges of the video blurry, something isn’t quite right there. Nice ASMR video btw :D
Is this 3D or is there more to it?
Yeah, 3D video captured from iPhone. It's pretty impressive considering you needed expensive camera equipment to achieve this up until now []-)
Those animated eyes on the Apple Vision Pro are so creepy.
When I open the video it is just audio, any advice?
Idk but i still prefer oculus quest 3 instead of apple vision pro 🙂i feel like oculus quest 3 is better than apple vision pro? Am i right?
Can't get into the beta
Everyone seems to be trying really hard to avoid calling these 3D videos because I guess 3D has a bad reputation but that's just what this is with a fancy new name. Glad to see 3D trying to make another comeback, this time for sure!
It’s more like parallax with apple adding something else that adds dof , basically apple adds extra shit to seem like but it’s not different than parallax video
Yeah watching instantly got me thinking "ok wow...this 3D video again", recalling all those 3D movies i use to watch in the theaters and even on Big Screen. Even the other day when playing on the 3DS with 3D turned on.
@@Mackadotious51 I like apple products but even I know they steal ideas and put a new name to it
Everything old is new again.
Am I missing something here? Looked at this this morning on my Quest 3 and it just appears to be a (admittedly very good quality) 3D movie clip. What is so ground breaking?
There's nothing groundbreaking. It's just standard 3D video.
The technology itself isn’t groundbreaking, it’s the accessibility everyone has to record these videos is what’s amazing.
@@SentinelSeptimit’s not accessible at all, you still have to buy a $2000 phone to do it this way. You’ve been able to buy much cheaper 3D cameras in the past like the insta360 evo
@@pixxelpusher that’s an over exaggeration of price lol.
@@SentinelSeptim iPhone 15 Pro starts at $1,849 in local currency. iPhone 15 Pro Max starts at $2,199. They go up to $2,899 when fully specced out. A 3D camera is a quarter or more of those prices, produce much higher resolution and some can film 180 degrees footage. If "spacial video" is simply 3D side-by-side, there's already much better and cheaper options. The iPhone approach is only interesting if it captures volumetric spacial depth that allows 6-dof head movements.
is spatial video just another name for 3d video? what im I missing here?
You're not missing anything
👍🏼👏🏼
Is this file compatible with Quest 1?
Yes []-)
@@VirtualRealityOasis Thanks got it working in BigScreen and after changing the 3D view settings it worked... Kinda weird though, I don't want to watch anymore of those :)
It works, but you need to select the 3D Top and Bottom mode on the right bottom corner of the player
@@assignmeanameplease Yeah it seems a little blurry or something, it's not what I imagined it to be. I thought I would be able to view more of the video from a different angle but it doesn't seem like that's possible yet... Still pretty cool and the tech is only going to get better.
the file on dropbox is deleted :(
Thanks for letting me know. It should work now mate []-)
no worries man []-)@@VirtualRealityOasis
Does it work on pico 4?
It works on every headset. It's just standard 3D video
Hello
The Spatialify beta is full.
I know he said just as a precaution to backup your phone. No, if your going to a beta always backup your phone. You won’t loose your data going to the newer version but if it’s to buggy and impedes on you using your iPhone. Downgrading will require you to wipe your phone. If for whatever reason you can not backup your phone. Pleas do not install the beta.
Are you sure about that? I’m pretty sure you can tell iTunes to install any iOS (compatible with your phone model) that’s currently being signed. You just download the update to your pc, hold shift while clicking the upgrade button, and point to the file.
@@michaelburns4020 yeah your right about updating as I said in my statement too. It’s the downgrading that will wipe your phone. Just double checked some tutorials and all say it will erase all data on the phone by downgrading.
What I said applies to downgrading. You click on the “update” button, but point it to the older iOS. Been a while since I did that, but tutorials do seem to say it wipes it. And a backup from a newer iOS is not compatible with an older one, so to be safe, you want to disable automatic backups before messing with this. So that your latest backup is the older iOS, and you won’t have to manually choose your backup.
Beta is full. And the public version is $3
Funny how soon you’ll actually be able to
You dont need iphone i already record 3d 4k straight from quest 3
Is ruby a sproodle ?
She’s a cockapoo []-)
Ahh very similar to a sproodle which is what we have
Literally the 3DS camera
Literally it’s called parallax video and people from apple fanboy like macrumors kept telling me off
(but with more pixels so it looks kinda better, but it ain't new)
@@Gold_Yoshiyes also the fact this mod doesn’t show the full widescreen so what we are only seeing is the normal camera with 3d effect but of normal camera aspect ratio ; what apple did was let you look slightly around to see the rest of the widescreen part of the camera through the window