Lets go!! I gotta save this. I havent seen the full length. But im really hoping that ill be able to use this for mine as well. Awesome to see the intro tho that its possible
Thank you!! WebXR is the future of web so I hope Apple will keep updating and suporting. Even in VisionOS 1.1 already have great support so the space is looking good.
Terrific work Hugh! On my AVP, I can get the still images to work, but the 180 video stops playing when you enter immersive mode, and the 360 video doesn’t load at all. Any idea what I’m doing wrong?
Glad it was helpful! I am just so excited for the future of any R. There are so many ways to create and innovate with everyone working so hard in the space double time!
Wow, thanks for setting up your own site for testing this! I tried it in both my Apple Vision, Pro, and Meta Quest 3. Some observations: In the GitHub build, the Apple Vision Pro looked clearer, but the colors were more flat… Not as “punchy”. The Apple Vision Pro also revealed some of the limitations of the resolution, seams, blockiness in the imagery. On the Quest 3, the colors were more vibrant, and the overall presentation looked smoother… Probably because of the lower resolution of the displays. Another strange thing: if I looked hard right with my eyeballs, I could see the menu floating in the right edge of the screen. The Quest 3 also allows you to switch which hand is controlling the laser pointer. In the VR 180 photos, both headsets showed similar behavior with presenting color and image resolution: AVP looking cleaner, but revealing resolution limitations, and flatter colors, while Quest 3 looking smoother and more punchy colors. In both headsets, I could feel my eyes “pull“ with imagery too close to the camera. (The feeling of your eyes trying to cross)
Wow thank you for all these great feedbacks. I got too busy on working on Spatial Video and immersive video stuffs on AVP but I will be back to WebXR after WWDC24 to refine the workflow based on your suggestion.
Nice Hugh! I'm excited about WebXR also. I noticed when converting my 360 photos to view on Vision Pro that Apple's WebXR is incorrectly displaying stereo photos. Notice how much lighter your photos are when immersed versus when displayed normally. The BabylonJS devs know of this problem, though it is not a Babylon problem. I haven't been able to connect with any Apple devs on VisionOS forum, so spread the news so we get it fixed!
Hey Hugh, in order to do what you did here do I just get the code you mentioned? Will there be a follow along guide? I need to quickly find an alternative to using 3D Vista for an upcoming conference I will be showcasing tours I’ve created to be viewed on the AVP.
Great Video. I hope that there will be more WebXR experiences in the future even if it for example is something like a greater library of 3d 360 locations to visit. Right now sadly there is only a handfull of those experiences and not even a good page that would give you an overview of what is out there in the WebXR world.
I hope this inspire some developers to build a full blow app. I am not a developer so it won't be me. But I am pretty sure there will be existed platform adaptation after they saw this or new comers enter into the game! The rapid speed of development since AVP launch is crazy!
So you are saying that if a website doesn’t play its VR 3D video properly it may be using the WebVR libraries instead of WebXR? The only way to fix it is for the website to change their code?
Not exactly. Many reason. But we tested on Safari Vision OS and the only way to even make VR mode works is using WebXR library instead of WebVR. There is no reason for Apple to adapt older standard as they can't even fully support newer standard and its input is brand new - hand and eye control which even WebXR is not supported. So hardware is faster than software in this case. But if you see application not working and you have active developer working on this, I will suggest this is the first place to look. I make development sound easy in this video, but there is a lot going on.
@Hugh Hou How on earth did you capture 3D 360 photos? I’ve been looking for them FOREVER but all I can ever find are 3D 180 or 2D 360. Also, I noticed that the 3D 360 photos have quite a bit of aliasing, is that something that’s an inherent limitation with them with current camera tech and is it the main reason they are very rare and most people don’t choose to capture 360 photos in 3D??
Oh capture 3D 360 is very easy. You just need a camera like Insta360 Pro 2 or Insta360 Titan. This is capture like 5 years ago on the Pro 2. It is not a great camera (action camera sensors but 6 of them) so you see aliasing. But it do the job and if I run some AI on it it will be as good as new lol. I will capture some new sample using my Titan soon - that is MFT sensor and 8 of them so it will be A LOT better. I never have the need to do so right until now after AVP release. But I have no trip lining up. I only capture stuffs when I have work trip. Jobs have been slow that is why so many RUclips from me lol.
@@hughhou I just looked up the price of the 360 Titan and holy crap is it expensive! It’s like 10 grand, is there camera out there that can do high quality 3D 360 photos with no aliasing that is in the 1-$2000 range? I would seriously consider picking one up if so. And yes, I would love to see some 360 photos from your Insta360 Titan, sounds like they would be amazing.
@@hughhouWhat about the VUZE +? I have that one, but I don’t use it that much cause I believe it does have noticeable aliasing. By the way, with new AI tools, do you know if the quality of this camera footage can be improved?
@@nicktheg00Vuze +, but only to get your foot in the water cause it's only 4K, and I believe it's aliasing. But you get the feeling of a 3D 360 low-budget consumer camera.
Hey Hugh, Thank you so much for your high-quality content-it's been incredibly helpful to me! Does anyone know how to improve the image quality of 360° images on the Vision Pro? My images appear quite flat with low contrast. Cheers, Jan
@Hugh Are you able to check visionOS 2.0 beta? I'm curious if WebXR AR mode works now since they just released Metal + passthrough. That suggests Apple should be able to implement the AR passthrough module in WebXR, or at least maybe have a working experimental flag.
@@hughhouI think xr with a connection to reality is the future. Anyway, actually I checked with someone at WWDC. The feature isn’t implemented yet, but it will come at some point.
Nice ST. Petter, the OG VR advocate! 😂 I remember that on the headset, Oculus Go (my favorite one!) They started introducing or making changes in some of the browsers available from one to the other. Do you know why they changed from WebVR to WebXR? Or vice-versa, I'm still confused 😖 why make it complicated? Great video, by the way! Thank you.
Well not really. I don't do REVIEW and comparison like other influencers who going for the views is because I do not think it is fair to pick side right now. AVP is so new a lot of support are needed to fully utilize its power. This is another use case of hardware is so much more advanced than software and applicaiton can not catch up. Most reviewers are not even aware of this or understand development. Jumping on a train of Apple worship or extreme criticism is not right. It is great for their views and good for them. But it is not the idea of this channel with objective reviews. So far Quest 3 is ahead of the game just b/c it is literally 5 years ahead of Apple in the ecosystem - but AVP is catching up fast. When native support is enable of immersive video playback, bugs fixes and VisionOS 2 is out, then might be a good time to voice my opinion. Before that, I will continue to showcase our expertise in the space - build apps, make contents and make tutorials.
For VR180 video not playing in AVP on Safari, @avatour found the solution. Go back into the Safari features and enable "GPU Process: DOM Rendering." Try that and let us know if it works
Thank you Hugh, this is great! Images work perfectly, but in testing on my AVP I found that the 3D180 video freezes when you go into immersive mode. (The 3D360 video doesn't seem to load on my AVP at all.) After going back into the Safari features and enabling "GPU Process: DOM Rendering" the 3D180 video played properly.
@@hughhou still not working here unfortunately. I got the video to play in immersive mode a couple of times, but not reliably. Most of the time it plays in the safari window but pauses as soon as you switch to immersive mode. Are you seeing any issues or does it work reliably for you?
I think Safari is the best - no other app use the native WebKit API. Juno in my opinion it is horrible (I bought it from the hype and it did not even support interactivity or any WebXR kit)
@@hughhou Thanks saved me $5. My HDR 4K video looks bright as heck on iPhone 15, but on VP, not so much. Why? For example this one: ruclips.net/video/4WLxo2PLogM/видео.htmlsi=yfkI9a_2nn74IGY5
AMAZING Contribution bud, apple shoud follow at least the webXR standards, otherwise, it's just gonna end up being another fully locked up product like the ipad
I hope so. I think they need to build API for root level hand and eye control support. I think hand control is supported actually seeing my hand demo. But eye control is current so new and it might take a while to open that API for developers.
The video/audio not playing in AVP WebXR mode is a bug that is known to Apple, should be fixed in one of the next updates. There's a workaround by restarting the audio context when in WebXR mode.
Great job pushing this medium forward, but the poor video/image quality of 99.9% of the stuff out there is still a deal breaker for me. Consumer capture systems need to catch up ASAP for this medium to thrive.
100 agree! Now the display set the bar high and camera dept are working hard to release new model to catch up. Actually under NDA but there will be new camera that will really shin on AVP very soon. I just can't wait to share more!
Lets go!! I gotta save this. I havent seen the full length. But im really hoping that ill be able to use this for mine as well.
Awesome to see the intro tho that its possible
Thank you!! WebXR is the future of web so I hope Apple will keep updating and suporting. Even in VisionOS 1.1 already have great support so the space is looking good.
Thanks!
Awww appreciated!
Terrific work Hugh! On my AVP, I can get the still
images to work, but the 180 video stops playing when you enter immersive mode, and the 360 video doesn’t load at all. Any idea what I’m doing wrong?
Same here, did you find a way?
Another excellent tutorial, Hugh! Thanks for raising the bar of what is possible in VR/MR/AR/180/360/doggo
Glad it was helpful! I am just so excited for the future of any R. There are so many ways to create and innovate with everyone working so hard in the space double time!
you are the best man!! great work
Thanks a lot!
This is exactly what I needed to get things working. thank you!
Nice glad to know :)
What would we do without Kimchi!? What a great guy.
Lol indeed!
Wow, thanks for setting up your own site for testing this! I tried it in both my Apple Vision, Pro, and Meta Quest 3. Some observations:
In the GitHub build, the Apple Vision Pro looked clearer, but the colors were more flat… Not as “punchy”. The Apple Vision Pro also revealed some of the limitations of the resolution, seams, blockiness in the imagery.
On the Quest 3, the colors were more vibrant, and the overall presentation looked smoother… Probably because of the lower resolution of the displays. Another strange thing: if I looked hard right with my eyeballs, I could see the menu floating in the right edge of the screen. The Quest 3 also allows you to switch which hand is controlling the laser pointer.
In the VR 180 photos, both headsets showed similar behavior with presenting color and image resolution: AVP looking cleaner, but revealing resolution limitations, and flatter colors, while Quest 3 looking smoother and more punchy colors. In both headsets, I could feel my eyes “pull“ with imagery too close to the camera. (The feeling of your eyes trying to cross)
Wow thank you for all these great feedbacks. I got too busy on working on Spatial Video and immersive video stuffs on AVP but I will be back to WebXR after WWDC24 to refine the workflow based on your suggestion.
This really is becoming my favorite new channel. Great video as always. Definitely going to be checking out the website on my new quest 3.👍
Awesome, thank you so much! Kimchi and I are happy to be one of your favorite :)
Wow nice. Thanks for the video.
Nice Hugh! I'm excited about WebXR also. I noticed when converting my 360 photos to view on Vision Pro that Apple's WebXR is incorrectly displaying stereo photos. Notice how much lighter your photos are when immersed versus when displayed normally. The BabylonJS devs know of this problem, though it is not a Babylon problem. I haven't been able to connect with any Apple devs on VisionOS forum, so spread the news so we get it fixed!
Strange. I did not see this problem. Stereo top and bottom and SBS both work correctly for me on AVP. Is your photo not in standard aspect ratio?
Is this only available on developer Beta 1.1?
No. I am not even on Beta. It available on all version of VisionOS.
That's awesome! I Looove webXR and what it can be implemented on different devices and is easier for people to use 👍✨
Also new VisionOS 2 update (beta) now webXR native supported and my example website work so much better now.
Wasn't able to get it to work. Entered the URL in the video and Safari just coughed up a bunch of google search results. Didn't go to the website.
Strange - it works on my end
Hey Hugh, in order to do what you did here do I just get the code you mentioned? Will there be a follow along guide? I need to quickly find an alternative to using 3D Vista for an upcoming conference I will be showcasing tours I’ve created to be viewed on the AVP.
Just get the code but 3D Vista is an other beast and will need their support on AVP
Amazing, thank you! :D
Hugh is a friggn genius
Great Video. I hope that there will be more WebXR experiences in the future even if it for example is something like a greater library of 3d 360 locations to visit. Right now sadly there is only a handfull of those experiences and not even a good page that would give you an overview of what is out there in the WebXR world.
I hear 👂 ya 😢
I hope this inspire some developers to build a full blow app. I am not a developer so it won't be me. But I am pretty sure there will be existed platform adaptation after they saw this or new comers enter into the game! The rapid speed of development since AVP launch is crazy!
So you are saying that if a website doesn’t play its VR 3D video properly it may be using the WebVR libraries instead of WebXR? The only way to fix it is for the website to change their code?
Not exactly. Many reason. But we tested on Safari Vision OS and the only way to even make VR mode works is using WebXR library instead of WebVR. There is no reason for Apple to adapt older standard as they can't even fully support newer standard and its input is brand new - hand and eye control which even WebXR is not supported. So hardware is faster than software in this case. But if you see application not working and you have active developer working on this, I will suggest this is the first place to look. I make development sound easy in this video, but there is a lot going on.
@Hugh Hou How on earth did you capture 3D 360 photos? I’ve been looking for them FOREVER but all I can ever find are 3D 180 or 2D 360. Also, I noticed that the 3D 360 photos have quite a bit of aliasing, is that something that’s an inherent limitation with them with current camera tech and is it the main reason they are very rare and most people don’t choose to capture 360 photos in 3D??
Oh capture 3D 360 is very easy. You just need a camera like Insta360 Pro 2 or Insta360 Titan. This is capture like 5 years ago on the Pro 2. It is not a great camera (action camera sensors but 6 of them) so you see aliasing. But it do the job and if I run some AI on it it will be as good as new lol. I will capture some new sample using my Titan soon - that is MFT sensor and 8 of them so it will be A LOT better. I never have the need to do so right until now after AVP release. But I have no trip lining up. I only capture stuffs when I have work trip. Jobs have been slow that is why so many RUclips from me lol.
@@hughhou I just looked up the price of the 360 Titan and holy crap is it expensive! It’s like 10 grand, is there camera out there that can do high quality 3D 360 photos with no aliasing that is in the 1-$2000 range? I would seriously consider picking one up if so. And yes, I would love to see some 360 photos from your Insta360 Titan, sounds like they would be amazing.
@@hughhouWhat about the VUZE +? I have that one, but I don’t use it that much cause I believe it does have noticeable aliasing. By the way, with new AI tools, do you know if the quality of this camera footage can be improved?
@@nicktheg00Vuze +, but only to get your foot in the water cause it's only 4K, and I believe it's aliasing. But you get the feeling of a 3D 360 low-budget consumer camera.
Is there a way to always allow it, rather than having to accept the two prompts?
I believe that’s an Apple question. They are not unlock experimental features for us…
Hey Hugh,
Thank you so much for your high-quality content-it's been incredibly helpful to me!
Does anyone know how to improve the image quality of 360° images on the Vision Pro? My images appear quite flat with low contrast.
Cheers,
Jan
It’s color science off as you will need HDR color grade for AVP as it’s HDR color space
@Hugh Are you able to check visionOS 2.0 beta? I'm curious if WebXR AR mode works now since they just released Metal + passthrough. That suggests Apple should be able to implement the AR passthrough module in WebXR, or at least maybe have a working experimental flag.
I have not tested ARKit as I am not a big AR users. But everything else is amazing. VR180 video now finally working.
@@hughhouI think xr with a connection to reality is the future. Anyway, actually I checked with someone at WWDC. The feature isn’t implemented yet, but it will come at some point.
Nice ST. Petter, the OG VR advocate! 😂 I remember that on the headset, Oculus Go (my favorite one!) They started introducing or making changes in some of the browsers available from one to the other. Do you know why they changed from WebVR to WebXR? Or vice-versa, I'm still confused 😖 why make it complicated? Great video, by the way! Thank you.
I think WebXR including augmented reality support but I am not really sure. I am not really a developer.
Which headset do you prefer? I’m assuming it’s the AVP
Well not really. I don't do REVIEW and comparison like other influencers who going for the views is because I do not think it is fair to pick side right now. AVP is so new a lot of support are needed to fully utilize its power. This is another use case of hardware is so much more advanced than software and applicaiton can not catch up. Most reviewers are not even aware of this or understand development. Jumping on a train of Apple worship or extreme criticism is not right. It is great for their views and good for them. But it is not the idea of this channel with objective reviews. So far Quest 3 is ahead of the game just b/c it is literally 5 years ahead of Apple in the ecosystem - but AVP is catching up fast. When native support is enable of immersive video playback, bugs fixes and VisionOS 2 is out, then might be a good time to voice my opinion. Before that, I will continue to showcase our expertise in the space - build apps, make contents and make tutorials.
For VR180 video not playing in AVP on Safari, @avatour found the solution. Go back into the Safari features and enable "GPU Process: DOM Rendering." Try that and let us know if it works
Not work for me
Thank you Hugh, this is great! Images work perfectly, but in testing on my AVP I found that the 3D180 video freezes when you go into immersive mode. (The 3D360 video doesn't seem to load on my AVP at all.) After going back into the Safari features and enabling "GPU Process: DOM Rendering" the 3D180 video played properly.
Oh really?! OMG! You just found a fix! Thank you!
@@hughhou still not working here unfortunately. I got the video to play in immersive mode a couple of times, but not reliably. Most of the time it plays in the safari window but pauses as soon as you switch to immersive mode. Are you seeing any issues or does it work reliably for you?
🎉thanks. What is the best app for RUclips now for VP?
I think Safari is the best - no other app use the native WebKit API. Juno in my opinion it is horrible (I bought it from the hype and it did not even support interactivity or any WebXR kit)
@@hughhou Thanks saved me $5. My HDR 4K video looks bright as heck on iPhone 15, but on VP, not so much. Why? For example this one: ruclips.net/video/4WLxo2PLogM/видео.htmlsi=yfkI9a_2nn74IGY5
cool!
Will this work with vr p()rn
Probably. I think this might be the only solution for that. Report back if it work for you.
@@hughhou haha I think it will sell a lot more avps if it worked
@@hughhouworks
AMAZING Contribution bud, apple shoud follow at least the webXR standards, otherwise, it's just gonna end up being another fully locked up product like the ipad
I hope so. I think they need to build API for root level hand and eye control support. I think hand control is supported actually seeing my hand demo. But eye control is current so new and it might take a while to open that API for developers.
The video/audio not playing in AVP WebXR mode is a bug that is known to Apple, should be fixed in one of the next updates.
There's a workaround by restarting the audio context when in WebXR mode.
What would be it like flying like superman in this vr world!!!
Indeed!!
This is not "Full support" at all, where is webAR??
Well okay support - it is still beta lol
Great job pushing this medium forward, but the poor video/image quality of 99.9% of the stuff out there is still a deal breaker for me. Consumer capture systems need to catch up ASAP for this medium to thrive.
100 agree! Now the display set the bar high and camera dept are working hard to release new model to catch up. Actually under NDA but there will be new camera that will really shin on AVP very soon. I just can't wait to share more!
these are all VR experiences, when are we getting AR ???