Great video as always, Hugh! Thank you for highlighting my spatial command-line tool. I'm glad that it worked well for you. FYI that I added some documentation yesterday, and the link can be found on the download page that you mentioned (and linked-to in your description).
These days, I've been watching your video over and over again for three or four hours a day. I've been under the illusion that I know you for a long time. I'm always thankful!
That was a very long process. But I got my first one done. It seems to be the only way to accomplish this at this moment. Rendering left and right eyes and recombining… It’s always good to learn the manual way first I agree! Thanks Hugh!
I am sure it will get easier in the workflow. This is week 2 of AVP lol. I still have lots to learn. We are in the same boat. When I have new trick I will share it immediately
Did you notice a loss of detail after the Mistika render? I’m using the 7 day trial version and the render (transcode actually) looks like half of the resolution of the original
RUclips’s support for 3D content, especially for side-by-side uploads, seems to have changed. Previously, there was an option to checkmark videos as 3D content directly on the platform, but this feature appears to be no longer available. This change has made it difficult for creators who wish to upload and present their content in 3D format. How can I do that on RUclips?
Not only is it no longer available to mark stereoscopic content, they destroyed the existing tags, breaking most classic "3d" videos. They later made exceptions for a handful like OK Go music videos, but all who are not getting the elusive support have to reupload with embedded metadata, losing links, likes, views, comments etc. If you remux into Matroska format, you can set stereo_mode, e.g: ffmpeg -i input_file.mkv -c copy -metadata:s:v:0 stereo_mode=1 output_file.mkv
This is the video I've been waiting for. I bought the r5c with the dual fisheye 2 years ago. Picked up the 1tb vision pro and was hoping I could use it all together!
Now this is the KING of spatial video as well, not only VR180. Spread the love so more Dual Fisheye owner know they just triple the value of their investment
Very well done and informative. I think the big thing that Apple did especially with the iPhone 15 Pro is consumerize and grossly simplify the workflow you showcase in this video especially taking the main camera and the ultra wide lenses to compose the Spatial Videos ready for viewing on the Apple Vision Pro. Keep up the great work!
Indeed so everyone can try Spatial Video - which make brands aware of the format and want to do it professionally. Then leads to more jobs for creators - everyone win in the end! Thank you!
@@hughhou It makes more of us creators. But I'm personally excited to see what pros like you do in creating new content with Spatial Video and other immersive formats. I'm hoping that Apple and other's produce cinematic Spatial Video (not VR180). The display quality on the AVP is so impressive. That is what really commands that big price tag of the AVP. Micro-OLED is not cheap. Apple had to pay through the nose. They will eventually make the technology more accessible for others in the next couple of years. It's part of the Apple catalytic formula.
So funny I am working on a Florence piece shot on R5C which I can finish in time to share it to your as a travel guide lol. But this is the old one shot on the R5C: ruclips.net/video/znoL7B_23Z0/видео.htmlsi=D-oSdtK9ItnpnB63
@ ah thanks! Yeah I’m familiar with spots in Florence and I’m doing engagement photos (I’m wedding photographer), but on top of that we’re trying out some spatial clips to see if we can create some spatial videos for the wedding next year
Wondering - Have you noticed a big difference in the quality and playback of your VR180 & VR360 videos on the AVP vs the Meta Quest, Hugh? Thank your generous commitment to your channel.
To be 100% honest, not really lol. AVP color is better and playback is smooth without refresh rate issue. But the quality is not like night and day different. But this is prob b/c the solution is not official yet. When Apple provide their Apple TV pipeline, then will be huge different!
Absolutely great work - as always! I saw the VR180 production from Italy on a Quest 3 yesterday. Wow! Great storytelling and quality. Is there a tutorial that shows how you achieved that wonderful cinematic look I am working with a R5C with dual fisheye. Besides wanting to know how to achieve that cinematic look I need to find the best way to record 90 minutes in a row and get the best quality possible for that very long recording time. Guess I will have to watch all your videos again.
Thank you Hugh for this very interesting video! You always manage to find great workflows that are a big help for creators 👏. In my opinion, spatial videos are not very convincing; I find this technology less immersive than 180 or 360 videos that envelop the viewer, but that's just my opinion
Glad it was helpful! Yes for people know VR180. But for massive audience out there have not heard of VR180, 3D Spatial Video is their gateway drug onto immersive storytelling. My hope is more people come here and understand the format and what is out there. And slowly move them into VR180 - the true immersive format - also pushing by Apple and heavy by Meta and Pico.
Thanks so much Hugh! Just ordered the r5c with dual fisheye and excited. I have a question: this tutorial shows how to create a spatial video for use in apples rectilinear/square Photos app format. And you have many videos regarding 180 degree 3D video for the AVP - but does 180 degree video have all the parallax and “ultra real” benefits of this spatial video method here? I’m trying to figure out if I need to build a rig to capture depth data as a film and recombine in post for nerf/splatting solutions that provide more immersion when I start filming immersive 180 content next week. I guess I’m asking “how did Apple film its demo content in Experience Immersive?” Any guesses? Thanks for everything!! You taught me like two years of stuff in one week!
Immersive 180 on AVP is exact the same as on Meta Quest 3 which shot on this setup or similar like RED V-Raptor. There is no movement like spatial video. The best example is Alica Keys or Adventure series on Apple TV. That’s your reference from official Apple.
@@nadeemtron Hi nadeemtron, follow up to your question, how has your journey with r5c and fisheye lens been? Did you manage to shoot immersive video & play it back on vision pro (not spatial)? I'm blown away by apple's demos (MLS, Alica Keys etc.), and want to create that by myself. Thanks!
Hi there, Thank you for providing such valuable insights!I have some questions that I'd love to discuss further with you: 1.Cost vs. Performance: Considering the significant price gap between the iPhone 15 Pro Max and the Canon EOS R5 C Mirrorless Cinema, how do they compare in terms of performance and value when it comes to producing high-quality spatial video content for VR? 2. Software Optimization and Workflow: How might the iPhone 15 Pro Max leverage its computational capabilities to streamline the process of capturing and editing spatial video for VR, especially compared to the Canon camera setup? Furthermore, considering Apple's expertise in software optimization, once the files are viewed in the Vision Pro, could Apple employ dedicated software enhancements or upscaling tricks to further enhance the final result? 3. Editing Complexity and Apple's Approach: Editing and preparing spatial video can be quite intricate, particularly given Apple's current lack of a dedicated editing tool in Final Cut for their new spatial video format. Have you heard any rumors or insights about potential developments in this area that could simplify the editing process? I eagerly await your thoughts and insights on these questions. Thanks again for all your invaluable help. And keep up the amazing work!
1. Consumer vs Professional quality. This should be always RENT than own. And get your clients pay for most of the cost. Hint commerial level. You can certainly use an iPhone to shoot commerials these days. But this is more a robust workflow. 2. I have a iPhone only workflow already which is in Davinci Resolve - link in this video description. FPC has no news so far. Crazy! 3. Yes. Apple is working hard on FPC to support Spatial Video. It is matter of time now. Right now, Resolve can do most of the thing and it is almost like free (if you get a BM camera or products).
Spatial video is cool, but I don’t understand why, if you have the capability to capture VR180 with the Canon R5c/Dual Fisheye Lens, you’d want to crop it to a small 3D rectangle?
Yeah, if you know what you're doing... there's no way you go back to spatial video. Well produced VR180 will now impress those with an Apple Vision Pro even MORE. BTW - the moon player is the closest to being able to play local VR180 files perfectly. There's a strange warp with the playback though... makes everything look like it was filmed on a giant ball. Bummer. But it should be fixed soon.
As Adam said. But most people don't know what VR180 is - just look at my video comments lol. Spatial Video is a gateway drug for them to get into VR180. But from 2D to VR180 is a big jump. Apple think that, not me.
Yes right here: ruclips.net/video/kwVlVEXg3og/видео.htmlsi=vAdFzHD0R0DwOApd and this for encoding: ruclips.net/video/PJWsscXmJiE/видео.htmlsi=E2clcH6p7PyFxSQ7
@@hughhou thank you. Just finished watching and it's an excellent one for VR180, but only mentions Spatial video conversion at 15:40 Still an excellent video!
Hey Hugh, thanks a lot for this video. I'm facing an issue after i render the video on mistika. There are these unusual reference dots appearing. Is it becuase im on a trial version ? how do i fix it ?
Thanks for your videos! Can we get an updated version of this coming from premiere with the canon plugin? Not sure what’s best codec to render to from premiere before doing the terminal steps…
Premiere does not support 3D editing (old school 3D) so in Adobe is hard. But I will let you know if I figure out how as I am pretty good at Premiere and After Effects.
I find that the iPhone 15 Pro Spatial Video is better at close quarters than the AVP. Anyone else notice the same thing? I also like the 16:9 aspect ration versus the square off of the AVP.
Thanks hugh! Very interesting tutorial. Will you provide some tutorial for customized 3d rig for shotting spatial video. Such 2 Gopro for example. I already have the Canon R5C but i think we can produce high quality spatial video in another 2D regular cameras. As long as we can sync it or have a 63.5mm IPD.
Great video Hugh! So money aside, if you would have all the cash in the world. Which system would you think you would use for spatial video for Vision Pro? 2 x Red Raptors V/Sony Venice 2 in a 3D Rigg and the field of view of..? Appreciate it!
Hey man, quick question: Have you ever tried to use two GoPros with the max lens side by side to get Stereo VR 180? Saw some samples online but wondering if you had any suggestions or concern that would steer me away from trying it. Thank you!
Honestly? I will not suggest it. Sync will be a nightmare as GoPro is not genlock sync and it will drift as rolling shutter. Great for people doing it but in practical shooting is hard to control. The drift can not be fixed in post.
Thank you very much for the reply! I was just trying to help a friend who need to shoot a music video in Italy and doesn’t have access to a Canon R5. So even with a remote that triggers both cameras, they’ll have sync issues…good to know, you saved us a lot of editing headaches! What camera would you try to get, even sacrificing some quality in favor of easy availability in Europe? Thanks a ton!
I will have other solution very soon making a new tutorial on this topic. R5C can not do HLS streaming but this one can (and will work on Vision Pro if someone build the player app): ruclips.net/video/jmOX6aHj8oI/видео.htmlsi=HxN0DCQmrWws7Hum
great job as usual . but the images from mystika are really bad, a lot of artifact, a lot a colored dots i use the demo version of mystika any advice? thx
Thanks for that great tutorial! So when playing back the converted file on Vision Pro; do you have parallax effect? (thus 6dof). If this is the case, do you know if the depth is generated on the fly? or by Mike Swanson's tool, stored in the mv-hevc file?
NOT 6DoF - 6DoF is only available on VolCap or Game Engine. This is just optical illusion parallax effect using eye and head tracking on the AVP. It is more than JUST 3D but still based on original 3D video. And yes, this workflow add immersive view and "Apple Parallax Effect" (edge blocking and edge parallax). It will work on all 3D video. It has been confusing on this spatial video topic. I wish Apple just say this is 3D+ instead of Spatial Video.
@@hughhou thanks for the explaination! I was thinking maybe they uses their tof sensor or cameras to create a kind of multi layered video (or even using "Depth Anything" to estimate depth with AI). So it looks like its more about a good 3d integration in the passthough. I've tried the new "spatial video" on Meta Quest 3; does it look the same?
Hello Hugh, thanks for the impassioned coverage! Hugh, do you have a tutorial to convert circular fisheye to 1:1 equirectangular, in DaVinci Resolve Studio? I would love to streamline this step, before stepping into Spacial. Thanks!
It is very similar on one of my old tutorial about defish Canon Fisheye using Fusion - it is one of my popular Resolve Tutorial on Canon Dual Fisheye lens. Same concept. Instead of 2 fish you get 1 fish here.
Thanks Hugh, found your video (ruclips.net/video/2GW7nb47rB4/видео.html). Unfortunately I cannot find the KartaVR plugins for Resolve/Fusion available anywhere for download (the link goes to the Facebook page, which has not been active a couple years). Any idea where we can find them today? I am looking and will post here if I find anything. Thanks for any leads!
Hello blogger, I saw the 360 panoramic photos you took on immerse. They are very high-definition, but the pictures I took using DJI Mavic 2Pro & Insta360 x3 are not clear. I want to know how you did it. Looking forward to it. You can answer and reply🙏
We have lots of workflow on 360 panoramic photos. Here is a good one to start: ruclips.net/video/hg1m-GlYnuI/видео.htmlsi=wQbuSD5tOjW2AaF6 / ruclips.net/video/vb8-2gQYp8c/видео.htmlsi=tvDvJSqIeOg-PMnK
Great tutorial, thanks! Did you say that you knew of a way to play 3D SBS (non 180 / 360) without the spatial format in AVP? I couldn't find a way to do that yet (and none of the apps like Moon support it yet either)
Can you render with software to get better quality instead of hardware? Like x265 vs video toolbox? It makes such a big difference with H265, wondering if possible with MV-HEVC
Thanks for a great Video Hugh. Would you have some sample videos that we could download and view on a Vision Pro. I am thinking of getting the 5.2 to use with either the R5 or Red Komodo.
WOW! Awesome work! What was that filmed on - the really High Def parts? Especially the stabilised walking scenes. Thank you for sharing. I will be subscribing.
Hugh, do you know a way to inject vr180 RUclips metadata without the creator app? I am trying to inject metadata at 8640x4320 resolution and the app gives me an error
Photos: I'm interested in creating spatial photos for the AVP. I can't seem to find any info on how this works with the Canon dual fisheye lenses. How difficult is the workflow?
Help Hugh! I’m using the 7 day trial of Mistika and the rendered output file has lost all the detail of the original file. The original is an 8k file, and I rendered to two side by side 4k images per your guidance, but Mistika just destroyed the detail in the image. Is it the free license or do your encodes also lose a lot of the image detail? Thanks for the video!
Mmmm... I render in ProRES from Misitka, and then I added VFX and Graphics on Davinci Resolve - maybe even light color grade. So try ProRes render but not compressed H265 / H264? Resolve is my final step.
@@hughhou thanks! I think part of the problem is the conversion to rectilinear expands the video far beyond the 4k image box, and so only about half of the image is used, as it stretches. So resolution is lost. I am trying to do this expand in Premiere, where I can control how much resolution is lost.
Hugh, is there any way to use the BMD Ursa 12K for creating spatial video for the AVP? BMD has a huge following, and no one has presented a tutorial or even a guide. With that crazy amount of pixels, you would think there would be a way? I know there is an adaptor to make it compatible with the Canon EF mount. Thoughts?
I am actually super close to Blackmagic and their camera sadly is not RF Mount. RF Mount is only for Canon and RED. I use URSA 12K to shoot test for ESPN for boardcast, but 3D we need genlock sync and global shutter - which BM does not do.
Doggonit. This isn’t what I hoped it would be. It’s sending me to other hardware and software. It’s interesting that the video both assumes we are informed enough to need the tutorial but knowledgeable enough to know things like, what was so wrong with the initial 3D. I saw nothing wrong and so, do not know what the problem is that we are trying to solve with subsequent steps. Sadly, not for me. Best of luck to others.
hi Hugh, how ru? i hope you doing well. I am not a professional in filiming . I am in toy business, and after expeireniced the apple vision pro apple demo, i was thinking if there is any way, i can take video or picture of my business toy showroom and show to my customers anywhere with the vision pro. Making an inmersive exprience so they can see and even select some of my products. Is there any profesional camera, i can easly do by myself? or if i need to hire a professional servise? i will really much preciate your guidance
I need to test v62 on Quest 3 to report back. In theory, Meta is trying to show the full potential of Spatial Video but I have not have time to test it out yet.
Here. It is official release now as a film: ruclips.net/video/NN8eBxTNgB0/видео.htmlsi=CbApKSDHEdrzFHWF - download the free trailer. The tallking head is iPhone and the film itself is R5C - you can even see the image quality different here! Great for educational purposes.
Two questions: I know the Quest 3 can playback 16:9 framed Spatial Video, but can it playback VR180 (3D) as a Spatial Video? If so, which player? Also, I watched your spatial video episode and I'm still not clear on if the parallax effect is fake and simply moves the 16:9 frame around to match your parallax perspective or if it's almost but not quite volumetric video and closer to stereoscopic video that's been given a minor amount of fake volumetric depth using AI generated depth map.
1. You will need this tutorial to turn VR180 3D video into Spatial Video first then it can play back. VR180 and Spatial Video is TWO very different thing. It is like 360 video shot on 360 camera and reframe video crop from 360 video. / 2. There is huge debate in this topic. It is like 3D+ - not real parallax - but special treatment to make 3D look better in Spatial Video. It is NOT just 3D but it is not volumetric
@hughhou Got it. Thank you. I can see how it would help sell a more volumetric-like look without actually doing anything to the parallax of the original stereoscopic video. Ideally you'd want to add a depth map via AI and/or the lidar sensor to give it a more realistic parallax. Have you played around with Lifecast? It's volumetric video taken from the Canon dual fisheye and brought into Unreal. Would likely look even better in AVP than spatial video.
I just realize the clip is part of my upcoming Spatial Video Feature Film - my director won't allow me to release it until launch - which is tomorrow! We are making the world 1st Spatial Film on Vision Pro (or at least we think it is the 1st ...)
Hugh, I returned my Vision Pro because I didn’t see much difference in vr180 vs quest 3 I was playing high quality 8k video. How can Apple make it better given the limitations of vr180 video currently would a developer be able to use foveated rendering? I love vr180 video just wondering if you think I should repurchase Vision Pro I have the money but was initially disappointed vr180 wasn’t 3000 dollars better
Oh no my review is not even out yet lol. Haha, well, right now you are right on. VR180 is NOT technically support on AVP yet. But it is not even 10 days yet on one work that fast on develop something lol. It took 1 year to launch QTV on Meta. So we have to wait at least a month or 2. I don't think Apple will release support until FCP has a solution for making it better.
I see on the previous comment that 2 goPro will be a nightmare to sync (drift etc...). Is it better on two insta 360 to sync ?@@hughhou I'm waiting for the tutorial too !
So the sample I used belong to my latest film. So I will release it when I finish the Spatial Video version on AVP. Director do not want to release it until it is correctly color graded. So it should be available no later than Monday. The full film! I will ping you here when it is out.
@@hughhou wow yea I guess I was misinformed from a video, was clog 3 supported on The r5c since the beginning? I just noticed in the menu on mine yesterday 🤔 I film mostly on my mavo.
объясните простыми словами- это устройство демонскрирует 3Д сепарацию кадров, для отдельных глаза как в 3Д кинотеатре через поляризационный или анаглифный метод ?
ok, I am confused about this, what you are proposing here is regular 3D not spacial video with paralax, am I right? plus Quest can only play back regular 3D video without the parallax effect so it’s not the real thing. correct me if I’m wrong. I could not find a real spacial video to play on the quest and the demo video Meta is showing is also just a regular 3D video with blurred borders… it’s pretty stupid actually, why fake it with a blurred border, 3D video with a regular border is actually better imo.
This is Spatial Video - basically fancy 3D+ video by Apple. Not immersive video. Canon already do immersive video natively - so no need to do anything extra
I don't see the point of these outside of consumers using a phone and capturing family memories. Production studios would probably rather their experiences be more immersive, not limited by a frame.
See my other comment of the different between Spatial Video vs Immersive Format. This is about Spatial Video, and convert immersive format video into Spatial Video with way smaller FOV!
Yes. This is about Spatial Video NOT* immersive format. Immersive Format is exactly the same as what we used to on Meta Quest platform and we have been shooting immersive format on this channels for over 5 years. Apple themselve also only said Spatial Video is new, not Immersive Format as they know immersive format is VR180 video - what the Canon camera capture natively without you doing any extra thing.
ok, the more I look into this spatial video thing the more it looks like it's a scam, there is no praralax effect in it the way apple showed in their presentation, it's the same old 3D video repackeged as something new; it's not; correct me if I'm wrong please! here is a video about this: ruclips.net/video/xKxjjlY1Vxk/видео.htmlsi=nzaCScCqI_0GAfKB
I respect Mic but I don't think he is 100% correct on this one. I have extended experience on the AVP at this point as I have it from day 1 till now, in it prob more than 100+ hours. The source video is 3D yes. But the presentation is different inside AVP - not something I ever experience, especially when I code my own 3D video into Spatial Video as point out in this tutorial. AVP has eye head tracking to offset head movement in 3D to reduce motion sickness and a more immersive view. It is not a 3D video stuck to your face like current Meta or Pico (although this inspire Meta to update Quest to v62 firmware also roll out spatial video support - which they also do not think that is JUST 3D video). It is software magic, yes! Not camera magic but AVP tracking and software live rendering. But call it JUST 3D is incorrect.
is great to know that Apple managed to enhance 3D videos like this… but is the parallax effect as extreme as on their promo video? there looks like a real volumetric video with 6DoF… it’s hard to believe it is, that would be some crazy realtime AI video magic!
I normally really appreciate videos that go through workflow and best practices … but this was PAINFUL to watch. 25% of the way through the video and you are still just rambling on. Please CURATE your content … find a way to concisely make a point and move forward without re-re-re-making the same point. I stopped the video at 30% of the way through and decided to leave a constructive comment. It sounds like you know what you are talking about … but aren’t able to convey that information to others.
Thank you for the feedback. I will take into the account. Some of my viewers think I am going too fast on the key knowledge and some more experience viewers think I am repeating myself a lot. I do need to strike a balance to make everyone happy. Maybe better chapter list will help jump to session interests you the most?
Yes But this professional level so you probably rent the camera and get paid BIG DOLLARS from your clients - hint, commerials quality or film quality production. If your client pay for your AVP and your salary, why not?
I really want to learn from you. But I’m far into this video, and there’s still nothing about the workflow for shooting on the Canon, or editing for distribution to Apple Vision Pro. The music is terribly distracting, and you are so busy hyping and cross-promoting other videos that you aren’t actually delivering on the promise of the title. If you have expertise in this area, you have the opportunity to become THE expert. But you have to teach. You have to be helpful. You have to create substantive content. And right now, this is all hype, smoke and mirrors. Please stop with the magic tricks. And get to the point. I’ll try watching a couple more videos, but soon, I’m going to give up on you, and never watch you again. I don’t want to waste my time on fluff, learning nothing. And OMG the music. Stop with this music. Just talk to us like we are your friends. No more hype.
Thank you for the feedback. I should stop the music after intro. This video does go indepth into the workflow. But there is pre-require understanding the space, why use professional camera instead of Vision Pro onboard camera to give a reason why we need to go tho all the trouble to produce high quality content. Not all viewers are as experience as you and need some upsell of the workflow to understand the importance. On an instructional design standpoint, I need the belt and whistle to keep the young generation interests. It is hard to be creators at modern day distrated world and compete with TikTok. But you are 100% right. This video are rapid speed produced, so lot less tho put into it like our normal content. Thank you for sticking around.
can you please confirm with me if the Spatial Video on the Quest plays back with the parallax effect it has in the Vision Pro? the Meta’s demo video showing off the new Spatial Video playback does not have the parallax effect to my eyes, the only thing it has is the blurred borders but it’s just a regular 3D video. thanks!
I got the v62 update a few days ago and I tried it, looks like a regular 3D with blurred borders placed in the home environment with a little bit of dimming of the surroundings, it is pleasant to look at but there is 0 parallax effect on it as far as I can tell. I thought that Apple figured out how to process 3D footage with AI and introduce a little bit of a parallax effect to make it look like a pseudo volumetric video, even if it is very subtle it would go a long way to add realism and reduce the nauseating effect of regular 3D, I don’t have an AVP so I have no idea how the spatial video looks in it but I am pretty sure that is not as exaggerated as their promo video shows, am I wrong? how does it look to you on the AVP headset? An other interesting thing is that Boz, the Meta VR boss, on the Meta demo video explains what their “spatial” video is and it was nothing more than explaining how 3D video works in general, no parallax was mentioned in it and the video itself is just a simple 3D video on the Quest 2 I have. So are all the rest of the demo clips. What they did is they added a native 3D video player to the Quest OS so it can play the 3D videos recorded on the iPhone 15, nothing more imo, they are riding on the AVP hype… lol, again, there is no parallax effect in it at all, neither does your demo spatial video that I downloaded and also played through the Meta TV portal. My iPad pro recognizes it as a spatial video in the Photos app and it even displays a little icon confirming that it is that. Unfortunately I could not upload it to the headset through the Meta Mobile app as Meta is suggesting (they are very sloppy with programing in general btw), there is no upload button yet in the gallery on the app, according to reddit posts many people have similar experience, looks like they are rolling this feature out in increments. Maybe there is parallax effect on the Quest 3 or Pro but not on the Quest 2? idk, but it was underwhelming to be honest, I’ve been using the Quest 2 to view 3D videos and pictures for years now, I am a 3D photographer, so I got very exited about the possibility to record 3D video on the iPhone and even more excited about the “spatial” aspect of it but that is not coming through on Meta’s implementation of it. Confusing for sure, but I will get to the bottom of this! 😂🤣😅 Thank for your videos, they are very useful for 3D creators!
Great video as always, Hugh! Thank you for highlighting my spatial command-line tool. I'm glad that it worked well for you. FYI that I added some documentation yesterday, and the link can be found on the download page that you mentioned (and linked-to in your description).
Thanks again!
These days, I've been watching your video over and over again for three or four hours a day.
I've been under the illusion that I know you for a long time.
I'm always thankful!
Wow, thank you! Hey you do know me now!! If you watch last 3 of my videos, you have been in my house and see Kimchi 3 times lol.
It can be only ONE VR King!!! And it's Mr HH 🤩
Fr
That was a very long process. But I got my first one done. It seems to be the only way to accomplish this at this moment. Rendering left and right eyes and recombining…
It’s always good to learn the manual way first I agree! Thanks Hugh!
I am sure it will get easier in the workflow. This is week 2 of AVP lol. I still have lots to learn. We are in the same boat. When I have new trick I will share it immediately
Did you notice a loss of detail after the Mistika render? I’m using the 7 day trial version and the render (transcode actually) looks like half of the resolution of the original
RUclips’s support for 3D content, especially for side-by-side uploads, seems to have changed. Previously, there was an option to checkmark videos as 3D content directly on the platform, but this feature appears to be no longer available. This change has made it difficult for creators who wish to upload and present their content in 3D format. How can I do that on RUclips?
Yes. I have several tutorials on this topic - but I will make a follow up soon and add Spatial Video support
thank you brother and happy Lunar New Year@@hughhou
Not only is it no longer available to mark stereoscopic content, they destroyed the existing tags, breaking most classic "3d" videos. They later made exceptions for a handful like OK Go music videos, but all who are not getting the elusive support have to reupload with embedded metadata, losing links, likes, views, comments etc.
If you remux into Matroska format, you can set stereo_mode, e.g: ffmpeg -i input_file.mkv -c copy -metadata:s:v:0 stereo_mode=1 output_file.mkv
This is the video I've been waiting for. I bought the r5c with the dual fisheye 2 years ago. Picked up the 1tb vision pro and was hoping I could use it all together!
Now this is the KING of spatial video as well, not only VR180. Spread the love so more Dual Fisheye owner know they just triple the value of their investment
Very well done and informative. I think the big thing that Apple did especially with the iPhone 15 Pro is consumerize and grossly simplify the workflow you showcase in this video especially taking the main camera and the ultra wide lenses to compose the Spatial Videos ready for viewing on the Apple Vision Pro. Keep up the great work!
Indeed so everyone can try Spatial Video - which make brands aware of the format and want to do it professionally. Then leads to more jobs for creators - everyone win in the end! Thank you!
@@hughhou It makes more of us creators. But I'm personally excited to see what pros like you do in creating new content with Spatial Video and other immersive formats. I'm hoping that Apple and other's produce cinematic Spatial Video (not VR180). The display quality on the AVP is so impressive. That is what really commands that big price tag of the AVP. Micro-OLED is not cheap. Apple had to pay through the nose. They will eventually make the technology more accessible for others in the next couple of years. It's part of the Apple catalytic formula.
Dude, I'm watching this before flying to Florence, Italy to test out R5C with dual fish lens -> spatial video for AVP. Wish me luck!
So funny I am working on a Florence piece shot on R5C which I can finish in time to share it to your as a travel guide lol. But this is the old one shot on the R5C: ruclips.net/video/znoL7B_23Z0/видео.htmlsi=D-oSdtK9ItnpnB63
@ ah thanks! Yeah I’m familiar with spots in Florence and I’m doing engagement photos (I’m wedding photographer), but on top of that we’re trying out some spatial clips to see if we can create some spatial videos for the wedding next year
Thanks! You saved me tons of time!
Wow thank you!! More to come. Trying to keep it up 1 video a day but taking a break tomorrow for our Meta Quest VR Film release on Vday :)
这副360眼镜真好！我们喜欢！❤
thanks for this tutorial! fyi I had to change the render options from "Left/Right" to "Left/Right VR180" for it to work properly
Sorry I might make a mistake there - it is Left/Right VR180 :) You are correct!
Wondering - Have you noticed a big difference in the quality and playback of your VR180 & VR360 videos on the AVP vs the Meta Quest, Hugh? Thank your generous commitment to your channel.
To be 100% honest, not really lol. AVP color is better and playback is smooth without refresh rate issue. But the quality is not like night and day different. But this is prob b/c the solution is not official yet. When Apple provide their Apple TV pipeline, then will be huge different!
Hugh did a great tutorial on how to make a great spatial video; this is the path and tutor to follow.
Wow, thanks!
Hey Hugh, big thanks for this video ! It's incredibly helpful. After extensive research for a solution, I finally found it in your video.
Glad it helped!
Absolutely great work - as always! I saw the VR180 production from Italy on a Quest 3 yesterday. Wow! Great storytelling and quality. Is there a tutorial that shows how you achieved that wonderful cinematic look I am working with a R5C with dual fisheye. Besides wanting to know how to achieve that cinematic look I need to find the best way to record 90 minutes in a row and get the best quality possible for that very long recording time. Guess I will have to watch all your videos again.
Thank you Hugh for this very interesting video! You always manage to find great workflows that are a big help for creators 👏.
In my opinion, spatial videos are not very convincing; I find this technology less immersive than 180 or 360 videos that envelop the viewer, but that's just my opinion
Glad it was helpful! Yes for people know VR180. But for massive audience out there have not heard of VR180, 3D Spatial Video is their gateway drug onto immersive storytelling. My hope is more people come here and understand the format and what is out there. And slowly move them into VR180 - the true immersive format - also pushing by Apple and heavy by Meta and Pico.
Congratulations on the video! Is it possible to stream online with this lens?
It is certainly possible. I am working on a easy to follow solution now but take me a while to R&D. Will ping you when I release that workflow.
Thanks so much Hugh! Just ordered the r5c with dual fisheye and excited. I have a question: this tutorial shows how to create a spatial video for use in apples rectilinear/square Photos app format. And you have many videos regarding 180 degree 3D video for the AVP - but does 180 degree video have all the parallax and “ultra real” benefits of this spatial video method here? I’m trying to figure out if I need to build a rig to capture depth data as a film and recombine in post for nerf/splatting solutions that provide more immersion when I start filming immersive 180 content next week. I guess I’m asking “how did Apple film its demo content in Experience Immersive?” Any guesses? Thanks for everything!! You taught me like two years of stuff in one week!
Immersive 180 on AVP is exact the same as on Meta Quest 3 which shot on this setup or similar like RED V-Raptor. There is no movement like spatial video. The best example is Alica Keys or Adventure series on Apple TV. That’s your reference from official Apple.
Thank you for being so personable and responsive!
@@nadeemtron Hi nadeemtron, follow up to your question, how has your journey with r5c and fisheye lens been? Did you manage to shoot immersive video & play it back on vision pro (not spatial)? I'm blown away by apple's demos (MLS, Alica Keys etc.), and want to create that by myself. Thanks!
Hi there,
Thank you for providing such valuable insights!I have some questions that I'd love to discuss further with you:
1.Cost vs. Performance: Considering the significant price gap between the iPhone 15 Pro Max and the Canon EOS R5 C Mirrorless Cinema, how do they compare in terms of performance and value when it comes to producing high-quality spatial video content for VR?
2. Software Optimization and Workflow: How might the iPhone 15 Pro Max leverage its computational capabilities to streamline the process of capturing and editing spatial video for VR, especially compared to the Canon camera setup? Furthermore, considering Apple's expertise in software optimization, once the files are viewed in the Vision Pro, could Apple employ dedicated software enhancements or upscaling tricks to further enhance the final result?
3. Editing Complexity and Apple's Approach: Editing and preparing spatial video can be quite intricate, particularly given Apple's current lack of a dedicated editing tool in Final Cut for their new spatial video format. Have you heard any rumors or insights about potential developments in this area that could simplify the editing process?
I eagerly await your thoughts and insights on these questions. Thanks again for all your invaluable help. And keep up the amazing work!
iPhone spatial only shoots in 1080P
1. Consumer vs Professional quality. This should be always RENT than own. And get your clients pay for most of the cost. Hint commerial level. You can certainly use an iPhone to shoot commerials these days. But this is more a robust workflow.
2. I have a iPhone only workflow already which is in Davinci Resolve - link in this video description. FPC has no news so far. Crazy!
3. Yes. Apple is working hard on FPC to support Spatial Video. It is matter of time now. Right now, Resolve can do most of the thing and it is almost like free (if you get a BM camera or products).
Got it, thanks! @@hughhou
Another great video!
Have you found a way to view 180° 3D VR shot on the Canon Fisheye yet?
Moon player
Yes Moon Player right now. I am sure more to come.
Spatial video is cool, but I don’t understand why, if you have the capability to capture VR180 with the Canon R5c/Dual Fisheye Lens, you’d want to crop it to a small 3D rectangle?
Yeah, if you know what you're doing... there's no way you go back to spatial video. Well produced VR180 will now impress those with an Apple Vision Pro even MORE. BTW - the moon player is the closest to being able to play local VR180 files perfectly. There's a strange warp with the playback though... makes everything look like it was filmed on a giant ball. Bummer. But it should be fixed soon.
As Adam said. But most people don't know what VR180 is - just look at my video comments lol. Spatial Video is a gateway drug for them to get into VR180. But from 2D to VR180 is a big jump. Apple think that, not me.
Thanks! Do you have a tutorial like this to create Spatial Videos on Davinci Resolve from R5C?
Yes right here: ruclips.net/video/kwVlVEXg3og/видео.htmlsi=vAdFzHD0R0DwOApd and this for encoding: ruclips.net/video/PJWsscXmJiE/видео.htmlsi=E2clcH6p7PyFxSQ7
@@hughhou thank you. Just finished watching and it's an excellent one for VR180, but only mentions Spatial video conversion at 15:40
Still an excellent video!
Hey Hugh, thanks a lot for this video. I'm facing an issue after i render the video on mistika. There are these unusual reference dots appearing. Is it becuase im on a trial version ? how do i fix it ?
That sound like more a GPU issue - hardware rendering bug... mmmmmmm
Another great video! thanks Hugh! However I don't find the video download link in the description, can you show it again?
It is on my patreon: www.patreon.com/HughHouFilm
@@hughhou Thank you！
Thanks for your videos! Can we get an updated version of this coming from premiere with the canon plugin? Not sure what’s best codec to render to from premiere before doing the terminal steps…
Premiere does not support 3D editing (old school 3D) so in Adobe is hard. But I will let you know if I figure out how as I am pretty good at Premiere and After Effects.
I find that the iPhone 15 Pro Spatial Video is better at close quarters than the AVP. Anyone else notice the same thing? I also like the 16:9 aspect ration versus the square off of the AVP.
Yes! We actually explain it why on this video: ruclips.net/user/shortsUbDPpcwlCh0
Thanks hugh! Very interesting tutorial. Will you provide some tutorial for customized 3d rig for shotting spatial video. Such 2 Gopro for example. I already have the Canon R5C but i think we can produce high quality spatial video in another 2D regular cameras. As long as we can sync it or have a 63.5mm IPD.
Oh yes! That is coming next! 2X Insta360 or GoPro!!!!
🥰We know that you are always prepared to surprise us. You're the best!
Amazing video. Thanks Hugh!
My pleasure!
is it possible to do the ffmpeg spatial video encoding part of the workflow in an windows pc?
also is it possible to view any regular 3d sbs video as a spatial video on the meta quest?
Great video Hugh! So money aside, if you would have all the cash in the world. Which system would you think you would use for spatial video for Vision Pro?
2 x Red Raptors V/Sony Venice 2 in a 3D Rigg and the field of view of..? Appreciate it!
Just 1 V-Raptor [X] is probably what I will go for or dream to own one ... but a RUclipsr can only dream lol
Haha Have you tried 6dof on it yet? 😅See that one, but renting is not always bad either!
Hey man, quick question:
Have you ever tried to use two GoPros with the max lens side by side to get Stereo VR 180?
Saw some samples online but wondering if you had any suggestions or concern that would steer me away from trying it.
Thank you!
Honestly? I will not suggest it. Sync will be a nightmare as GoPro is not genlock sync and it will drift as rolling shutter. Great for people doing it but in practical shooting is hard to control. The drift can not be fixed in post.
Thank you very much for the reply!
I was just trying to help a friend who need to shoot a music video in Italy and doesn’t have access to a Canon R5. So even with a remote that triggers both cameras, they’ll have sync issues…good to know, you saved us a lot of editing headaches!
What camera would you try to get, even sacrificing some quality in favor of easy availability in Europe?
Thanks a ton!
The best solution is Canon R5 + dual lens fish eyes ? Is any other solution with the best resolution possible ? Can it be streamed ?
I will have other solution very soon making a new tutorial on this topic. R5C can not do HLS streaming but this one can (and will work on Vision Pro if someone build the player app): ruclips.net/video/jmOX6aHj8oI/видео.htmlsi=HxN0DCQmrWws7Hum
great job as usual . but the images from mystika are really bad, a lot of artifact, a lot a colored dots i use the demo version of mystika any advice? thx
Thanks for that great tutorial! So when playing back the converted file on Vision Pro; do you have parallax effect? (thus 6dof). If this is the case, do you know if the depth is generated on the fly? or by Mike Swanson's tool, stored in the mv-hevc file?
NOT 6DoF - 6DoF is only available on VolCap or Game Engine. This is just optical illusion parallax effect using eye and head tracking on the AVP. It is more than JUST 3D but still based on original 3D video. And yes, this workflow add immersive view and "Apple Parallax Effect" (edge blocking and edge parallax). It will work on all 3D video. It has been confusing on this spatial video topic. I wish Apple just say this is 3D+ instead of Spatial Video.
@@hughhou thanks for the explaination! I was thinking maybe they uses their tof sensor or cameras to create a kind of multi layered video (or even using "Depth Anything" to estimate depth with AI). So it looks like its more about a good 3d integration in the passthough. I've tried the new "spatial video" on Meta Quest 3; does it look the same?
Hello Hugh, thanks for the impassioned coverage! Hugh, do you have a tutorial to convert circular fisheye to 1:1 equirectangular, in DaVinci Resolve Studio? I would love to streamline this step, before stepping into Spacial. Thanks!
It is very similar on one of my old tutorial about defish Canon Fisheye using Fusion - it is one of my popular Resolve Tutorial on Canon Dual Fisheye lens. Same concept. Instead of 2 fish you get 1 fish here.
Thanks Hugh, found your video (ruclips.net/video/2GW7nb47rB4/видео.html). Unfortunately I cannot find the KartaVR plugins for Resolve/Fusion available anywhere for download (the link goes to the Facebook page, which has not been active a couple years). Any idea where we can find them today? I am looking and will post here if I find anything. Thanks for any leads!
Hello blogger, I saw the 360 panoramic photos you took on immerse. They are very high-definition, but the pictures I took using DJI Mavic 2Pro & Insta360 x3 are not clear. I want to know how you did it. Looking forward to it. You can answer and reply🙏
We have lots of workflow on 360 panoramic photos. Here is a good one to start: ruclips.net/video/hg1m-GlYnuI/видео.htmlsi=wQbuSD5tOjW2AaF6 / ruclips.net/video/vb8-2gQYp8c/видео.htmlsi=tvDvJSqIeOg-PMnK
@@hughhou thanks so much！！
Great tutorial, thanks! Did you say that you knew of a way to play 3D SBS (non 180 / 360) without the spatial format in AVP? I couldn't find a way to do that yet (and none of the apps like Moon support it yet either)
I think you still need to tell AVP this is 3D video in metadata. Just don't inject spatial metadata.
Can you render with software to get better quality instead of hardware? Like x265 vs video toolbox? It makes such a big difference with H265, wondering if possible with MV-HEVC
H265 is HEVC - so yes in theory? MV-HEVC just has 3D wrapper on top of HEVC.
Thanks for a great Video Hugh. Would you have some sample videos that we could download and view on a Vision Pro. I am thinking of getting the 5.2 to use with either the R5 or Red Komodo.
I believe the Red komodo is not full frame, so it may not work with the 5.2mm lens
Thanks@@nariza7 good point - I had not thought of that.
Yes. The full trailer and full film are here: ruclips.net/video/NN8eBxTNgB0/видео.htmlsi=OlRLaQ5Hjc7eDQp1
Thanks @@hughhou ...Downloading. Shot with the AVP? and it can just be viewed on AVP or needs a player?
WOW! Awesome work! What was that filmed on - the really High Def parts? Especially the stabilised walking scenes. Thank you for sharing. I will be subscribing.
Which camera is better to use to record real estate tour videos for real estate agencies 180 or 360?
Hugh, do you know a way to inject vr180 RUclips metadata without the creator app? I am trying to inject metadata at 8640x4320 resolution and the app gives me an error
Yes. Premiere natively support it! I use Premiere still on render.
Photos: I'm interested in creating spatial photos for the AVP. I can't seem to find any info on how this works with the Canon dual fisheye lenses. How difficult is the workflow?
Help Hugh! I’m using the 7 day trial of Mistika and the rendered output file has lost all the detail of the original file. The original is an 8k file, and I rendered to two side by side 4k images per your guidance, but Mistika just destroyed the detail in the image. Is it the free license or do your encodes also lose a lot of the image detail? Thanks for the video!
Mmmm... I render in ProRES from Misitka, and then I added VFX and Graphics on Davinci Resolve - maybe even light color grade. So try ProRes render but not compressed H265 / H264? Resolve is my final step.
@@hughhou thanks! I think part of the problem is the conversion to rectilinear expands the video far beyond the 4k image box, and so only about half of the image is used, as it stretches. So resolution is lost. I am trying to do this expand in Premiere, where I can control how much resolution is lost.
Hugh, is there any way to use the BMD Ursa 12K for creating spatial video for the AVP? BMD has a huge following, and no one has presented a tutorial or even a guide. With that crazy amount of pixels, you would think there would be a way? I know there is an adaptor to make it compatible with the Canon EF mount. Thoughts?
I am actually super close to Blackmagic and their camera sadly is not RF Mount. RF Mount is only for Canon and RED. I use URSA 12K to shoot test for ESPN for boardcast, but 3D we need genlock sync and global shutter - which BM does not do.
I wish there was a 180 lens for this beast! @@hughhou
I’m…going to love this video.
::waits for ads to end::
Doggonit.
This isn’t what I hoped it would be. It’s sending me to other hardware and software.
It’s interesting that the video both assumes we are informed enough to need the tutorial but knowledgeable enough to know things like, what was so wrong with the initial 3D.
I saw nothing wrong and so, do not know what the problem is that we are trying to solve with subsequent steps.
Sadly, not for me. Best of luck to others.
hi Hugh, how ru? i hope you doing well. I am not a professional in filiming . I am in toy business, and after expeireniced the apple vision pro apple demo, i was thinking if there is any way, i can take video or picture of my business toy showroom and show to my customers anywhere with the vision pro. Making an inmersive exprience so they can see and even select some of my products. Is there any profesional camera, i can easly do by myself? or if i need to hire a professional servise? i will really much preciate your guidance
I will start with just your iPhone to test water before investing immersive camera. But Canon is what I used :)
Does the parallax effect show if viewing on quest or in my case pc vr apps like virtual desktop or virtual home theater ?
I need to test v62 on Quest 3 to report back. In theory, Meta is trying to show the full potential of Spatial Video but I have not have time to test it out yet.
Can you review the EOS VR utility or its plugin for Premier Pro?
I have both on my channels already. You can search EOS VR Utility Hugh Hou it should show up :)
@@hughhouWill do, thanks!
Cant find the link to the video to try on my vision pro. Where is it?
Here. It is official release now as a film: ruclips.net/video/NN8eBxTNgB0/видео.htmlsi=CbApKSDHEdrzFHWF - download the free trailer. The tallking head is iPhone and the film itself is R5C - you can even see the image quality different here! Great for educational purposes.
Two questions:
I know the Quest 3 can playback 16:9 framed Spatial Video, but can it playback VR180 (3D) as a Spatial Video? If so, which player?
Also, I watched your spatial video episode and I'm still not clear on if the parallax effect is fake and simply moves the 16:9 frame around to match your parallax perspective or if it's almost but not quite volumetric video and closer to stereoscopic video that's been given a minor amount of fake volumetric depth using AI generated depth map.
1. You will need this tutorial to turn VR180 3D video into Spatial Video first then it can play back. VR180 and Spatial Video is TWO very different thing. It is like 360 video shot on 360 camera and reframe video crop from 360 video. / 2. There is huge debate in this topic. It is like 3D+ - not real parallax - but special treatment to make 3D look better in Spatial Video. It is NOT just 3D but it is not volumetric
@hughhou Got it. Thank you. I can see how it would help sell a more volumetric-like look without actually doing anything to the parallax of the original stereoscopic video.
Ideally you'd want to add a depth map via AI and/or the lidar sensor to give it a more realistic parallax.
Have you played around with Lifecast? It's volumetric video taken from the Canon dual fisheye and brought into Unreal. Would likely look even better in AVP than spatial video.
where is the link to download and watch the final video on AVP?
..id like to view it
I just realize the clip is part of my upcoming Spatial Video Feature Film - my director won't allow me to release it until launch - which is tomorrow! We are making the world 1st Spatial Film on Vision Pro (or at least we think it is the 1st ...)
Hugh, I returned my Vision Pro because I didn’t see much difference in vr180 vs quest 3 I was playing high quality 8k video. How can Apple make it better given the limitations of vr180 video currently would a developer be able to use foveated rendering? I love vr180 video just wondering if you think I should repurchase Vision Pro I have the money but was initially disappointed vr180 wasn’t 3000 dollars better
Oh no my review is not even out yet lol. Haha, well, right now you are right on. VR180 is NOT technically support on AVP yet. But it is not even 10 days yet on one work that fast on develop something lol. It took 1 year to launch QTV on Meta. So we have to wait at least a month or 2. I don't think Apple will release support until FCP has a solution for making it better.
What is FCP?
@@FNCSREDBULL Final Cut Pro
final cut pro @@FNCSREDBULL
Final Cut Pro@@FNCSREDBULL
万分感谢老师的干货！请问下，这样制作出来的空间视频可以在vision pro里直接播放吗？ 还是需要额外下载什么播放器？
不需要播放器-可以直接观看！
hey Hugh, thx for this amazing video again!! Just one thing - it seems that your Mistika code for 10% off doesn't work?
I love Kimchi. Great name for a great doggie. My dog is called noodle!
Lol thank you and Kimchi said hi
Where is the smaller "spatial" file generated from?
Sorry my director do not want me to put that out yet as that is part of this film: ruclips.net/video/iAG2AN94tZA/видео.htmlsi=6IVvpZ4IJXWz-SJ3
Thank you@@hughhou -- I meant is that smaller file something that is generated from a workflow, or is that literally just a short clip.
When I use Spatialify it gives me an mp4 file. Am I doing something wrong?
Not really. MP4 work as well btw but MOV can get lossless audio and way way higher quality!
@@hughhou Thanks!
On a scale from 1-10. Where do you rank the quest 3 vs vision pro Vr180 playback.
They are like 5 vs 6 - all not ideal lol. Maybe need AVP 2 to get there. I am cynical tho.
What would be ideal. How would you get a 10
佳能配双鱼眼不知道要多少钱？
$2000 美金 - 国内可能跟便宜。美国一般比较贵
So can the quest display spatial video from the iPhone?
Yes in v62!!!!!
Question is it possible use 2 insta360 to make a 180 vr for it? Or the insta360 R 1in?
Yes! Tutorial is coming as well!
I see on the previous comment that 2 goPro will be a nightmare to sync (drift etc...). Is it better on two insta 360 to sync ?@@hughhou I'm waiting for the tutorial too !
So where is the link to the download of the spatial video of yours? ☺️
So the sample I used belong to my latest film. So I will release it when I finish the Spatial Video version on AVP. Director do not want to release it until it is correctly color graded. So it should be available no later than Monday. The full film! I will ping you here when it is out.
I believe its Clog 2 not 3 as the R5 & C isn't not clog3
I shot at C log 3 why you think it is not C log 3?
@@hughhou wow yea I guess I was misinformed from a video, was clog 3 supported on The r5c since the beginning? I just noticed in the menu on mine yesterday 🤔 I film mostly on my mavo.
Hi! I tried recording 3d vids on my quest 3 but they come out smooshed. Do u have any tips?
New v62 will have lots of improvement. Wait till end of this week for update and try again?
объясните простыми словами- это устройство демонскрирует 3Д сепарацию кадров, для отдельных глаза как в 3Д кинотеатре через поляризационный или анаглифный метод ?
Awesomeeeee :)
Thank you! Cheers!
I would be more interested in comparing the CALF rather than Kandao Ego.
Good suggestion. Let me put my CALF to work!!!
感谢分享，满满的干货～❤
我的MP4文件无法input，8K SBS
用spatial转换的时候，无法输入，这个工具是对分辨率有要求吗？
没有。是不是你的codec有问题？用handbrake来转换成h264？
Great tutorial. But seriously, why is the dog on the kitchen table
Camera test! Kimchi love to be filmed!!
ok, I am confused about this, what you are proposing here is regular 3D not spacial video with paralax, am I right? plus Quest can only play back regular 3D video without the parallax effect so it’s not the real thing. correct me if I’m wrong. I could not find a real spacial video to play on the quest and the demo video Meta is showing is also just a regular 3D video with blurred borders… it’s pretty stupid actually, why fake it with a blurred border, 3D video with a regular border is actually better imo.
This is Spatial Video - basically fancy 3D+ video by Apple. Not immersive video. Canon already do immersive video natively - so no need to do anything extra
I don't see the point of these outside of consumers using a phone and capturing family memories. Production studios would probably rather their experiences be more immersive, not limited by a frame.
This is not Apple immersive format.
See my other comment of the different between Spatial Video vs Immersive Format. This is about Spatial Video, and convert immersive format video into Spatial Video with way smaller FOV!
This is not how to create an Apple immersive video. Spatial and Apple immersive format are completely different.
Yes. This is about Spatial Video NOT* immersive format. Immersive Format is exactly the same as what we used to on Meta Quest platform and we have been shooting immersive format on this channels for over 5 years. Apple themselve also only said Spatial Video is new, not Immersive Format as they know immersive format is VR180 video - what the Canon camera capture natively without you doing any extra thing.
Why does this guy talk like he's DJing at EDC?
I simply can't understand him. I really trued.
Awww what do you not understand?
ok, the more I look into this spatial video thing the more it looks like it's a scam, there is no praralax effect in it the way apple showed in their presentation, it's the same old 3D video repackeged as something new; it's not; correct me if I'm wrong please! here is a video about this: ruclips.net/video/xKxjjlY1Vxk/видео.htmlsi=nzaCScCqI_0GAfKB
I respect Mic but I don't think he is 100% correct on this one. I have extended experience on the AVP at this point as I have it from day 1 till now, in it prob more than 100+ hours. The source video is 3D yes. But the presentation is different inside AVP - not something I ever experience, especially when I code my own 3D video into Spatial Video as point out in this tutorial. AVP has eye head tracking to offset head movement in 3D to reduce motion sickness and a more immersive view. It is not a 3D video stuck to your face like current Meta or Pico (although this inspire Meta to update Quest to v62 firmware also roll out spatial video support - which they also do not think that is JUST 3D video). It is software magic, yes! Not camera magic but AVP tracking and software live rendering. But call it JUST 3D is incorrect.
is great to know that Apple managed to enhance 3D videos like this… but is the parallax effect as extreme as on their promo video? there looks like a real volumetric video with 6DoF… it’s hard to believe it is, that would be some crazy realtime AI video magic!
I normally really appreciate videos that go through workflow and best practices … but this was PAINFUL to watch. 25% of the way through the video and you are still just rambling on. Please CURATE your content … find a way to concisely make a point and move forward without re-re-re-making the same point. I stopped the video at 30% of the way through and decided to leave a constructive comment. It sounds like you know what you are talking about … but aren’t able to convey that information to others.
Thank you for the feedback. I will take into the account. Some of my viewers think I am going too fast on the key knowledge and some more experience viewers think I am repeating myself a lot. I do need to strike a balance to make everyone happy. Maybe better chapter list will help jump to session interests you the most?
Recording en 3d? ? Price: apple vision +camera 3d?? 10.000 dolares ????? 😂😂😂😂😂😂
Yes But this professional level so you probably rent the camera and get paid BIG DOLLARS from your clients - hint, commerials quality or film quality production. If your client pay for your AVP and your salary, why not?
@@hughhou yes, recording for avatar 3 or 4 no?? 🤣🤣🤣👍
Please speak chinese…
I really want to learn from you. But I’m far into this video, and there’s still nothing about the workflow for shooting on the Canon, or editing for distribution to Apple Vision Pro. The music is terribly distracting, and you are so busy hyping and cross-promoting other videos that you aren’t actually delivering on the promise of the title. If you have expertise in this area, you have the opportunity to become THE expert. But you have to teach. You have to be helpful. You have to create substantive content. And right now, this is all hype, smoke and mirrors. Please stop with the magic tricks. And get to the point. I’ll try watching a couple more videos, but soon, I’m going to give up on you, and never watch you again. I don’t want to waste my time on fluff, learning nothing. And OMG the music. Stop with this music. Just talk to us like we are your friends. No more hype.
Thank you for the feedback. I should stop the music after intro. This video does go indepth into the workflow. But there is pre-require understanding the space, why use professional camera instead of Vision Pro onboard camera to give a reason why we need to go tho all the trouble to produce high quality content. Not all viewers are as experience as you and need some upsell of the workflow to understand the importance. On an instructional design standpoint, I need the belt and whistle to keep the young generation interests. It is hard to be creators at modern day distrated world and compete with TikTok. But you are 100% right. This video are rapid speed produced, so lot less tho put into it like our normal content. Thank you for sticking around.
can you please confirm with me if the Spatial Video on the Quest plays back with the parallax effect it has in the Vision Pro? the Meta’s demo video showing off the new Spatial Video playback does not have the parallax effect to my eyes, the only thing it has is the blurred borders but it’s just a regular 3D video. thanks!
v62 is not out yet? I can't test it until it is out. Unless I missed the update?
I got the v62 update a few days ago and I tried it, looks like a regular 3D with blurred borders placed in the home environment with a little bit of dimming of the surroundings, it is pleasant to look at but there is 0 parallax effect on it as far as I can tell. I thought that Apple figured out how to process 3D footage with AI and introduce a little bit of a parallax effect to make it look like a pseudo volumetric video, even if it is very subtle it would go a long way to add realism and reduce the nauseating effect of regular 3D, I don’t have an AVP so I have no idea how the spatial video looks in it but I am pretty sure that is not as exaggerated as their promo video shows, am I wrong? how does it look to you on the AVP headset? An other interesting thing is that Boz, the Meta VR boss, on the Meta demo video explains what their “spatial” video is and it was nothing more than explaining how 3D video works in general, no parallax was mentioned in it and the video itself is just a simple 3D video on the Quest 2 I have. So are all the rest of the demo clips. What they did is they added a native 3D video player to the Quest OS so it can play the 3D videos recorded on the iPhone 15, nothing more imo, they are riding on the AVP hype… lol, again, there is no parallax effect in it at all, neither does your demo spatial video that I downloaded and also played through the Meta TV portal. My iPad pro recognizes it as a spatial video in the Photos app and it even displays a little icon confirming that it is that. Unfortunately I could not upload it to the headset through the Meta Mobile app as Meta is suggesting (they are very sloppy with programing in general btw), there is no upload button yet in the gallery on the app, according to reddit posts many people have similar experience, looks like they are rolling this feature out in increments. Maybe there is parallax effect on the Quest 3 or Pro but not on the Quest 2? idk, but it was underwhelming to be honest, I’ve been using the Quest 2 to view 3D videos and pictures for years now, I am a 3D photographer, so I got very exited about the possibility to record 3D video on the iPhone and even more excited about the “spatial” aspect of it but that is not coming through on Meta’s implementation of it. Confusing for sure, but I will get to the bottom of this! 😂🤣😅 Thank for your videos, they are very useful for 3D creators!