The potential here is huge, and I'm really looking forward to the day when you can seemlessly see 'external' controls as well as yourself in the level of detail we now enjoy in MSFS. Graphics cards and CPU's are still bounding ahead, so ultimately the computer power will be there and it becomes a software development exercise. Great times ahead!
I just returned 3 weeks ago from the Czech republic where I flew the DogFight Boss F-18C physical cockpit, full motion with Motion Systems 6DOF platform, along with the Varjo XR-3 Focal Edition headset, the experience was unbelievable. I own a DogFight Boss physical cockpit, every switch, every knob, every screen in the MIP, and all caution/warning advisory panel lights operational. My next step is to add the Varjo XR-3, but currently am using the HTC Vive XR Elite. @Russ Barlow, this demonstration is awesome, as I have Reality Mixer, and want to start experimenting with it, you've given me the motivation to do so. I'm a retired US Army Blackhawk Maintenance Test Pilot, and the evolution of personal, commercially available flight simming, with xtended reality is very exciting and promising. Again, great video!
As 'hacky' as this is, what a fantastic result for a home sim. Very very exciting! Thanks for sharing Russ, Will be sure to share this with the GotFriends MSFS dev team! - Developer Mykrode
Thanks. I have to admit I feel like there is no good way to make inputs to the MS/Asobo team. I send an email to Austin Meyer and he answers the same day. Wish MS was not such a bureaucratic leviathan
This is amazing. As you said, I had no idea this was going to be available anytime soon. This is really exciting. I fly VR all the time now. I can't seem to go back to the 2d flying. And this functionality is the only thing that was missing. I can't wait to try it out. Thanks for letting us know about this. :)
With the proper pass through full color high rez 3D Video it would be awesome. I agree flat screen sims don’t do it for me anymore. Problem is I like building cockpits so this could be the best of both worlds
@@rbarlow I absolutely agree! I love the hardware in front of me in 2D (just like real aircraft) but can't give up the immersion of VR. I agree. Best of both indeed. :) VR (for me at least) really scratches the itch to fly. :)
What actually is needed is the ability to get rid of the 3D panel in FS, so a homebuilt panel can be used. And the box should be resizeable to fit the MIP.
I started building my home GA cockpit with triple 55" tv's some months ago. I really tried to go the VR route but despite amazing immersion, it just had too many downfalls for me. I'll continue building my panel and adding switches, cause I'm expecting to use that once mixed reality gets good for consumers and with good enough pass through to also see the panel. Hopefully in a few years, then I'll replace my triple tv's.
I suspect as the pass through technology becomes more abundant others will develop solutions for this too. I know Varjo uses registration marks on the sim so that the pass through and VR worlds are correctly aligned regardless of the initial headset position.
I wonder if, instead of setting approximate areas us, it would be possible to green screen an area around a bounding box so the software could say "anything that is within the box, but is green I'll ignore". That way you could green screen exactly what you don't want to display. Obviously this won't work with the current software but it might make for a more accurate interleaving of the virtual and real world.
Actually he is working on that in the next beta…. But a green screen requires space and cost sand the adjustable boxes work fine once you get used to it. You can create a profile of boxes for different aircraft too.
This one is gonna be big I hear green screen is coming and the ability to use any camera. The only downside for me is I don’t use the steam version of msfs being that open xr toolkit is doing amazing things for visuals
@@rbarlow when I saw the video I had a flash back to before I had a HP Reverb G2 I tried the Quest 2 and the pass through on that was terrible unless you had plentiful ambient light lol.
Hello, Russ...how are you, Captain? Mark Alviso here, one of your old 73 co-pilots at USAir. I was delighted to discover your excellent sim vids. Many fond memories of sharing the cockpit with you. Not too many guys made the impression on me that you did. Your engineering background and meticulousness shines through on every video. You've gotten a lot older, as have I - (67 this week) but I remember how you were back then - and you really haven't changed at all. Deliberate, logical, intelligent, interesting, affable. The same ol' Russ Barlow. I hung on until the Covid madness of 2020 and then punched out from the AAL Airbus in Dec of that year, about 2 years early - the atmosphere in MIA had become oppressive, and they were threatening me with termination because I wouldn't take the jab, and on top of that they were offering the more senior Capts financial incentives - 'offers I couldn't refuse,' as they would say in PHL. Anyway, just wanted to reach out and acknowledge the memories. Will be watching more of your vids. They are the best on the WWW. BTW, will be attending Sun N' Fun this week for the first time. Maybe I will get to see you - or at least, maybe one of your old Phantoms with Leading edge Boundary Layer Control.
Hi Mark. I always enjoyed our trips together not only because of your excellent airmanship but also for the many engaging conversations we shared. I always found your finely-tuned skill of sarcasm quite entertaining. Glad to hear you have escaped the asylum too. I am not at Sun N' Fun this year but will attend Air Venture in July as usual. Hope our paths may cross in the future. Drop me an email so we can stay in contact. I'm at barlow320 which is a gmail dot com address.
I can't wait for this to be available for home cockpit builders that have the store edition of MSFS! I don't have a VR unit yet. Still using Track IR with 3x 55" screens
So, yesterday I tried the Quest 3 for the first time and I was very happy to see high quality pass-through mixed reality has finally come to consumer headsets. While it's not as good as on the XR-3 it is definitely "good enough". I think we will finally see mixed reality coming to home flight sims. With Reality Mixer + Virtual Desktop it looks like it can already be made today. I will do some experiments in the coming days.
Hi Russ! Yesterday I made my first successful connection and decent use of Virtual Desktop Reality Mixer on Quest 3 in DCS. I am ready for the next step which is why I am reaching out. How do you keep reality mixer window boxes centered on the same view as virtual desktop? I find that by the time I launch everything the two apps come slightly off center to each other.
That is a pain. You have to press and hold down the right controller meta button and it will re-initialize the reference of the headset based on where your head is pointing. You can move your head slightly left and right and continue to push until you get things lined up with the physical world. Once you have the headset reality, mixer boxes aligned with the area in the real world it is just a matter of adjusting the vr head position in the sim.
@@rbarlow Wow ty for quick reply! I am looking into Trackers. I see there is an option to attach the box to one. I am hoping that if I place a tracker on my pit I can link the viewports to it and have them always be in the right relative position. I was looking for what is compatible and I see that Vive and Tundra are listed on the description in store.
Hi, I’m using this with quest 3, Can’t find how to make the edges clear like yours instead of the border lines, any help appreciated :) Been loving this with my sim
The quality of the G2 B & W Video is just not clear enough. The next update will allow using an external color camera added to the headset( like a 4K webcam) and when that is available I will try again so stay tuned
I was hoping Varjo would do that for Aero owners. It has the clarity to pull it off and the obviously have the technology. I think they waiting until they have fully exploited the high end early adopters before creating an almost as good alternative.😊
It is a beta now and he’s a one man developer so cut him some slack. He probably doesn’t have a quest 2 to develop on. Now it is SteamVR but maybe OpenXR in the future.
The potential here is huge, and I'm really looking forward to the day when you can seemlessly see 'external' controls as well as yourself in the level of detail we now enjoy in MSFS. Graphics cards and CPU's are still bounding ahead, so ultimately the computer power will be there and it becomes a software development exercise. Great times ahead!
Yes, me too!
I just returned 3 weeks ago from the Czech republic where I flew the DogFight Boss F-18C physical cockpit, full motion with Motion Systems 6DOF platform, along with the Varjo XR-3 Focal Edition headset, the experience was unbelievable. I own a DogFight Boss physical cockpit, every switch, every knob, every screen in the MIP, and all caution/warning advisory panel lights operational. My next step is to add the Varjo XR-3, but currently am using the HTC Vive XR Elite. @Russ Barlow, this demonstration is awesome, as I have Reality Mixer, and want to start experimenting with it, you've given me the motivation to do so. I'm a retired US Army Blackhawk Maintenance Test Pilot, and the evolution of personal, commercially available flight simming, with xtended reality is very exciting and promising. Again, great video!
As 'hacky' as this is, what a fantastic result for a home sim. Very very exciting! Thanks for sharing Russ,
Will be sure to share this with the GotFriends MSFS dev team!
- Developer Mykrode
Thanks. I have to admit I feel like there is no good way to make inputs to the MS/Asobo team. I send an email to Austin Meyer and he answers the same day. Wish MS was not such a bureaucratic leviathan
Nice one Russ..... I can see the potential.
Hope so!
This is amazing. As you said, I had no idea this was going to be available anytime soon. This is really exciting. I fly VR all the time now. I can't seem to go back to the 2d flying. And this functionality is the only thing that was missing. I can't wait to try it out. Thanks for letting us know about this. :)
With the proper pass through full color high rez 3D Video it would be awesome. I agree flat screen sims don’t do it for me anymore. Problem is I like building cockpits so this could be the best of both worlds
@@rbarlow I absolutely agree! I love the hardware in front of me in 2D (just like real aircraft) but can't give up the immersion of VR. I agree. Best of both indeed. :) VR (for me at least) really scratches the itch to fly. :)
What actually is needed is the ability to get rid of the 3D panel in FS, so a homebuilt panel can be used. And the box should be resizeable to fit the MIP.
I started building my home GA cockpit with triple 55" tv's some months ago. I really tried to go the VR route but despite amazing immersion, it just had too many downfalls for me. I'll continue building my panel and adding switches, cause I'm expecting to use that once mixed reality gets good for consumers and with good enough pass through to also see the panel. Hopefully in a few years, then I'll replace my triple tv's.
That is my plan too. I accurate cockpit that can seamlessly blend into VR
Very kewl starting point for this type of software.
I suspect as the pass through technology becomes more abundant others will develop solutions for this too. I know Varjo uses registration marks on the sim so that the pass through and VR worlds are correctly aligned regardless of the initial headset position.
I wonder if, instead of setting approximate areas us, it would be possible to green screen an area around a bounding box so the software could say "anything that is within the box, but is green I'll ignore". That way you could green screen exactly what you don't want to display. Obviously this won't work with the current software but it might make for a more accurate interleaving of the virtual and real world.
Actually he is working on that in the next beta…. But a green screen requires space and cost sand the adjustable boxes work fine once you get used to it. You can create a profile of boxes for different aircraft too.
This one is gonna be big I hear green screen is coming and the ability to use any camera. The only downside for me is I don’t use the steam version of msfs being that open xr toolkit is doing amazing things for visuals
Yes and I would guess other options will follow too when the hardware become more inexpensive and available.
So I found that if you use a bright white light over head facing down it drastically improves the image quality of the pass through. Give it a try
Thanks for the tip. As I said I am only a few hours into Reality Mixer
@@rbarlow when I saw the video I had a flash back to before I had a HP Reverb G2 I tried the Quest 2 and the pass through on that was terrible unless you had plentiful ambient light lol.
I’m going to try this in iracing so I can see a stream deck and a button box.
have anyone tried this with the q3 yet ?
Hello, Russ...how are you, Captain? Mark Alviso here, one of your old 73 co-pilots at USAir. I was delighted to discover your excellent sim vids. Many fond memories of sharing the cockpit with you. Not too many guys made the impression on me that you did. Your engineering background and meticulousness shines through on every video. You've gotten a lot older, as have I - (67 this week) but I remember how you were back then - and you really haven't changed at all. Deliberate, logical, intelligent, interesting, affable. The same ol' Russ Barlow. I hung on until the Covid madness of 2020 and then punched out from the AAL Airbus in Dec of that year, about 2 years early - the atmosphere in MIA had become oppressive, and they were threatening me with termination because I wouldn't take the jab, and on top of that they were offering the more senior Capts financial incentives - 'offers I couldn't refuse,' as they would say in PHL. Anyway, just wanted to reach out and acknowledge the memories. Will be watching more of your vids. They are the best on the WWW. BTW, will be attending Sun N' Fun this week for the first time. Maybe I will get to see you - or at least, maybe one of your old Phantoms with Leading edge Boundary Layer Control.
Hi Mark. I always enjoyed our trips together not only because of your excellent airmanship but also for the many engaging conversations we shared. I always found your finely-tuned skill of sarcasm quite entertaining. Glad to hear you have escaped the asylum too. I am not at Sun N' Fun this year but will attend Air Venture in July as usual. Hope our paths may cross in the future. Drop me an email so we can stay in contact. I'm at barlow320 which is a gmail dot com address.
The future is exciting! Way cool!
Yes it is a great time for this hobby.
Can it work with a HD webcam attached to HMD? Full HD webcams provide much higher quality image.
He’s working on that in a future release.
I can't wait for this to be available for home cockpit builders that have the store edition of MSFS! I don't have a VR unit yet. Still using Track IR with 3x 55" screens
Hope you have tried VR… just can’t describe it or show it on a video.
Nicely done Russ, you are always on the forefront of Sim technology. This was such an exciting glimpse of the certain future.
Shucks Chuck...I bet you tell all the guys that😀
This would work well if they added a green screen capability. You could build an entire cockpit and put the windows as green screen.
Yes green screen chroma key is coming soon….but you need high rez cameras to read instruments and charts
Definitely the future of Sim. Tnx for bringing
Thanks for your comment. I agree.
So, yesterday I tried the Quest 3 for the first time and I was very happy to see high quality pass-through mixed reality has finally come to consumer headsets. While it's not as good as on the XR-3 it is definitely "good enough". I think we will finally see mixed reality coming to home flight sims. With Reality Mixer + Virtual Desktop it looks like it can already be made today. I will do some experiments in the coming days.
Hi Russ! Yesterday I made my first successful connection and decent use of Virtual Desktop Reality Mixer on Quest 3 in DCS. I am ready for the next step which is why I am reaching out. How do you keep reality mixer window boxes centered on the same view as virtual desktop? I find that by the time I launch everything the two apps come slightly off center to each other.
That is a pain. You have to press and hold down the right controller meta button and it will re-initialize the reference of the headset based on where your head is pointing. You can move your head slightly left and right and continue to push until you get things lined up with the physical world. Once you have the headset reality, mixer boxes aligned with the area in the real world it is just a matter of adjusting the vr head position in the sim.
@@rbarlow Wow ty for quick reply! I am looking into Trackers. I see there is an option to attach the box to one. I am hoping that if I place a tracker on my pit I can link the viewports to it and have them always be in the right relative position. I was looking for what is compatible and I see that Vive and Tundra are listed on the description in store.
Hi, I’m using this with quest 3,
Can’t find how to make the edges clear like yours instead of the border lines, any help appreciated :)
Been loving this with my sim
Keep going on the box edit pages and you will see a place to adjust edge width and color. I set 0 but still get the faint color line.
@@rbarlow same! Thank you
Interesting app. However, Quest 2 is not currently supported.
Russ, what about looking at a chart or handwriting a clearance ? Could you make a video on that?
The quality of the G2 B & W Video is just not clear enough. The next update will allow using an external color camera added to the headset( like a 4K webcam) and when that is available I will try again so stay tuned
Does this work for a Reverb G2 V1 if I am using the store version of MSFS?
Good question… not sure that’s why I tested it with X-Plane. I hope OpenXR support will come.
congratulation on your first taste of mixed reality
I love it…great potential
I assume some company will come out with stick on cameras for your vr headset so you can use those cams for the pass through image.
I was hoping Varjo would do that for Aero owners. It has the clarity to pull it off and the obviously have the technology. I think they waiting until they have fully exploited the high end early adopters before creating an almost as good alternative.😊
Wish something like this could come for pimax (widest FOV headsets available currently)
Afternoon Sir - Are you planning on going ot Flight Sim Expo in Houston in June?
Yes Sir, I will be wandering around when I am not helping at the Sim Innovations booth
@@rbarlow Excellent, hope to meet you there. I'll be roaming around with the TwoToneMurphy group. Hope to see you there.
Thanks Russ.
My pleasure
Doesn't work with the most popular headset (quest 2) so it's shit 🤷♂️
It is a beta now and he’s a one man developer so cut him some slack. He probably doesn’t have a quest 2 to develop on. Now it is SteamVR but maybe OpenXR in the future.