How to fly a FPV drone in mixed reality - Is this the future of FPV?

Поделиться
HTML-код
  • Опубликовано: 3 янв 2025

Комментарии • 137

  • @hoardersam10
    @hoardersam10  3 дня назад +24

    I forgot to mention, the real-life view in the goggles has much better resolution than the recorded footage you see in the video. The Quest 3s has a resolution of 1832x1920, but when recording video, it only records at 1024x1024, or roughly 1/4 the amount of pixels. That's why the video looks pretty grainy, since it's fewer pixels and I have to zoom in to stretch it to widescreen.
    Happy new years everyone!!

    • @jim-xi1ml
      @jim-xi1ml 2 дня назад +1

      On your video on how to build the 100$ fpv drone can you please tell us were to download the auto populating file for bats flight called VTX1000mw.Jason file

    • @hoardersam10
      @hoardersam10  2 дня назад +1

      @jim-xi1ml Here it is: pastebin.com/QxQWipCN

    • @jim-xi1ml
      @jim-xi1ml 2 дня назад

      @@hoardersam10 thank you so much for that

    • @dhtxse
      @dhtxse День назад

      There are a few ways to adjust the size, framerate and bitrate of the recorded in-headset video to increase quality and also allow stereo recording, if you want. You can use SideQuest, Quest Games Optimizer or via adk commands.

    • @danieldewindt3919
      @danieldewindt3919 День назад

      I was thinking of a similar setup.
      The idea was to have one HD goggle to handle it all:
      - Multicopter Freestyle (Bando) FPV
      - 3D CAD Drawings
      - Virtual/Augmented Reality
      Only thing holding me back till now is. Not knowing how mutch latency it introduce with FPV
      Can you please do a review about that topic.
      I'm realy curious.
      Thank you in advance❣️

  • @KaiVertigoh
    @KaiVertigoh 2 дня назад +3

    I’ve been wishing for something like this for years!! Incredible insight, thank you for sharing this discovery!

  • @shaider1982
    @shaider1982 18 часов назад +1

    This looks more practical and better than the one for Apple Vision Pro that Rotor Riot (I think) did a few months ago.

  • @BasementCreationsChannel
    @BasementCreationsChannel День назад +3

    Dude, that is so cool! I've been thinking about buying Quest 2 back in the day for this exact reason, since they were cheaper than most digital FPV goggles, but now this mixed reality flying might be an actual game changer. I wonder if you could also have a second window for apps like Mission Planner to get a whole ground station setup in VR.

  • @chanel454879876354
    @chanel454879876354 8 часов назад

    Awesome. Now hdmi input is so valuable feature!

  • @bing0bongo
    @bing0bongo 3 дня назад +10

    Fascinating!! I'd love to see a Walksnail HD version!

    • @thatmanfromukraine
      @thatmanfromukraine 3 дня назад +7

      It works great! I own quest 3 and walksnail vtx.

    • @lamboratorioaive
      @lamboratorioaive 2 дня назад

      ​@@thatmanfromukrainedo you have the Moonlight vtx+dvr at 4k???
      With the Avatar FPV VRX?
      I'm so close to hitting the buy button right now 😂

    • @thatmanfromukraine
      @thatmanfromukraine 2 дня назад

      @ I have moonlight kit laying around waiting for my first build. Right now I’m running vtx with walksnail meteor75, picture is great so far, at moonlight I believe it will be even better! In any case we can have streaming at 1080p, 4K for recording only. The only downside is that with vtx you can get only normal framerate, I believe 60fps, with goggles x you will get 100. But I would say - 60 is enough if your just a regular flyer.

    • @The_Dark_Hood
      @The_Dark_Hood День назад

      @@thatmanfromukraine Do you know what the limitation is there? I thought you could get the Avatar VRX to 100FPS with 720P recording. Does the Quest 3 not allow that?

    • @danieldewindt3919
      @danieldewindt3919 День назад +1

      How much is the latency?
      Can you do Freestyle or Bandos.
      Or is that out of the spectrum?

  • @cobraswap
    @cobraswap 7 часов назад

    I have been looking for this. Thanks!

  • @paranoidzkitszo
    @paranoidzkitszo 5 часов назад

    Yes, you are very correct about the antennas....those are tuned for 2.4ghz- which they work mediocrelly but still much better than when attempting to use em for 5ghz

  • @chrisryan3445
    @chrisryan3445 3 дня назад +5

    This is quite an interesting option - I already have a Quest 3, so being able to use it potentially as an FPV headset would certainly lower the cost of entry for a newcomer like myself.

    • @magiofthoth
      @magiofthoth 3 дня назад +1

      How I see it, just gotta stick to analog, which if you're using a whoop, almost all are analog.
      So flying indoors is even "safer" this way.

  • @cycledelic7066
    @cycledelic7066 22 часа назад

    If there is any way you could post a video of how to build a cinewhoop, you're the only RUclipsr I trust for build guides.

  • @Helibas
    @Helibas 3 дня назад +2

    Happy New Year Sam & ALL - thank you for this possibility was looking for this!

  • @JohnyPatrick
    @JohnyPatrick 2 дня назад

    Very cool to see this in action! Thank you for sharing! This just made my wishlist and I'm getting this set up soon to see how this would feel. I can finally wear my glasses since Quest 3 has some spacing for this. This might be good

  • @Modern-Nerds
    @Modern-Nerds 2 дня назад

    Trying this tonight. I already have all of these things!

  • @kingjam6433
    @kingjam6433 2 дня назад +2

    I can't wait for augmented flights via fpv feed, imagine not having to set up race gates, just load a racing track on your goggles and fly away, or anything you could imagine really super mario style...

  • @veritasiumtry2015
    @veritasiumtry2015 День назад +1

    Thank you for shiwing people this Bro. I also do this with my walksnail VRX and Quest 3 passthrough then i make the screen sooooo Huge😊 and enjoy my self a !

  • @GrumpyDohBoy
    @GrumpyDohBoy 17 часов назад

    What a great idea! Keep up the good work. Subd

  • @mistercohaagen
    @mistercohaagen 13 часов назад

    Nice find!

  • @UH60Z28MRO
    @UH60Z28MRO 21 час назад

    Awesome!

  • @eduardoluisbaptistadeolive8542
    @eduardoluisbaptistadeolive8542 3 дня назад +4

    Dude, you can do that at 1080p with OpenIPC :)

  • @snowsh1ne
    @snowsh1ne 3 дня назад +18

    Or you could use OpenIPC with a USB C receiver and directly process the HD video on the Quest. Thats how i fly FPV now

    • @nic.h
      @nic.h 2 дня назад +3

      What's the software setup needed on the quest for that to work?
      Also what's the latency like.

    • @speeddemon2008
      @speeddemon2008 2 дня назад

      Can you share what hardware you are using? I'm super interested in OpenIPC, but haven't dived into it yet, and this looks like it could be an amazing option!

    • @thirdpartycookie
      @thirdpartycookie 2 дня назад

      The software is called fpvue_sk

    • @greensheen8759
      @greensheen8759 2 дня назад

      That's awesome!

    • @kmieciu4ever
      @kmieciu4ever 2 дня назад

      Triple feed patch FTW!

  • @I_like_rc13
    @I_like_rc13 3 дня назад +1

    Love your work❤

  • @I_like_rc13
    @I_like_rc13 3 дня назад +1

    It looks so cool

  • @FrederiQQ
    @FrederiQQ 3 дня назад +3

    This is really smart idea. What do you recon that the latency is like?
    This setup also helps people with glasses, since you dont have to put on and off them every time that you change batteries.

  • @tomthecatvr728
    @tomthecatvr728 3 дня назад +3

    That’s cool

  • @HaleFPVRC
    @HaleFPVRC 3 дня назад +1

    I really thought this was going to be an option with the DJI goggles 3. 😂 cool video bro

    • @danieldewindt3919
      @danieldewindt3919 День назад +1

      It's not?😳
      I thought they had augmented reality

    • @HaleFPVRC
      @HaleFPVRC 18 часов назад +1

      @ not really, can’t be used during flight. Mainly just for like plugging your quad in before take off or something of that nature

    • @danieldewindt3919
      @danieldewindt3919 13 часов назад +1

      @@HaleFPVRC that realy sucks.... For a big brand like that.
      Wouldn't be that hard to make a picture in picture, i guess

    • @HaleFPVRC
      @HaleFPVRC 6 часов назад

      @ yea, I was pretty disappointed… but other than that they perform really well..
      What’s the latency like on the headset??

  • @DavidFPV360
    @DavidFPV360 2 дня назад

    Love this. I'd really enjoy being able to do this with my dji o3

  • @roobertssuccess
    @roobertssuccess День назад

    Well Done !

  • @Cornusse
    @Cornusse 2 дня назад

    It's awesome!

  • @X862go
    @X862go 2 дня назад

    keep it coming

  • @TitanFPV
    @TitanFPV День назад

    I'm going to see a power loop and a split s, please.

  • @picobob
    @picobob 2 дня назад +1

    Nice Idea thank you for that. I dived into latency testing USB capture cards to use them with my HDZero VRX but my conclusion was sadly that the added latency is about 110 - 170 ms with the three different models I tested.
    With this added latency the drone is still flyable but it makes it harder for me. So if you find a low latency card please let me know.

    • @MikeHunt79
      @MikeHunt79 День назад

      It would be nice if something like OpenIPC could be used with this, I've heard that can go below 50ms latency

    • @danieldewindt3919
      @danieldewindt3919 День назад

      How did you connect it?

  • @thatmanfromukraine
    @thatmanfromukraine 3 дня назад

    Hey Sam! I’m using almost the same setup but with walksnail vtx, meta quest 3 and hagibis capture card. It works great! I have goggles x laying around but for some reason this setup feels much more comfortable for me, i don’t know why, maybe cause i don’t need to take off goggles while looking for my meteor75 somewhere behind my bed 😁

    • @Robinator202
      @Robinator202 2 дня назад +1

      Can you explain more how to get the feed from the walksnail into the meta quest?

  • @ml11ML
    @ml11ML День назад

    I tried this with a quest 2 and some similar cheapo 5.8g usb receiver last year and it does work although I used another app as the quest hdmi link app didn't exist yet. The latency wasn't really noticeable (especially given that I was very used to flying djis long range by the camera view before getting into actual fpv) however the big issue I found is that the virtual screen/window being locked in space instead of locked to the headset is way too distracting for me because of all the tiny head movements that become very noticeable and mainly because you can't move around irl (or aim any directional antennas you mount to your head) without resetting the view all the time with the quest controller, which is annoying and just another thing to carry around while in the field... Ended up buying some used analog goggles. I think this would be great if only there was a way to force the quest to lock an app to the headset instead of locking it in place, which from my research is sadly not possible.

  • @Jake-wl2ol
    @Jake-wl2ol 2 дня назад

    How does your video feed look so good

    • @hoardersam10
      @hoardersam10  2 дня назад +1

      Caddx ratel2, best quality i've found in analog cameras

  • @anhbamientay_102
    @anhbamientay_102 2 дня назад +1

    Can you test with dji o3, can use it??

  • @mihavuk
    @mihavuk 2 дня назад

    That's interesting. The issue is "just" 350 USD. 🙃 And the fact that I wouldn't se my drone LOS when it is more than 10m from me. Even if I could see it well far away, I'd still need a spotter to be by the book. Interesting idea though. 👍

  • @anthoniok7922
    @anthoniok7922 3 дня назад +1

    Kindly do it with dji 03 air unit

    • @anon_ninja
      @anon_ninja 3 дня назад

      Nah, DJI doesn't have a receiver that can use HDMI out like that. Also HDMI out in general with DJI system is sketchy after 10 minutes of research on Google.

  • @t1mmy13
    @t1mmy13 3 дня назад +1

    Can you get multiple live video feeds in? That would be extra interesting, being able to glance over at the feed of a spotter drone while flying an fpv...

  • @JacksonBohne
    @JacksonBohne 3 дня назад +2

    Dude me and my friend want to do some of your builds you do awesome stuff this is literally the thing I've been thinking about and I had no idea that it might be a little work on the quest 2?

    • @magiofthoth
      @magiofthoth 3 дня назад +1

      Probably not on the 2. The active pass through is crappy, black and white and very fuzzy.

    • @JacksonBohne
      @JacksonBohne 3 дня назад +1

      @magiofthoth I wouldn't use the pass through stuff it would just be like a full screen I wouldn't really want that pass through stuff

  • @StarsAtNight1
    @StarsAtNight1 2 дня назад

    Does it mean we don't need a observer anymore?

  • @arrack34
    @arrack34 4 часа назад

    Do you think there is a way to make this work with dji o3 systems ? Thanks for the vid !

  • @khawajadotd
    @khawajadotd День назад

    Hows the lag? Did I miss that part in the vid?

  • @dwho1029
    @dwho1029 3 дня назад

    I hope there is a way to charge the quest while using the receiver that will be great!

  • @jubakusha
    @jubakusha 3 дня назад +1

    curious if the way you have this set up (small fpv screen) is less straining on the eyes than having the drone video feed be all you see like on traditional fpv goggles

    • @hoardersam10
      @hoardersam10  3 дня назад +1

      Yeah I actually prefer it smaller but those who want the large screen can make it bigger or walk closer to the screen

  • @ihacksushi7194
    @ihacksushi7194 3 дня назад +1

    yo thats fire, is it possible with the o3 aswell?

    • @hoardersam10
      @hoardersam10  3 дня назад +1

      I don't think so, DJI doesn't like giving us HDMI

    • @anon_ninja
      @anon_ninja 3 дня назад +1

      Nah, DJI doesn't have a receiver that can use HDMI out like that. Also HDMI out in general with DJI system is sketchy after 10 minutes of research on Google.

  • @micah6635
    @micah6635 19 часов назад

    Would this work with the Quest 2?

  • @noisy_boi_fpv_3920
    @noisy_boi_fpv_3920 2 дня назад

    DJI goggles 3 tap tap pic in pic and clear probably costs less. Good innovation though

  • @tomkoller749
    @tomkoller749 2 дня назад

    I saw a similar project a few months ago and someone said the latency was terrible. Is this the same for all glasses systems? 🤟👍

  • @mileschun143
    @mileschun143 День назад

    How's the latency in your opinion?

  • @LordRejion
    @LordRejion 3 дня назад

    Yep. That's pretty neat. I seen rotor riot do it a while ago with the apple thing ..right? But the acted like the lag was not worth it. The way your doing it seems better. And I feel this could be a future thing..idea. for either rig. If they can make it more for it.. have a full screen and Og mint reality feed. Switch between effortlessly. . But I feel your ideas are on point for the advantages. And who knows what other benefits could come from this.. maby like double recording lol.. like I said to cool.

  • @iffyfpv
    @iffyfpv 3 дня назад +1

    Can you fullscreen this to make a similar field of view of a normal analog fpv goggle?

    • @hoardersam10
      @hoardersam10  3 дня назад

      Yes or even bigger. You can drag the window around or also just walk around in real life to get closer

    • @iffyfpv
      @iffyfpv 3 дня назад

      @@hoardersam10 Interesting. Is it possible to have no augmented reality and just have a resizable screen to simulate the fpv goggle experience even better?

    • @hoardersam10
      @hoardersam10  3 дня назад

      @iffyfpv Kind of, you can side load a black virtual environment to get that effect. But by default, Meta only gives us colorful visual environments

  • @zackerygrantham6806
    @zackerygrantham6806 3 дня назад

    Hey Sam, I saw your video back on switching from DJI. I know this question might be outside of your FPV content, but would you be able to maybe help with help answering how you would have an at home-built drone connect to your phone? Figured I might be able to save money, but I also would like to get into the hobby of building my own drones. Just feel like a drone more similar to DJI and the interface it uses outside of FPV might be that steppingstone. Would mainly use the drone on vacations or just getting good action shots of outdoor activities. Would definitely appreciate any help, or if you could at least maybe point me in the right direction.

  • @veritasiumtry2015
    @veritasiumtry2015 День назад

    Guys is there a way i can install the dji fly app onto my Quest 3 goggles ?

  • @Reyinlight
    @Reyinlight 3 дня назад

    I am new to FPV. Right now, I have EMax goggles, and I want to upgrade to bigger ones. Do you recommend using those instead of dedicated goggles? I already have a Q3; I just need to buy a receiver."
    Thanks and happy new year!

  • @stockholmacidforce
    @stockholmacidforce 2 дня назад

    What camera are you using?

    • @hoardersam10
      @hoardersam10  2 дня назад

      Caddx ratel2, best quality i've found in analog cameras

  • @fnsfabrications6844
    @fnsfabrications6844 3 дня назад

    Nice

  • @johnthebaby
    @johnthebaby 3 дня назад

    hey hey can you make a wiring diagram if you are using a SpeedyBee TX800 VTX. i can see it only can get Voltage in:3.7-5.5V on you 100 doller drone. btw this is really cool way to fly you drone

  • @JamesDowningFPV
    @JamesDowningFPV 2 дня назад

    I had essentially this same view 10 years ago with a monitor on a tripod... no goggles.

  • @road3240
    @road3240 2 часа назад

    For all the people who want to fly LOS like quadmovr, this will speed up the process to getting anywhere near that level of skill.

  • @NOTgrounded
    @NOTgrounded 5 часов назад

    Can anyone recommend a controller for DJI drones? I just picked up a Neo and already have a Quest.

  • @divyamishra3616
    @divyamishra3616 3 дня назад

    Cool but latency issues?

    • @GilesGuz
      @GilesGuz 3 дня назад

      I cant perceive it on my setup (on a quest 3 non s), but im not a super high speed racer.

  • @Sleeperknot
    @Sleeperknot 3 дня назад

    I just lift up my goggles when the quad comes back above me and I just look at it line of sight to fly it LoS or to land it. It costs 0$ in addition to the cost of a cheap analog goggle.

  • @h-fidz
    @h-fidz 3 дня назад +2

    I would actually like to see more the advancements in how to implement stereoscopic depth perception in fpv rather than using it as as a traditional fpv goggle with mixed reality. stereo 3d in fpv which require dual cameras would be the real game changer

    • @hoardersam10
      @hoardersam10  3 дня назад +1

      Check out the older Skyzone 02X goggles, they have a 3D mode where the left and right eyes get a different analog video signal from two different frequencies, so you can run two analog setups on a single drone to get 3D in your goggles. I haven't tried it yet but it may be the easiest way to do 3D

    • @SaiyanEuc
      @SaiyanEuc 3 дня назад

      Dude that would be pretty cool, kinda like the 3ds

    • @zippa20
      @zippa20 3 дня назад

      @@hoardersam10 I thought that this would be the coolest as well, but heard it mentioned on another channel that its not really useful unless the object is close to the quadcopter b/c the parallax is so small. So in a fast-moving quadcopter its not worth the tech. :/. (I'm posting this w/o a reference b/c I don't recall the vid or channel. sorry)

  • @SaiyanEuc
    @SaiyanEuc 3 дня назад

    You know ive been thinking of doing something like this, i was just gonna buy one of those cheap headsets your phone slides in and just use my phone haha

  • @graphguy
    @graphguy 2 дня назад

    range?

  • @NetworkGeek280
    @NetworkGeek280 2 дня назад

    I wonder if I could use augmented reality goggles as a workaround to CASA ban on FPV in Australia. I doubt it...😢

    • @TheVeganarchism
      @TheVeganarchism 2 дня назад +1

      No, because you’re not “line of sight” if the image you’re viewing is mediated through the goggles. There are however true augmented reality glasses which technically do meet the CASA requirement, you can find demos on RUclips.

    • @NetworkGeek280
      @NetworkGeek280 2 дня назад

      ​​@TheVeganarchism Thanks for the tip! AR glasses appear to use USBc DP ports, so I need an intermediate device between the eachine Rotg02 receiver. Latency may become an issue.

  • @AlexLebed
    @AlexLebed 2 дня назад

    i did that a while ago in oculus 2, and latency was horrible, makes it barely flyable.

  • @SeanPitts
    @SeanPitts 4 часа назад

    🥽👏🔥 yooo!

  • @SilverDragon092
    @SilverDragon092 3 дня назад

    not supposed to take the vr headsets out in direct sunlight - so maybe stay inside a car or under some cover... thats what ive read anyways!

  • @mechamotollc
    @mechamotollc 3 дня назад +1

    You might be able to use the Radxa Zero 3W to convert the USB signal to HDMI to the HDZero goggles. I've just started getting into OpenIPC and I no it's used for the VRX.

  • @kurtzFPV
    @kurtzFPV 2 дня назад

    Thanks for this video. I have been flying fpv for a few years and just got into vr recently. I'd been thinking about trying to figure out how to do this on my quest 3s when this video popped up. Thanks also to the algo gods. Happy New Year! Edit: I guess with this HDMI link app you could get a digital signal in as well from DJI goggles or DJI camera drones from another android phone.

  • @TheFrightHaven
    @TheFrightHaven 2 дня назад

    Hey Sam , any chance you can post a video of all your tools? I know you usually put a good amount in the description but an in depth video of your most used tools would be awesome! If not all good

  • @RuToClose
    @RuToClose 2 дня назад

    My son has a quest 2. Not the same. Might try it just for fun, I don't have the nice 5.8ghz receiver, but it might work ok. Nice job. Interesting video.

  • @Pouncer9000
    @Pouncer9000 День назад

    Am I gonna be that guy?
    Yeah, I'm gonna be that guy, *ahem* : how is this different from flying FPV with a monitor on a tripod?

  • @jf5336
    @jf5336 День назад

    If you find a card that works with HDZero, would you please do this same kind of build/demo video? This is fantastic!

  • @ameygauns
    @ameygauns 3 дня назад

    Would this work with the dji neo?

    • @hoardersam10
      @hoardersam10  3 дня назад +1

      DJI doesn't like to give us video-output so it won't work

  • @raztaz826
    @raztaz826 3 дня назад

    It looks like a good idea, but I like the way my box goggles fully fill my view

  • @magiofthoth
    @magiofthoth 3 дня назад

    I see this as an awesome thing in my idea toolbox.
    Looking for ways to make fpv cheap and accesable to youth.
    If they have a quest 3, cheap accessory, a radio and a whoop is all thats left.
    Otherwise fatshark and drone used bundles are best option.
    Im trying to make a business with drones to fund events and education for drones around me.
    This would be a dope way to show it off to kids.❤

  • @WillyFPV
    @WillyFPV 3 дня назад

    nfw

  • @charly94xry34
    @charly94xry34 3 дня назад +1

    looks cool, but... future with analog? dont think so

    • @hoardersam10
      @hoardersam10  3 дня назад

      Works with a HDMI capture card as well - I just tested it with HDzero.

  • @boccatxrx5023
    @boccatxrx5023 10 часов назад

    Very interesting! Is there a way to not have the FPV picture not anchored to one spot but follow your head movement? I'd love to know how it affects latency too.

  • @TaigiTWeseDiplomatFormosan
    @TaigiTWeseDiplomatFormosan 14 часов назад

    0.0

  • @HolyOllie
    @HolyOllie 3 дня назад

    future of fpv? what problem does this solve?
    youre looking at a flat acreen in vr while you could just have a screen in real life

  • @tomallo99
    @tomallo99 3 дня назад +2

    Thank you for covering this. A few years ago, when the quest 2 was still the newest headset, I was annoyed that for $300 I could buy something that is way more advanced than those fatshark style goggles, with the models that make sense to buy being around twice as expensive as the quest. The value proposition was just terrible.

    • @kurtzFPV
      @kurtzFPV 2 дня назад +1

      But Meta sells these only a bit above their costs so they can capture the market and sell games, as well as collect personal data and target ads. They also manufacture in very high quantities. FPV goggle companies only manufacture a fraction of the quantity of their goggles for a niche market and have to support their company on the profits.