Hand Tracking: Designing a New Input Modality
HTML-код
- Опубликовано: 9 окт 2024
- Breakthroughs in computer vision technology have allowed hand tracking to finally become feasible, unlocking the possibility of a more natural input method. Translating the rich, complex data that computer vision based hand tracking provides, in addition to considering human ergonomics and hardware constraints, make hand tracking as input a challenging design problem. We'll give insights into our design journey over the past few years to bring a new input modality to VR.
"Every person is an expert in using their own hand." Got you.
if you have a missing finger will it show up as five fingers or as how every many you have?
That pinch pointer method is genius! Bonus: it's really easy to simulate a computer mouse that way for backwards compatibility with existing 2D UI. You could even have up to 4 simulated "mouse buttons" by pinching with different fingers.
This is gold!!! Love to see from behind the scene what you guy really put in to make it happend
wooah this video made me really hyped for the quest hand tracking!
That was the idea!
Thanks for sharing your finding on prototyping hand input Oculus! You totally covered some topics I've been thinking about while waiting for hand tracking to come out, but also touched base on a lot of input features I never even thought about, you have saved us developers a lot of time. You rock!
Was tinkering with the Interaction SDK V41 looking through gesture debug stuff.
So cool.
I Love it!
Gonna Order my Quest today!!
We really appreciate this kind of initiative. Way to be proactive!
I recommend waiting till the link cable for the Quest comes out. There are a lot of games missing on the Quest and the cable will allow it to have the other games.
just a friendly area 51 alien I got mine two days ago. I tested what you said and there were no problems. The only game that had a little problem was Robo Recall Unplugged, if you stream the quest to your phone, it will crash your game 🤷♂️. I love it!!! ( I had a Rift and a HTC Vice before)
TheHamster 767 yea I know, but you can still buy it even if you already have the Quest. In the Time before Link comes out I can play the other games :)
treelon musk that's cause it's w.i.p
10:28 nobody laughs? I just about choked on my rice pilaf when she said that.
hahaha
same
Can't wait for my Quest!
So how about motorized gloves? If we can track hands, then there's no reason we can't track gloves as well. If we were to sync the gloves to the headset and be able to get haptic feedback, the experience would be 1000% more immersive.
they have shown that they're working on gloves but these things take a lotttttt of time to get right
@Jansen Gagliardi Just hope I'm not too old before VR gets truly realistic
It's coming faster than you think.
And that means no more batteries yaay!
Spongesonic20 This wont replace your controllers. This is just for menu navigation. Without haptic feedback they will never use this as the main feature when gaming. We need VR gloves so there is some Feedback
@@Simlife101 Will replace controllers someday! There are people doing research on increasing the expressivity of hand input. Let's look forward.
combined with two depth sensors on each side it could make hand tracking perfect. with all the things they learned and implemented already in the Quest 1 i am realy excited for the next model.
Wait... does this make our hands a proprietary controller for the Quest?
Couple this with something similar to a TENS machine on the arm to lock the limb or digits in place to simulate collision, use the TENS machine to simulate a feeling of weight by stressing the muscles of whatever limb, do this and you'll be one step closer to bridging the gap.
have you used a tens machine? The setting to make your hand close is very uncomfortable for even 30 seconds
@@TheSkyHive I have but my thought is that those aren't exactly what you want, they're just close to the tech. More control is needed. A TENS machine is like using a sledgehammer when you need a reflex hammer. The nerves can be fooled, they only run on electrical impulses. We just haven't spent a whole lot of time dumping fake input into the human nervous system with the aim to improve VR experiences afaik.
Going to re-ask. Will the SDK next Spring allow for Hand tracking and Controller mix use? I've heard two different answers from 2 different interviews.
Thank you for sharing such a wonderful video about hand tracking you are truly awesome and interesting ^^
Someone PLEASE give her a glass of water!!!
Welcome to Oculus Switch
Is this only for the quest or will it be coming to Rift S also?
Psandoval I contact Oculus who emailed me back stating there is no hand tracking coming to the Rift S on launch. They are looking into other way to track your hands. It is due to sensor placement on the Quest allows all 4 sensors to see your hands, the way the Rift S cameras are layed it is way harder because not all 5 cameras can see your hands.
Sad for Rift S users but I use the Quest and Valve Index so I'm super happy.
What I was thinking was if the Quest sensor cameras are the same tech as the Rift CV1 external sensors why can they not implement hand tracking on the Rift S using the OG Rift Cv1 sensors. Then if you had 3 sensors set up along with your Rift S that would allow great hand tracking and maybe even get rid of any blind spots the Rift S cameras have.
Maybe it's a lot harder than I think but maybe there is a possibility it could work. If I thought of it they must of, so maybe its impossible
So why cant my CV1 & 4 sensors be hand tracked without touch? Or simply given an update to allow hand tracking through oculus rift sensors smh
Cause the spots of the sensors can't see the full hand
It might just be me but people still trying to find a seat 4 minutes after the start was so distracting!!
Once I got over that this video was very, very interesting.
Is there anyway to join Beta testings for Hand Tracking System as a company?
Painful. My quest broke, I brought it to warranty, 1 month no vr! Can I have any F's?
f
Here is an F my dude
F
F
Thank you people you're kind. I have another F just today but it's not oculus themed.
what about the rift s? it has the same cameras!?
LOMSTER TV it won't cause the cameras are different placements
@@kpo8718 that wont be good....
this will arrive at the rift s?
Doubt it. Especially not with the quest link being a thing in November.
Nope lmao
No, Oculus hate Rift S
Yes, because most devs would still use S for their work
VRerse no because the camera placements
Pinch seemed very ergonomically exhausting from the 5 minutes I tested hand tracking.
can you put hand tracking on gear VR
the 1 dislike is the dude that has á rift S
will it be on rift s
LazyFurryKoala NO
@@ARCHIEcfjsure it will
SengirShowsU it won't because the camera placements are different
No cause camera placements
How tubular
interesting
When is the Male specific presentation video being released?
?
@@iramak4195 If I had to guess then I'd say he's more fragile than tissue paper.