Everything you need to know about face tracking - VRChat
HTML-код
- Опубликовано: 5 окт 2024
- Check out my patrons socials below:
Slimpy: / @islimpycat
Kyndell: / @avirtual_life
Weight: / we_ight
WiZaRdMiLk: / cylinks_owo
Chowpound: / @uglyfeller
Stijn: imnotedatingry...
嵐狐LangerFox: youtube.com/@a...
Vandal: This guy sucks:)
iFong: www.youtube.co...
Use my affiliate code BONELESSVR with Zyber and VRRock for 10% off :)
zybervr.com/co...
www.vr-rock.com
use this link to shop at antlion :) antlionaudio.c...
Join the discord for meetups and possibly being in videos!
/ discord
Support the channel through merch:)
www.bonelesssu...
Support the channel for $3 a month:
/ bonelessvr
☹
☹️
bro really got me excited in the video that he knew ceeno0
☹️
“Or, we can have a really smart furry do it for us” one of the TRUEST statements I’ve ever heard. When unity breaks and blender is hard, the furries are always our genius friends who magically fix the problems ❤
I mean, there's that saying "furries run the Internet".
Furries are the reason why mmos and muds exist, and why anime even exists outside of Japan. Furry history is wack.
Everyone hates furries until they have a technical problem
I don’t know anything about blender or unity since I never used those apps, but I could start doing it. Who knows, it might grow on me.
furries can hack into nuclear reactor companies these days, but if you ask a war thunder player to fix your problem you better watch out
"luckily we can just have a really smart furry do it for us"
💀
Why is it so true tho 😂😂
@@pighaver facts
feel like this is true for absolutely everything i love it
we do make the internet work tho
We can harrass them AND still have them do work for us? Amazing, will use this on zeekers
The biggest problem with doing Face Tracking in VRChat, is that there is no comprehensive 0-100% guide on how to set up an avatar for it.
I've been using Blender for 7 years or something, and been working with game engines for a similar amount of time, and there certainly is documentation,
but It took me several days to puzzle everything together with essentially trial and error, pulling from the limited resources.
I can proudly say, I've set up my own vroid avatar for quest pro FT, without using any presets what so ever, but it could have been A LOT more straight forward.
Also for some reason, VRChat only allows a very limited amount of parameters to drive the blendshapes that can only network update at 15hz which looks terrible.
So essentially, to add a whole other complexity to it, creators use bit sized parameters to create virtual floats with less precision to save space, and interpolate the 15hz update rate
to make it look smooth.
NEOS VR / Resonite already does this way better.
Care to point a fella in the right direction with quest pro ft???
(I need to add from scratch to avi)
So does ChilloutVR. Both Resonite and ChilloutVR have native face tracking support that is light years ahead of VRCFT.
Also, if you have the right kind of stereo camera (or a recent iPhone), you can grab FaceIt and use the stereo camera to generate facial keys in blender for the addon's face rig in only a few minutes.
If you are able to, try document your process like a SOP and publish it somewhere! I know it might feel like a job at that point but worth! :D
Glad that it's pretty streamlined now with stuff like Jerry's presets, making it so the only thing that needs to be done really is creating necessary blendshapes in blender and putting the preset on your avi
Dat voice crack at 7:44 tho
Our boi 🅱️oneless finally hitting puberty
Another banger. Boneless never fails to pump me full with his content!
and i'll do it again
Ayo..
@BonelessVR phrasing.. XD
SIR
@@BonelessVR 🥺🥺🥺
I can't wait for eye tracking to be more mainstream in new affordable headsets so that foveated rendering could be improved. You can get a lot more performance that way.
Thank you so much for featuring my work!!!
Amazing production quality as well :)
Really big heads up, the concept of frying your eyes with EyeTrackVR is literally only possible if you disregard every single disclaimer and decide to source your own parts instead of buying the already picked parts or buying the premade kit.
Just a heads up incase that scares anyone
This. The website is extremely straightforward about which parts you should buy. You have to have very bad reading compression and/or be very dumb to Fry your eyes. If you believe in that danger then you're just straight up letting yourself miss out on an inexpensive yet decently capable eye-tracking solution.
Yesn't. I bought my IR LEDs from them, and after putting everything together, I had to stop using it after 20-30 minutes whenever I had it on because my eyes started hurting and I got a headache. Even the official ones seem to not be perfect sometimes.
"If you're watching my channel, chances are you have your own custom model." I don't even own VRChat, much less any VR gear of any kind or a model LOL
This video helped me realize just how important and underappreciated the of an eye/mouth tracking solution is when considering a VR headset -- for those specifically looking for these features.
great vod to show up on my feed as I got very interested in face tracking recently. love it!
6:42 man that smile was adorable
Face tracking is cool, it allows you to be more expressive. I wonder if there's a document about how to set up blend shapes. Only issue is face tracking is on the more expensive and niche side so maybe one day I'll get into face tracking.
Heads up, Bigscreen is working with EyeTrackVR to get an official eye (and maybe face? Still working on that part) addon for the beyond. Also, Somnium VR1 has eye tracking and they’re working on a face tracker. So for future people watching this video, maybe one of those is out by now! Or, if you’re lucky, both of them :)
ye, and i asked the question how thats works with prescription inserts, since they share the same space, but got no answer while others said "might be incompatible because vision correction in vr, is always an afterthought"
@@dharkbizkit That's not true at all lol
They work, and we've tested them
prescription inserts and the eye tracking module? ok nice. but how about the eye space? from the loooks of it, theres already little space and the inserts add depth?@@RidgeXR_2
If this is the case it will be an instance buy for me
Aaaand the XR Elite Face tracker JUST got released.
Time to become squidward.
holy shit from the avatars you were using I did not expect you to look like a military general when I saw your face
THIS IS SO SICK
I haven't played VRchat in two years since i had some moves and now have no space
But i was so distracted by your friends face 😂 so cute
Clean and crisp videos as always!
"have a really smart furry do it for us" -boneless. I NEED THIS FURRY ONG
I know a few lmao
Got a used quest pro for the unique features (and to replace my broken CV1) and I love it. I would consider it as close of an upgrade as I could possibly get for my money, considering that anything else in the quest lineup would have been a downgrade no matter how you looked at it.
One thing I didn't expect was that there are no good public face tracking avatars and I am struggling to even find one to purchase. Hell, even when I found an avatar that used the eye + face tracking properly, they had expression gestures set up and I couldn't disable it. Thus making both of those features useless. I'm a noob when it comes to that stuff though, obviously I don't know the right websites and places to look, but it shouldn't be that hidden away...?
Also, I have found very few apps that actually use eye tracking. I have a grand total of 3 that do, and it's: VRChat, Waltz of the Wizard, and Steam Link. Speaking of which, the Steam Link experience is amazing with vrchat and the VRCFT team should add the steam link quest pro module to the application. Had to do a google search for that, but it works perfectly!
Tbh i want to get a quest pro but im waiting for when vrc adds standalone face tracking for quest pro
Never. They had eye tracking stand alone a long time ago and removed it due too performance issues.
No plans to add it back in and even if they do they won't add face tracking. On top of that vrchat native eye tracking have never been very great anyway.
Your quip about getting a smart furry to do it brought a smile to my face. Thanks! I've been having a crap day but I'm feeling better for a good laugh.
"If you're watching my channel, then chances are you have your own custom model" *cries in too dumb to learn unity and blender*
Cries in trying to learn Blender with donut tutorial 😭😭
Bought one off booth and tried loading it up in unity but got overwhelmed : (
@@SnakeTheHat if you need some help there's plenty of people in the VRChat discord who could help, or I can lend a hand if you need.
i use a quest pro with steamlink, ovr spacecalibrator set to continuous, vive puck sttached to the back via zip ties with another usb c cable to keep it charged and connected to the pc 24/7.
quest pro works extremely well and the new steam link and the steamvrcft module. its face and eye tracking is top tier imo. with the vive tracker on the back, im able to use full body tracking with the pro as well.
very good hardware.
Great education on the this topic. can’t wait for those other non vive options you brought up
Just came across this video. The part about the Quest Pro made me laugh because a running joking within my group is "Hey.... Want to buy me a Quest Pro?". I currently use an ol' Vive Pro Eye and it is so darn uncomfortable on my small head. Great quick coverage though on face tracking, well done!
that avatar at 0:43 is rlly cool
Dang, never thought I'd see Dan's Iconic ring beard face used in a clickbait thumbnail lmao.
Do an EP on the VR rave scene, sure its been done before but it changes so much and there is so much going on the other stuff don't scratch the surface.
In-frickin-credible content! Damn! This is the stuff I live for!
How do you not have more subscribers to your channel?
You nail it and explain it so the rest of us can follow along and are kept in the loop.
"if you're watching my channel you probably have your own Avi"
Bro I dont even play VRC I just find it fascinating as a game lol. Somehow VRC is harder to talk to people in than talking to people IRL.
Face tracking is great. Thanks for your insight and sharing your knowledge from another perspective. I haven't met anyone with the Varjo setup so it was interesting hearing the issues you have with it. From my perspective seems the pro eye might have less jank overall, but that could be my bias from it being my daily driver and not having experienced the other eye tracking headsets. Something about running an extra cable directly to my PC with varjo, or having to calibrate two playspaces together with qp just doesn't seem inherently user friendly.
Again, thanks for your insight and sharing your experiences!
Loving the content boneless. Just grabbed a meta quest pro myself for this exact reason.
Funny thing pico is pulling out of consumer vr apparently so it's literaly just meta and also apple I guess but they are likely gonna be incompatable lol
6:40 that Avi looks amaaaazing
Even tho I don't have any sort of face tracking this vid was absolutley great.
Maybe in the future I could change my Q2 for a QPro just for the face tracking, I'm barely recovering from buying my FBT lol
I forgot when I subscribed to you but your video quality is 11/10, I see the effort you put in these. Keep it up 😁
I really like ur video, great content and quite funny
woah balls
man dont you love when vive makes a really good product then shoots itself in the foot by canning it? :/
am really excited to see how the xre squidward performs tho, should getting mine today :3c
I bought the Quest Pro specifically because of its built in face and eye tracking capabilities. I already own a Quest 3, so the Pro was a downgrade for pretty much everything else spec wise.
I must say accessing face and eye tracking in VRC was seamless and painless with the Quest Pro. There are packages made available by creators that are optimized for Quest Pro and are decently priced (like $35 to save you _hours_ of tedious setup). I just had to buy an already face tracked head (that came with a bunch of shape keys for customizing the aesthetics, besides the FT ones), swap it into my model in Blender, import it into unity, and then simply use an already fully configured prefab from the package that makes it "magically" work.
One thing that surprised me quite a bit with the Quest Pro is comfort. Reviews claim it to be bad due to the rigid strap design, which is understandable. But for me personally, it's even comfier than my Quest 3 which was heavily modded for comfort specifically. It's the first headset for which I felt absolutely no need to buy prescription lenses. It's actually less pain to just put it on right on top of my glasses than to deal with removing my glasses before putting it on. And the open peripheral vision frankly could've been a killer feature for MR, _if_ the passthrough was at least as good as the Quest 3 (which it isn't, but I still actually like the real world peripheral vision nonetheless).
In short, I bought the Quest Pro thinking I'll only "have" to use it when I really want face and eye tracking. But surprisingly, it became my main VR headset. I'm even thinking of reselling my Quest 3 now since I rarely play standalone games and MR just isn't good enough yet for it to be more than a gimmick for me.
But beware that your mileage might vary. Given the price point of the Quest Pro, you'll probably be way happier with other headsets (like the Beyond if you're going premium or the Quest 3 if you're going budget), unless you specifically want face and eye tracking capabilities, in which case, Quest Pro is definitely the way to go in my opinion.
My avatar is a fucking low poly office man with a fish for a head that rotates its jaw to unbelievable lengths in order to visualize me talking.
"Drinking requires expert precision"
Me *drinks with a straw*🥤
I use a quest pro with steam link. Works like a charm. And it got updated recently to add very basic tongue tracking.
I found mine sealed, unopened for only 720€ (roughly 800 USD)
Hey, im looking for a best first VR set for me.
Whats important for me?
1. Face tracking!! I seek full face tracking (OR ABILITY to attach it/develop it later - but not some complicated DIY, i'm weak in such stuff) but well, i also can accept partial but it depends on the other stuff below.
2. Durability and stability - I want to choose once and use this set for as much time as possible, theres a problem with cash and I dont wanna choose wrong and having to buy another. But cash problem doesnt mean that i wanna something cheap - im prepared to pay well if it gives me what I seek.
3. Low risk of discontinuing or/and removing support - I dont wanna buy some set and have it declared "old" after a year. Thats why I'm really afraid of Meta.
I watched entire video and I see that you recommend Meta Pro for its face tracking. I agree that face tracking is important for me but if one set is only good in this and lacks 2 other points then its not a certain choice for me and thus I'm ready to sacrifice face tracking quality for good standing in 2 other points, especially the 2nd one.
I see. I was wondering why my eye tracking never worked. I was missing a program.
I need that avi at the end. It looks so good.
Can't wait to get quest pro soon ! excited for the facial tracking.
This channel got recommended to me so many time, it's now time for me to do my duty and subscribe to see more of this incredible content ~w~
This guy just mentioned he's using an Aero like it's nothing
I hope I can get face tracking at some point in time, I’m already PC-VR With An Oculus Quest 3 Connected To My PC, Now All I Need Is The Proper Materials.
I'm super happy with my Quest pro, Great eye and face tracking without any parts that stick out
Just to clear one thing, The Reverb G2 Omnicept Edition has Basic eye tracking, not full eye tracking, what i mean is like, if you want it to track your eyes it will do it, but nothing more, you can't really squint your eyes or or half close your eyes as the headset eye tracking does not track your eyelids, this headset has probably the worst eye tracking for social games
I own a vive facial tracker for my quest 2, it's sometimes a pain at times but about 85% of the time it just works for me, the other 15% is just I need to painfully adjust it then lock it in place or clean it since it rarely fails to track my tongue properly and somehow stick it through my teeth when shut.
otherwise it's a niche thing to have so I'll continue to use it until more affordable options come around rather than forking out for a new headset that doesn't suit my requirements.
Hey, could you please send us a download link for the 3d model for the vive facial tracker on the varjo? Thanks! :)
a really smart furry here, with a completely custom facetracked avatar! 🦊✨
teach me ur ways...
Ive installed blendshapes before, its alright if you have a premade package however thats facial expressions only, any further than that is a nightmare and a half
At the least, hardware availability issues are likely to solve themselves once patents expire.
Issue with that is patents take 10-20 years to expire....
Ill wait for the next hmd with bulit in fsce tracking but its def super important... If i can get the courage to look people in the eye
I'm sorry, but I died at the "or you can just have a really smart furry add it for you" part, as I'm reading discussions about headsets in a Telegram group of furries who are in VR. XD
im ready to see bro at 100k
"Have a smart furry do it for us" yea that's very true, ik people who are on one day then gone for a month, they come back and proceed to show me 15 models that they put facetracking onto
quality content. its honestly surprising he doesnt have more views and subs
I have a quest pro and love it. The pancake lenses are amazing, and the quest 3 has those same lenses, with some small improvements.
I can't live without face tracking in vrchat and even in other social platforms. People will say. Meh, I don't need it, and then after spending a little time talking with me and seeing my real face reactions, they're clamoring to get it themselves.
When I have deep intimate talks with people, it really puts them at ease. They know I'm listening, they know I'm reacting, and also they know when I'm about to say something so we don't talk over each other.
and ummmmm speaking of intimate. face tracking ads an entirely new dimension to erp... I mean,,,,, if you're into that sort of thing...... which I'm not..... I promise I'm not...... my friend told me so yeah.
BTW, if you get a quest pro get a studioform creative velcro headstrap it will save your life. Just google studioform and VR. It made my quest pro the most comfortable headset I've ever used.
me trying to find a pro eye but I guess I'll have to wait for something to come up be a big upgrade from the CV1
"especially compared to the quest 3"
dawg mine broke in the first 2 months i had it 💀💀
That live Nick face cam was peak
I sip out of a silly straw for the best little kid experience
Pimax has native eye tracking with the Crystal
love your channel, i really like your manuka!!
I love the Echotheneko face tracking :3 its so good!!
Don't forget plug your Vive pro into the 2.0 port because nothing will work 😅
"Money- a quest pro" LOL
Great video as always, Boneless
I lowkey want face tracking, it would make my performances and everything much better. IDK if it'd work with Quest 2/3 though lmao
The song at 1:16 goes hard
VR chat looks likr a blast
I want facetrack so I can finally have my 4 year old sized avatar pout an bite at everyone in a full world XD years back my friend and I where small avatars an hearing someone yell "LET THE LITTLE ONES DO IT" never leaves my head after like 6 years
What sort of hellscape avatar was that beside him
great video continue like that, i'm always happy to look at your video thx
Meta has stopped producing the Quest Pro now unfortunally, so those they have they sell and thats it! 😢 I own one, eye and face tracking is great on them!!
I wonder if we'll have a way to put facetracking on the Quest 3 anytime.
What's the meme name for the goatee guy on the thumbnail?
Fish
AYOOO saw my avatar, that was unexpected
ty for the video :D
Boneless have tried using a water bottle or a bottle for the drinking instead of a cup
As a HUGE addict to face tracking and someone who is very involved with it, I can say it's not for your casual VRChat user. It is an investment. For me it was worth it, but for someone who just got into VRC I wouldn't recommend it yet. Not worth the troubleshooting and effort just yet.
hello boneless, thank you for making my day once again :)
Lol the thumbnail is funny
thank you i was already gonna get a quest pro but now i have to
Always amazing videos 💜💜💜
Must mention
Pico 4 Pro is available in Newegg for $585.99
Thanks for the tip.
We are getting way too deep. Hahahaha famous last words bro
4:59 you have a arrow headset so im not so sure about that 😂
Eveyrone likes to hate on meta but they built eye and face tracking straight into the Quest Pro. No need for attachments and the price is a lot cheaper now. So better buy one now before meta scraps this wonderful headset.
No secret word to drop in the comment section this time? You're getting engagement from me anyway. Thanks for the video and sharing the same pain of owning a Vive Pro every single time.
this is the most relatable video i've ever seen
Curious how it goes with Pimax Crystal. It has eye tracking. I have one here I haven't tried yet. (thats what landed me here to see how it all works)
I tried to get the mouth tracker to work for me, I plugged it into my index and got nothing in return tried looking in the face tracking discord and it never worked for me even when I had it updated too