【VTubeStudio】Webcam Tracking just got an UPGRADE! VBridger Update

Поделиться
HTML-код
  • Опубликовано: 21 ноя 2024

Комментарии • 129

  • @Vaporstar4x4
    @Vaporstar4x4 10 месяцев назад +198

    I'm so happy that vbridger supports webcams now! I've been wanting to use it for over a year but because I don't have an iPhone I never had the opportunity. I'm glad that those of us who just use a webcam can get a new major upgrade to our tracking and I can finally start rigging models with vbriger parameters (more work yes but I'm excited)

    • @CutieDragon
      @CutieDragon  10 месяцев назад +9

      Definitely exciting!! Just bear in mind some of the parameters don't work with mediapipe (notably the jaw) so you may not be able to use the full scope of parameters! Have fun rigging! ^^

    • @dynogamergurl
      @dynogamergurl 10 месяцев назад +1

      Wow ya that’s so great it works with webcams. I may have to get a decent camera because the built in one on my laptop isn’t that good

  • @vivaldi_is_dreaming
    @vivaldi_is_dreaming 6 месяцев назад +14

    Noting that I've seen disabling low light compensation in webcams can remove that Nvidia jitter without having to tinker around with the smoothness.

  • @PreshaOrion
    @PreshaOrion 10 месяцев назад +38

    That does look a lot better with the mouth shape and speaking, the webcam rtx I mean. I use a 3d model, because 2d never quite captured facial expressions, save for those who spent thousands of dollars on model rigging and tracking software. I'm happy to see 2d taking steps forward, I think facial expressiveness is a big make or break for making models that are relatable to the audience. Maybe in another couple years we'll have good enough tracking to trigger enhanced expressions (like the anger vein) without toggles... Thank you for covering this topic!

    • @CutieDragon
      @CutieDragon  10 месяцев назад +7

      Actually there is a way to do an angry face (so for example an anger vein) without a toggle but it requires the iphone tracking ~ but perhaps someday for webcam!

  • @blackbulb
    @blackbulb 8 месяцев назад +4

    Really appreciate this, I'm still having a few issues but I'm getting the hang of it. Godspeed :D

  • @Cruznick06
    @Cruznick06 2 месяца назад +1

    Thank you so much for this video. I chose to use a 3D model originally because the ONLY mocap that worked with my glasses is for vrm models. Its really nice to hear that there's improvements for people who need glasses.

  • @QutelDawn
    @QutelDawn 10 месяцев назад +6

    Thanks for the efforts!

  • @MrsRemi
    @MrsRemi 10 месяцев назад +6

    This is so exciting, thank you for the video or else I wouldn't have known about it!!
    Would webcam also support cheek puff/tongue etc.? I will definitely look into all of this though, Vbridger is just such a nicer look

    • @CutieDragon
      @CutieDragon  10 месяцев назад +3

      sadly the webcam trackers don't support cheek puff or tongue (yet)!

    • @MrsRemi
      @MrsRemi 10 месяцев назад +3

      @@CutieDragon That's good to know, thank you for replying! There is hopee but even without it, vbridger seems like it could improve overall tracking

  • @EebyDemon
    @EebyDemon Месяц назад +2

    why does no one talk about how to set up the params in live 2d it self to link it to the vbridger movements cant find anything about it and what to change to get the most out of the programs

  • @izzy-mew
    @izzy-mew 8 месяцев назад +1

    my glasses are extremely reflective so i have to take them off when I use my model :( but this is really good info thank you for making content!

    • @Goldy01
      @Goldy01 6 месяцев назад +1

      It's moments like these where I regret that I didn't take the "anti-reflection" option for $200 more when I got my glasses 🤣might be worth upgrading!

  • @rachijuuni
    @rachijuuni 10 месяцев назад +25

    I don't know what happens, but the model in vbridger never starts moving. Only once did I succeed and then all attempts failed and the capture only happens if I start the camera directly in the VTS ^^

    • @CutieDragon
      @CutieDragon  10 месяцев назад +7

      Which tracking type are you using? It might be the tracker isn't starting properly through vbridger perhaps

    • @rachijuuni
      @rachijuuni 10 месяцев назад +2

      @@CutieDragon mediapipe. after the last update, it's started to work but only for mouth parameters like funnel, shrug... maybe i'll wait some days to test again ^^

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      alrighty! At least it's getting there! I imagine the program might have some issues to work out after a big update!@@rachijuuni

    • @oromihasu
      @oromihasu 9 месяцев назад +1

      I'm having the same issue ;; just downloaded it today, and I have no signs of movement

    • @rachijuuni
      @rachijuuni 9 месяцев назад +2

      @@oromihasu What I did to solve it was click on Load, on the bridgit option (it's right above the model) and then select the VBridger_VTS_Compatible file. In my case, the model worked better because it was detecting movements, but for some reason was not detecting the mouth open/mouth form parameters. I hope this can help you.

  • @Wbfuhn
    @Wbfuhn 10 месяцев назад +1

    I've had good luck with Logitech hardware.

  • @nyamipon
    @nyamipon 10 месяцев назад +5

    No matter what i do it won't move or connect to vtube studio (trying media pipe). My webcam works well so I don't know what the issue is.

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      Double check what camera vbridger is connected to in the settings! I've had it try connect to a virtual webcam by accident before which caused it to not work! (Settings > Camera settings)
      Also on the vtubestudio side, you'll need to make sure to turn on API support in the VTubeStudio settings! (it's not on my default so it's worth a check!)

  • @ErolSultan
    @ErolSultan 10 месяцев назад

    So glad i buy it last time

  • @Samzittv
    @Samzittv 10 месяцев назад +3

    Does this support tongues too? thro the rtx tracking?

    • @DM-Oz
      @DM-Oz 9 месяцев назад +1

      I was wondering the same thing, would be nice if it did. Is a shame not being able to use the model fully cause no iphone

  • @THEDUBMAN_UK
    @THEDUBMAN_UK 10 месяцев назад +1

    Thanks for video I do hope you were using a vpn as when you show type it shows your ip address in bar

    • @CutieDragon
      @CutieDragon  10 месяцев назад +2

      Thank you for the concern but that's just my internal IP! (tldr; the internal IP is only useful to the router!)

    • @THEDUBMAN_UK
      @THEDUBMAN_UK 10 месяцев назад +1

      @CutieDragon that's good news

  • @dylandreisbach1986
    @dylandreisbach1986 10 месяцев назад +1

    Imagine how much money a webcam that is specifically made to track for avatars. Like a camera that cannot record video and just gives face data through some other sensors.

    • @lepurplecl0ud
      @lepurplecl0ud 10 месяцев назад +2

      we already have Tobii Eye Tracker and Leap Motion for hands, those already are really expensive

    • @dylandreisbach1986
      @dylandreisbach1986 10 месяцев назад

      @@lepurplecl0ud did the Tobin track your face for vtube also?

    • @CutieDragon
      @CutieDragon  10 месяцев назад +2

      I imagine it'd function much like the iphone camera - it'd be neat to have the LiDAR technology on a webcam but I don't think it's quite a thing yet

    • @hlonghi
      @hlonghi 5 месяцев назад +1

      ​@@CutieDragonhmmm I wonder if I can use an Intel 515 real sense for this. Not sure I would buy one just for tracking given the $600 pricetag though. 😅

  • @JessieJoy-o4y
    @JessieJoy-o4y Месяц назад

    O'Hara Mission

  • @AnonningAnon
    @AnonningAnon 2 месяца назад

    Tried it with my webcam and the mouth tracking is horrid compared to default VtubeStudio. Oh well, I guess.

  • @mikufan_1
    @mikufan_1 10 месяцев назад +3

    Which Webcam do u recommend to buy? Like Which one do u use that's good I also wanna start vtubing and have glasses so I need a good webcam

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      So the one I'm using in the video is one of the cheapest webcams out there (it's 720p not even full HD!), I tend to find the tracking is better with any webcam that's full HD - 1080p quality so I'd look around for anything that is that quality or above if possible!

  • @mikufan_1
    @mikufan_1 10 месяцев назад +3

    also any tips on monitors? I want a 2 monitor setup 1 horizontal and 1 vertical like should I go with two 27 inch monitors or maybe 24 inch Idk

    • @CutieDragon
      @CutieDragon  10 месяцев назад +2

      Depends on your space and preference! I personally only use two 22inch monitors since my space is relatively small!

  • @AlbyCervitaur
    @AlbyCervitaur 6 месяцев назад +3

    Which of these cams are better for this tho:
    Razer Kiyo Pro
    Logitech StreamCam
    Elgato Facecam
    Or others?

    • @CutieDragon
      @CutieDragon  6 месяцев назад +1

      I use the logitech personally, but to be honest as long as the webcam is 1080p 30fps then the performance will be similar!

    • @AlbyCervitaur
      @AlbyCervitaur 6 месяцев назад

      @@CutieDragon I see, thank you.
      I might save a little bit and invest in a iphone honestly, it's too smooth.

  • @xmarshmallowzx
    @xmarshmallowzx 6 месяцев назад +1

    My vbridger face is moving like crazy..someone help me here lmao

    • @xmarshmallowzx
      @xmarshmallowzx 6 месяцев назад +1

      Its twitching, the mouth does not even pout, everything is twitchinggggg🥲

    • @greatcagod5420
      @greatcagod5420 6 месяцев назад +1

      Same

  • @buffyocalypse
    @buffyocalypse 2 дня назад

    You mentioned a lot of things but failed to show us -- like turning down mic audio delay and other things but you didn't show us how and I was left scrambling to try and figure it out, which I never did.

  • @AtomekKotalke
    @AtomekKotalke Месяц назад

    Isn’t there a workaround with the microphone input where you just delay the animation so the sound comes more on time with the mouth movement more correctly? I wonder if it’s possible to adjust that.

  • @awpdo8a7dn9fp.sdfg7
    @awpdo8a7dn9fp.sdfg7 10 месяцев назад +1

    i bought vbridger but cannot get it to move on my PC >.< all the settings are correct as well

    • @CutieDragon
      @CutieDragon  10 месяцев назад

      Are you using media pipe or nividia?

  • @Scyclo
    @Scyclo 10 месяцев назад +3

    I'd like to ask, when you use the nvidia tracking, i have an rtx 3060, so would it cause frame drops in my games as well?

    • @CutieDragon
      @CutieDragon  10 месяцев назад +3

      It really depends on the game ~ I haven't noticed any drops in most of the games I've tested, the only one I've noticed a little bit of struggle with is Apex Legends (which is already poorly optimized!) and I'm also running a 3060!

  • @ArmorOfFaith
    @ArmorOfFaith 2 месяца назад +2

    I decided to get the program but my vtube model isn't responding to my movements very well.. Her face is giving a sad expression and the eyebrows refuse to really move, the mouth also doesn't open or close at all... I am wondering, does the Vtube model need to be rigged for this program to work ? Is that maybe why?

    • @SynestriaVI
      @SynestriaVI Месяц назад

      i know this is a month late but generally you do need to have vbridger parameters rigged in order for it to work 100% properly

  • @joshy8392
    @joshy8392 9 месяцев назад +1

    So if i am using Vbridger to help lip sync via detecting my microphone, do I still keep 'Use Microphone' and advanced lip sync enabled on VTube Studio

  • @Neuvilletteshorns
    @Neuvilletteshorns 8 месяцев назад +1

    For some reason, On Vbridger the models Eyes wont close which causes my Model on Vtuber studio to not close its eyes either. any idea on how to fix that?

  • @AikoAmami
    @AikoAmami 9 месяцев назад +1

    can this make it so it can track tongues as well?

    • @CutieDragon
      @CutieDragon  9 месяцев назад

      Sadly not with webcams (yet), tongue tracking is still iphone exclusive

  • @ongv2
    @ongv2 10 месяцев назад +4

  • @TenkoBerry
    @TenkoBerry 10 месяцев назад +2

    This is Good 👍

  • @fulfilawish
    @fulfilawish 10 месяцев назад +2

    would any webcam work with this? i kinda don't really want to upgrade mine.. (even though i should since i've had it for quite a while) 😅

  • @CalleighSpencer
    @CalleighSpencer 10 месяцев назад +3

    I'm really at a loss how to connect everything... is there any way you could make a tutorial on it? I can't even find that... can I use vts app on the phone to capture the face or do I need to use a different one? T.T

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      I can make a video on doing the full setup soon! For iPhone you'll need either ifacialmocap or facemotion3D (both available on the app store), I personally use ifacialmocap. Next up you'll need to make sure the IP matches on both vbridger and the app you chose (it will show the local IP on both apps), click connect and it should work!

    • @CalleighSpencer
      @CalleighSpencer 10 месяцев назад +1

      @@CutieDragon thank you so much for the reply. I got confused because there's also an option to select vtube studio as the capture method. You're an absolute gem! I'll give it a try

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      you can also use the vtubestudio app as a capture method through the ios app too BUT it's a lot more drain on the battery of the device so I generally don't recommend that option!
      Wishing you the very best with vtubing! @@CalleighSpencer

    • @CalleighSpencer
      @CalleighSpencer 10 месяцев назад

      thank you so much for helping. this is so valuable @@CutieDragon

  • @MsBrittneyK
    @MsBrittneyK 6 месяцев назад

    I tried to connect using mediapipe and nothing is happening! Nooooo!

  • @VoidTela
    @VoidTela Месяц назад

    My vtube studio on PC doesn't have 3rd Party PC Client, does anybody know how do I fix that?

  • @JohnnyYeTaecanUktena
    @JohnnyYeTaecanUktena 5 месяцев назад

    Has anyone even tried the NVIDIA tracker with a AMD graphics card? As there are AMD equivalents to RTX cards so the issue of quality should not really matter in those cases. But i don't know if it was just programmed to only work for NVIDIA cards or any card that is strong enough, there are a lot of things in life that people can will only work for one thing but if no one actually ever tries to limit test one would not know

  • @hiyuutheblue3290
    @hiyuutheblue3290 10 месяцев назад +1

    Can anyone give me some advice about webcams? The price is very affordable.

    • @CutieDragon
      @CutieDragon  10 месяцев назад

      What's your budget? I might be able to suggest a few!

  • @lazice
    @lazice 10 месяцев назад +2

    YIPPE!!! HEck yeah!!!!!

  • @EmmyThePuppy
    @EmmyThePuppy 5 месяцев назад +1

    i loaded the mic input thing to test it out but i dont like it and cant figure out how to now unload it T-T please help

    • @CutieDragon
      @CutieDragon  4 месяца назад

      You'll need to 'Load' the other settings file (the default one is just the arkit file)

  • @cruelmyth5826
    @cruelmyth5826 8 месяцев назад

    How do I connect the VBridger to Vtube studio tho?? please??

  • @greatcagod5420
    @greatcagod5420 6 месяцев назад

    I can’t frown?

  • @RevyMorelia
    @RevyMorelia 10 месяцев назад +4

    HUH I somehow thought vbridger was only for teeth implementations and since I don't need that, I didn't even consider this...
    So how does that work, do I make all the settings in vbridger instead and leave the vtube studio settings untouched? Like, it seems like some of the settings are in both programs, so would it lead to problems if you tweak around on both ends?
    I am kinda scared to change anything in my vtube studio settings, it took so long to get it right and I am afraid of messing it up if I install something extra 😅
    Maybe it's possible to import the model a second time into vtube studio and try setting it up with vbridger freshly?

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      You're fine to not touch the settings in vbridger and/or vtubestudio - what really matters is to stay aware of where you've made changes!
      You can save a duplicate version of your model (with a different name, maybe add 'test version' or something along those lines) and import it into vtubestudio too if that makes you more comfortable!

    • @RevyMorelia
      @RevyMorelia 10 месяцев назад +3

      @@CutieDragon Thank you!
      I am surprised there aren't really good tutorials of how to add vbridger to vts, or maybe I am searching wrong. but I'll try and figure it out!

  • @yoelpaa6243
    @yoelpaa6243 10 месяцев назад +3

    I have an RTX graphics card and a webcam. Would buying vbrigder add better movement to my vtuber? Or is the expense not worth it?

    • @CutieDragon
      @CutieDragon  10 месяцев назад +4

      it's really up to you whether it's worth it or not! But I've found the vbridger tracking is a tad more accurate than the base version ~ but a lot can be done through just rigging the model well!

  • @edwardrobbins-fd6xk
    @edwardrobbins-fd6xk 2 месяца назад

    White Betty Martin Jennifer Gonzalez Sandra

  • @PixelaGames2000
    @PixelaGames2000 7 месяцев назад

    Recently my Vtube studio stopped tracking properly. Like, it just freezes, and stopped tracking properly. How do I fix this? Does this fix it?

  • @Avalon19511
    @Avalon19511 3 месяца назад

    does vbridger work with animaze?

  • @rosethefrench
    @rosethefrench 10 месяцев назад +2

    I have a problem 😭 with the cam (mediapipe) the mouth works great but not the eyes at all, it doesnt open/close as much as with the vtube studio tracking, same with my eyebrows. Is there anyone who could help me?

    • @lepurplecl0ud
      @lepurplecl0ud 10 месяцев назад +1

      hello there! I was having the same problem. just try to play around with EyeOpen L and R Output Curves on Vbridger until you get a better tracking (that's the best help I can get you lol sorry)
      same with eyebrows, although I didn't have to configure them

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      exactly this! You can also mess around with the parameter inputs in VTubestudio too @@lepurplecl0ud

    • @rosethefrench
      @rosethefrench 10 месяцев назад

      thank you!!!@@lepurplecl0ud

  • @Natsuki_Vtuber
    @Natsuki_Vtuber 10 месяцев назад +1

    I have an Iphone but it does not even work now with ifacialmocap or facemotion3d i dont know why, i have the right ip adress and i loaded the right thing but the model wont moove (and both my computer and phone are connected to wifi) can someone help me please ? ToT Ty

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      Is it the vbridger model not moving? I'd try manually setting the port in both vbridger and ifacialmocap settings (the number should also match!) And see if that works. I ran into an issue with the programs thinking a port was already being occupied before so it's a possibility

    • @Natsuki_Vtuber
      @Natsuki_Vtuber 10 месяцев назад

      @@CutieDragon i realised that it was because of my wifi, it's a campus wifi :c so it cant work (it's about the ip adress) sadly

  • @Cruen_Media
    @Cruen_Media 3 месяца назад

    How do I even use the iphone for face tracking? To me it feels like it will overheat the phone in longer streams?
    I mean, do you put the iphpne on a rig in front of your face?
    When researching, I only see the setup over the phone (software) but not in irl etc.

  • @LaurenJeffries-n7w
    @LaurenJeffries-n7w Месяц назад

    Wyman Manors

  • @PhilomenaWilliams-x4m
    @PhilomenaWilliams-x4m 2 месяца назад

    Georgiana Manors

  • @MissTronik
    @MissTronik 6 месяцев назад

    My problem is: my windows 11 and my iPhone don’t connect. I can’t download iTunes to make it work. It’s so annoying. I don’t know if I want to spend 70 euros for a webcam 🙄

    • @GatorceriVT
      @GatorceriVT 6 месяцев назад

      I had to download ITunes which helped sync the too and if you connect the to by USB that is better.

    • @MissTronik
      @MissTronik 6 месяцев назад

      @@GatorceriVT but windows 11 doesn’t even want to download iTunes. It’s just not downloading. That’s the crazy part.

  • @LuneIita
    @LuneIita 7 месяцев назад +1

    does this work with laptop webcams?

    • @CutieDragon
      @CutieDragon  7 месяцев назад +1

      Yep! Any webcam!

    • @LuneIita
      @LuneIita 7 месяцев назад +1

      @@CutieDragon :OO thank you!! I might get my hands on Vbridger soon

  • @StuartEverley-p5u
    @StuartEverley-p5u 2 месяца назад

    Jackson Mary Gonzalez Anna Miller Joseph

  • @xamaihannax
    @xamaihannax 10 месяцев назад +1

    Hello, ty for video but i have som problems can u hellp me pls. He gives me this error when I try to turn on nvidia tracking (The GPU is not supported). Can you explain why. Maybe I need to reinstall the driver?

    • @CutieDragon
      @CutieDragon  10 месяцев назад

      Which GPU do you have in your PC Rig? To use the Nvidia Tracking you'll need to RTX graphics card!

    • @xamaihannax
      @xamaihannax 10 месяцев назад +1

      @@CutieDragon oh okay i see now why its not working ty bb. i have 2 NVIDIA GeForce GTX 1650 Ti and Intel(R) UHD Graphics

    • @CutieDragon
      @CutieDragon  10 месяцев назад +2

      Yeah sadly Nvidia won't work on that rig! mediapipe is still an option though!@@xamaihannax

  • @partypieart
    @partypieart 9 месяцев назад

    I'm going insane trying to figure out why I can't check/uncheck on the output modifiers (Delay, Smoothing, Steps and the + plus button)
    They're greyed out and don't react to clicking on them. I've been searching for hours but no one else seems to have the same problem. Am I just really silly and missed a step? TIA

    • @CutieDragon
      @CutieDragon  9 месяцев назад +1

      Just something to check there's the 'Outputs' menu on the top right, do the modifiers become available after you click on any of the options on there? (you might also need to tick the box next to the modifier after that)

    • @partypieart
      @partypieart 9 месяцев назад +1

      @@CutieDragon shdgdgsj that was it! I WAS silly!
      Thank you so much!!!

    • @CutieDragon
      @CutieDragon  9 месяцев назад

      No worries!! (I had the exact same issue when I started poking the new update xD) @@partypieart

  • @ScarlettHearts
    @ScarlettHearts 10 месяцев назад +1

    I'm trying to get this to work but Vbridger comes out with an ErrorCode 10048 and I have no idea what that means

    • @CutieDragon
      @CutieDragon  10 месяцев назад +1

      Oo not sure about that one, VBridger has a troubleshooting channel in the discord that might help! discord.gg/xEXvVbXWPa

    • @ScarlettHearts
      @ScarlettHearts 10 месяцев назад +1

      @@CutieDragon Thank you CutieDragon! I have watched a few of your rigging tutorials in the past, and they greatly helped. Thank you

    • @ShokoraDeLeon
      @ShokoraDeLeon 10 месяцев назад

      Don't know if you found the answer but I just did tonight. You cannot use your camera in VTS at the same time as Vbridger. Vbridger will take over as the main tracking camera instead of VTS.
      The issue that I'm having is that it's laggy and it transfers that on the model. But also be sure to adjust your settings in Vbridger (top left gear) and change your camera settings to either 30 or 60 FPS (it defaults to 5 FPS for some reason when starting off...)

  • @gloriathorndike9017
    @gloriathorndike9017 2 месяца назад

    Perez Eric Walker Matthew Taylor Gary

  • @spoopyricotta6231
    @spoopyricotta6231 9 месяцев назад

    wen I connect vbridger to vts it track my face with my web cam, but the model in VTS dose not move?

    • @CutieDragon
      @CutieDragon  9 месяцев назад

      make sure you click 'connect' on the bottom right and make sure that you have api plugins enabled in vtubestudio! it will popup to ask to allow vbridger if it's your first time using it

  • @Zevest
    @Zevest 10 месяцев назад +1

    If I was a VTuber I wouldn’t be serene knowing that A webcam is connected to the pc I use for streaming.

  • @CowperFord-k5z
    @CowperFord-k5z Месяц назад

    Cummerata Pines

  • @AAAAnitha
    @AAAAnitha Месяц назад

    What would I do without this female 😂 thx girl I didnt know how to fix it

  • @divacroft1034
    @divacroft1034 8 месяцев назад

    steam is garbage...would never create account..

  • @SusanTaylor-vd8rs
    @SusanTaylor-vd8rs 2 месяца назад

    143 Romaguera Street

  • @Freytana
    @Freytana 10 месяцев назад +2

    👌👍