NueMedia
NueMedia
  • Видео 9
  • Просмотров 121 402
ARKit tracking with webcam using Mediapipe
Python: www.python.org/
Project repository: github.com/nuekaze/mediapipe-vt
Discord: discord.gg/AgeeBk88s6
Like my content? Support here:
www.buymeacoffee.com/nuemedia
liberapay.com/NueMedia/donate
XMR: 82sLiWqHfpG17HhwpRyE2kZMRNJgxBxHK9moyYjv4vK8AQUAardGCbESrCd56gkjCC1LMMrgWeLDQ5aKK5y7rEmtVnQfM9b
Links:
nuemedia.se
stream.nuemedia.se/
hanashi.nuemedia.se/@nuekaze
nuekaze
joinpeertube.org/instances
Просмотров: 287

Видео

Blender A-pose to T-pose
Просмотров 10 тыс.9 месяцев назад
Here is an updated version of my tutorial on converting A-pose to T-pose in blender. SKkeeper: github.com/smokejohn/SKkeeper Discord: discord.gg/AgeeBk88s6 Like my content? Support here: www.buymeacoffee.com/nuemedia liberapay.com/NueMedia/donate XMR: 82sLiWqHfpG17HhwpRyE2kZMRNJgxBxHK9moyYjv4vK8AQUAardGCbESrCd56gkjCC1LMMrgWeLDQ5aKK5y7rEmtVnQfM9b Links: nuemedia.se stream.nuemedia.se/ hanashi.nu...
How to run OpenSeeFace standalone on Windows
Просмотров 2,1 тыс.11 месяцев назад
In case you need to know how to run OpenSeeFace standalone, here is how to do it! I use it for my Blender VTuber tracker plugin. Python: www.python.org/ OpenSeeFace: github.com/emilianavt/OpenSeeFace If you are interested in the plugin you can check this video. ruclips.net/video/00qx3uaT0TU/видео.html nuemedia.booth.pm/items/4216877 Discord: discord.gg/AgeeBk88s6 Like my content? Support here: ...
How to toggle clothes and items on your VRChat avatar
Просмотров 23 тыс.Год назад
Here is my tutorial on what I think is the easiest way to toggle clothes or items from your avatar in VRChat. Discord: discord.gg/AgeeBk88s6 Like my content? Support here: www.buymeacoffee.com/nuemedia liberapay.com/NueMedia/donate XMR: 82sLiWqHfpG17HhwpRyE2kZMRNJgxBxHK9moyYjv4vK8AQUAardGCbESrCd56gkjCC1LMMrgWeLDQ5aKK5y7rEmtVnQfM9b Links: nuemedia.se stream.nuemedia.se/ hanashi.nuemedia.se/@nuek...
Weight painting and editing to remove clipping on your model.
Просмотров 10 тыс.Год назад
A few tips on how to easily remove clipping on your model when attaching clothes and assets. Vertex groups and bone names: ruclips.net/video/RlJ3NXjQp38/видео.html Discord: discord.gg/AgeeBk88s6 Like my content? Support here: www.buymeacoffee.com/nuemedia liberapay.com/NueMedia/donate XMR: 82sLiWqHfpG17HhwpRyE2kZMRNJgxBxHK9moyYjv4vK8AQUAardGCbESrCd56gkjCC1LMMrgWeLDQ5aKK5y7rEmtVnQfM9b Links: nue...
VTuber Tracker for Blender
Просмотров 2 тыс.Год назад
Demo video for the VTuber Tracker for Blender add-on. You can get it at nuemedia.booth.pm/items/4216877 BGM: ruclips.net/video/9swXEd6SWjA/видео.html Discord: discord.gg/AgeeBk88s6 Links: nuemedia.se stream.nuemedia.se/ hanashi.nuemedia.se/@nuekaze nuekaze joinpeertube.org/instances
How to attach clothes from Booth to your avatar in Blender (in depth)
Просмотров 25 тыс.Год назад
A tutorial on how to attach clothes to a model in Blender. I try to do an in depth explanation on how the clothes attachment actually works. Discord: discord.gg/AgeeBk88s6 Like my content? Support here: www.buymeacoffee.com/nuemedia liberapay.com/NueMedia/donate XMR: 82sLiWqHfpG17HhwpRyE2kZMRNJgxBxHK9moyYjv4vK8AQUAardGCbESrCd56gkjCC1LMMrgWeLDQ5aKK5y7rEmtVnQfM9b Links: nuemedia.se stream.nuemedi...
How to set up VSeeFace on GNU/Linux using Proton and OpenSeeFace
Просмотров 2,1 тыс.2 года назад
Most work is done in a terminal and I suggest you learn the basic usage of it beforehand. Always good to know when using GNU/Linux. You also need to know how you use your own package manager which is also an essential part of any GNU/Linux based operating system. Every time you want to use OpenSeeFace you need to source the python environment. Otherwise the dependencies will not be loaded and i...
How to set up iPhone face tracking for VSeeFace using VTube Studio
Просмотров 48 тыс.2 года назад
A quick tutorial on how to set up iPhone tracking using VTube Studio and VSeeFace. Free and good quality tracking. By using iPhone tracking you also reduce the load on your CPU. OpenSeeFace tracking can take up a lot of resouces so if your computer is not that powerful this can be a way to offload your computer of the face tracking. Like my content? Support here: www.buymeacoffee.com/nuemedia l...

Комментарии

  • @camaraco1234
    @camaraco1234 12 дней назад

    you are a very, very weird dude....

  • @Ali-gd4cb
    @Ali-gd4cb 13 дней назад

    THANK U <3

  • @TheHiyokoZz
    @TheHiyokoZz 14 дней назад

    frfacasdiasd

  • @Patchywork
    @Patchywork Месяц назад

    Followed all the steps but it wont work. I have a model that works with my webcam so i know it should work but I cant get the two apps the connect. Yes theyre on the same wifi. Yes I checked the IP address for my phone. Idk whats wrong at this point

    • @nuekaze_media
      @nuekaze_media 18 дней назад

      In the VTube Studio app where you activate 3rd party clients it should display if any device is connected. If the status icon is yellow then no device is connected. Make sure this connection works first.

  • @XanChew12
    @XanChew12 Месяц назад

    Bro is actually a gigachad with the tutorials holy Btw I was wondering, how can I sync a toggle’s emission colours with the main body’s emission colours? I see a lot of neon spines and neon characters but struggle with having the colours actually communicate and synchronise

    • @nuekaze_media
      @nuekaze_media Месяц назад

      I am not sure I understand what you want to do. But I have seen that avatars with dynamic lights use AudioLink for shaders. Not sure how it works but it could be a hint maybe.

  • @nacl_keo
    @nacl_keo Месяц назад

    thank you so much! i didnt need to use SKeeper but im sure it will come in handy some day. God bless

  • @Delicioushashbrowns
    @Delicioushashbrowns Месяц назад

    such an amazing tutorial thank you for making this! there's lots of tools now for achieving this without needing the manual steps but this still comes in so handy tyty i appreciate it

    • @nuekaze_media
      @nuekaze_media Месяц назад

      Thank you! I have been using VRC Fury myself recently and been thinning to make a video on it a some point. Great tool!

  • @Kiraluna03
    @Kiraluna03 2 месяца назад

    Android?

    • @nuekaze_media
      @nuekaze_media Месяц назад

      Look for an app called MeowFace. It should be able to produce similar tracking.

  • @Xiao_Clip
    @Xiao_Clip 2 месяца назад

    감사합니다. thank you so much ^^

  • @BabuPookz
    @BabuPookz 2 месяца назад

    its not working

  • @squashii1943
    @squashii1943 2 месяца назад

    it dont toggle

  • @user-vu9lt2gd8s
    @user-vu9lt2gd8s 2 месяца назад

    where did you get your character mesh

    • @nuekaze_media
      @nuekaze_media 2 месяца назад

      I get most things from Booth.

    • @user-vu9lt2gd8s
      @user-vu9lt2gd8s 2 месяца назад

      @@nuekaze_media can you send me a link for that character

  • @user-vu9lt2gd8s
    @user-vu9lt2gd8s 2 месяца назад

    are booth meshes allowed for commercial use

    • @nuekaze_media
      @nuekaze_media 2 месяца назад

      It depends on the license for the specific product.

  • @sadieparker4715
    @sadieparker4715 2 месяца назад

    vtube studios says its working but its not tracing my face

    • @nuekaze_media
      @nuekaze_media 2 месяца назад

      Does the character in the VTube Studio app move?

  • @FurukawaAkane
    @FurukawaAkane 2 месяца назад

    Hi! Followed this tutorial as well as instructions in the Git page and for some reason OpenSeeFace opens then immediately closes upon executing the command. Using the run batch file results in"'facetracker' is not recognized as an internal or external command, operable program or batch file.". No idea what's happening. Should I delete and start over again, or should I just stick with how VSeeFace does tracking? Thanks!

    • @DaSquareful
      @DaSquareful 2 месяца назад

      I'm having the same issue, I got all the way to the end but once I got to running facetracker.py it would just open and close immediately. Hopefully they see this message and can assist. It did at one point require me to enable Script Execution permissions which I was able to do to complete the setup process.

    • @nuekaze_media
      @nuekaze_media 2 месяца назад

      Hello! Sorry for a late response. When you run the facetracker.py you must write it as ".\facetracker.py". The dot and backslash are required as that is how the console figures out you want to run a file and not a command. You could also try running it as "python facetracker.py" if the other doesn't work. If you are using VSeeFace you don't really need this as VSeeFace has it built in already. It is the same thing.

    • @FurukawaAkane
      @FurukawaAkane Месяц назад

      @@nuekaze_media Thanks, bud!

  • @jkash3383
    @jkash3383 2 месяца назад

    what I like to do is make an alias in bashrc so I can just type in OSF for example and it'll start OpenSeeFace's face tracker

  • @AlweizSummer
    @AlweizSummer 3 месяца назад

    Does it only work with iphone? Can it work with a Samsung s24

    • @nuekaze_media
      @nuekaze_media 2 месяца назад

      This is for iPhone specifically. For Android there is a tool called MeowFace that you could try.

    • @AlweizSummer
      @AlweizSummer 2 месяца назад

      @@nuekaze_media thank you!

  • @ScorchedIce
    @ScorchedIce 3 месяца назад

    Hi! I bought the addon and it's honestly impressive, I was wondering how you set up your blend shapes? the vowels seem to work fine for me but I don't know how to get it to blink. I have one "blink" blendshape, should I have one for each eye? I'd really appreciate if you could let me know what shape keys I should add to my model. I have so many questions, I'm sorry!

  • @donthejester6808
    @donthejester6808 3 месяца назад

    I spent hrs trying to figure a way to do this thank you

  • @joemama17059
    @joemama17059 3 месяца назад

    So damn underrated. Good tutorial

  • @SolidCapo
    @SolidCapo 4 месяца назад

    Thanks for being the only video that really explains and makes a good tutorial on how to use all this on Linux! :D but i have a problem...I've followed all the steps and openseeface is actually running with python facetrack and it turns on my webcam, but when open vseeface or vTuber or Inochi, they wont detect any movement :( any idea? :S Operating System: EndeavourOS KDE Plasma Version: 6.0.2 KDE Frameworks Version: 6.0.0 Qt Version: 6.6.2 Kernel Version: 6.8.1-arch1-1 (64-bit) Graphics Platform: X11 Processors: 8 × Intel® Core™ i7-7700 CPU @ 3.60GHz Memory: 31.3 GiB of RAM Graphics Processor: NVIDIA GeForce GTX 1060 6GB/PCIe/SSE2 Manufacturer: Gigabyte Technology Co., Ltd. Product Name: H110M-S2PH PS: i had to play with hotkeys til i've found CTRL + C cancels the facetracking :P and also, is there a way to initialize the facetracking easier without having to open the terminal, then go to the openseeface folder and then use the python facetracker.py? thanks

  • @sas6500
    @sas6500 4 месяца назад

    Thank you so much! <3

  • @FineLineAnimation
    @FineLineAnimation 4 месяца назад

    Hello I bought Character (without clothes )From "Buhta " . Can I Create clothes in Blender and to parent him??? If not , how can i create cloth for him and parent to him😢

    • @Specter_1125
      @Specter_1125 3 месяца назад

      You can make basically whatever you want to in blender. It’s ultimately a matter of do you know how and do you have the time to do it.

    • @its3amagain.
      @its3amagain. 14 дней назад

      @@Specter_1125 yup. blender in a nutshell hahaha

  • @herobrinejr1701
    @herobrinejr1701 4 месяца назад

    Proceeds to show sensitive details

    • @nuekaze_media
      @nuekaze_media 4 месяца назад

      If you mean the IP that is not a sensitive detail.

    • @ShinDigginIt
      @ShinDigginIt Месяц назад

      @@nuekaze_media someone could find where you live off your ip

  • @user-oo5is8ub8k
    @user-oo5is8ub8k 4 месяца назад

    PERFECT simple well paced explanation, thanks so much! :D

  • @hiroboy7506
    @hiroboy7506 4 месяца назад

    Hi this is very interesting ! I am not familiar with animation, however, do we need to make animation for every facial expression ? Wht do we make ? Will it just follow our face ? Please give basic tutorial. thank you !

    • @nuekaze_media
      @nuekaze_media 4 месяца назад

      This guide assumes that you already have an avatar in the VRM format. That is what VSeeFace uses.

  • @soy1119
    @soy1119 4 месяца назад

    i think i lov u

  • @rofinatheirin9929
    @rofinatheirin9929 5 месяцев назад

    Oh frick...It's worked consistently, but suddenly I have a model with no shape keys, so it doesn't want to work at all. q_q EDIT: I lucked out in that part of the mesh DID have shape keys, so I was able to ctrl+J them all together and subsequently follow the steps in the video. But if I do come across a mesh with zero shape keys, how would I be able to fix the pose? Thank you for your time!!

    • @nuekaze_media
      @nuekaze_media 4 месяца назад

      If it doesn't have any shapekeys it should just be to apply the duplicated armature. The addon is for when you have shapekeys and want to preserve them.

  • @Roku-juu
    @Roku-juu 5 месяцев назад

    For the weight, if The body already has it you can use 'Data transfer "modifer in that case, right 🤔??

    • @nuekaze_media
      @nuekaze_media 5 месяцев назад

      Yes that is great to use if the clothes are close to the body. Would not have worked for the skirt on this one but for the rest yes. When I made the video I did not know the modifier existed, but if I knew I would definitely use it for the socks at least.

  • @efs3
    @efs3 5 месяцев назад

    Good tutorial! Worked for me without having to install the plugin!

  • @edgyboi5816
    @edgyboi5816 5 месяцев назад

    Broh se autodoxeo

  • @Zharkan16
    @Zharkan16 5 месяцев назад

    Tack :), måste följa trenden

    • @nuekaze_media
      @nuekaze_media 5 месяцев назад

      Är det en trend med T-pose? xD

  • @wesleyviscardisantos2922
    @wesleyviscardisantos2922 5 месяцев назад

    Woah this dress is so beautiful, where can i buy it ? Thanks for the tutorial!

    • @nuekaze_media
      @nuekaze_media 5 месяцев назад

      It is this one. booth.pm/en/items/3683712

  • @rofinatheirin9929
    @rofinatheirin9929 5 месяцев назад

    When I go to toggle clothes in the game, instead of toggling on and off I have to hold the button for it to change, and it goes right back to default when I let go. 🤔 I'll edit if I figure it out! EDIT: I think I accidentally had it set to button instead of toggle! EDIT2: Now it's not toggling at all, and it acts like the animation is playing when it's not... EDIT3: Okay! It seemed to be a problem with the animation itself, but I rerecorded it and it's working like a charm! :D

  • @Anxiety_Gh0st
    @Anxiety_Gh0st 5 месяцев назад

    Ça marche sur Android ?

  • @darksin720
    @darksin720 5 месяцев назад

    merci mec tu gères😄

  • @i_want_a_user
    @i_want_a_user 5 месяцев назад

    not his voice having a swedish accent

  • @Kerocolaa
    @Kerocolaa 6 месяцев назад

    Hi! I recently picked up the blender plugin and it's very nice, but for some reason OpenSeeFace is not sending the values for shape keys to blender? I could've messed up something up following the tutorial or things have changed since this. Any solutions to this?

    • @nuekaze_media
      @nuekaze_media 6 месяцев назад

      Character moves but shapekeys don’t work? You selected correct mesh a it has aiueo shapekeys?

  • @cherrygirl8204
    @cherrygirl8204 6 месяцев назад

    can you make the second part of this video about after you finished with Blender how do you bring back to unity without to create parameters , animations please?

    • @nuekaze_media
      @nuekaze_media 6 месяцев назад

      I have planned to make a video that covers “Blender -> Unity -> VRChat” but not had the time. It will happen at some point. :)

    • @cherrygirl8204
      @cherrygirl8204 6 месяцев назад

      It’s ok 🥺

  • @NotNinjaGirl
    @NotNinjaGirl 6 месяцев назад

    this was a complete life saver thank you so much, just subscribed !

  • @ssniper_cat
    @ssniper_cat 6 месяцев назад

    Vet inte om jag har råd att köpa iPhone har redan en Android men funkar webcam bra eller ska jag satsa på en iPhone? Sparar också just nu för att ha råd med en PC

    • @nuekaze_media
      @nuekaze_media 6 месяцев назад

      Just denna guiden är för att använda iPhone men man kan köra VSeeFace med webcam också. Till Andoid finns det en app som heter MeowFace som kan vara värd att testa. Den ska fungera ganska lika tror jag. Annars fungerar webcam också bra så länge man har bra ljus i rummet så den hittar ens ansikte ordentligt.

  • @DoguitoVR
    @DoguitoVR 6 месяцев назад

    thank you <3

  • @mrdankhimself
    @mrdankhimself 6 месяцев назад

    Does each article of clothing need to be uploaded separately into Unity from Blender?

    • @nuekaze_media
      @nuekaze_media 6 месяцев назад

      The animation you make is not dependent on how the mesh is attached. As long it is under the avatar in the hierarchy and you can find it, it should work. I personally always prepare all my clothes in Blender first and then export everything as an FBX. But if you have a ready mesh you should be able to just drag and drop it onto the avatar in the hierarchy.

  • @Squiggy8440
    @Squiggy8440 6 месяцев назад

    Wadaiyo and vtube apps dont work with vsee face for me. Vseeface is upto date and i followed both tutorials. Neither are working.

  • @dumpmail-xz2qp
    @dumpmail-xz2qp 7 месяцев назад

    interesting, does this consume a lot of CPU/GPU?

    • @nuekaze_media
      @nuekaze_media 6 месяцев назад

      Hi, sorry for the late response. I don't have any exact performance measurements but I run it without issue on both my desktop and an older laptop, so it is in my experience not worse than other VTubing tools at least.

  • @minuettu
    @minuettu 7 месяцев назад

    this worked! tysm lovely

  • @LeahmayandDora
    @LeahmayandDora 7 месяцев назад

    YOU’re AMAZING!!! THANK YOUUUY

  • @allie4182
    @allie4182 7 месяцев назад

    i uploaded my avatar after doing this, but other people couldnt see my toggles. do you know why this could be?

    • @nuekaze_media
      @nuekaze_media 7 месяцев назад

      Can you see your own toggles? Others should see the same that you can see on your avatar. I have never heard this before so I have no idea unfortunately.

    • @allie4182
      @allie4182 7 месяцев назад

      @@nuekaze_media oh no D: i can see my own toggles and they work fine for me.. ill figure something out. thank you for the great tutorial!

    • @jollysss187
      @jollysss187 7 месяцев назад

      @@allie4182 From what a friend told me its the new SDK just being messed up and you gota just redo the toggle again that might fix it

  • @zcz3573
    @zcz3573 7 месяцев назад

    why i can't find onnxruntime (venv) PS D:\easyVtuber\OpenSeeFace-master> pip install onnxruntime opencv-python pillow numpy ERROR: Could not find a version that satisfies the requirement onnxruntime (from versions: none) ERROR: No matching distribution found for onnxruntime

    • @nuekaze_media
      @nuekaze_media 7 месяцев назад

      Which version of python do you use? From what I can see it should be available for 3.8 to 3.11. pypi.org/project/onnxruntime

  • @zcz3573
    @zcz3573 7 месяцев назад

    (venv) PS D:\easyVtuber\OpenSeeFace-master> pip install onnxruntime opencv-python pillow numpy ERROR: Could not find a version that satisfies the requirement onnxruntime (from versions: none) ERROR: No matching distribution found for onnxruntime

    • @nuekaze_media
      @nuekaze_media 6 месяцев назад

      Hi, sorry for my late response. For onnxruntime you need python version 3.8 or higher I think. If you already have that I unfortunately don't know what could be wrong.