Видео

Actually, the dynamic hair is done in JavaScript libraries (in the browser), which I then bake and export to USD/Omniverse as bone animation.

audio2face from NVIDIA Omniverse looks interesting. Unlike some solutions, it seems to be mesh based rather than blendshape based, so it can cope with a wider range of meshes. I am poking around the NDVIDI Omniverse discord at the moment learning more (XOrdinary99), and the Unity discord.

​@@XOrdinary99hey do you make it work? How fast is the API for audi2visemes by nvidia? Like for a 10s sound, will the user wait a lot? This would kill the ux.

@@rindtier7287 Try looking for NVIDIA Ace and Omniverse Convai - they are getting it going real time with player NPCs. Pretty cool stuff.

If two clips in a row, what I normally do is right click on second clip and there is an option to "align with previous clip"

@@extraordinarytv3483 Thanks, I tried that. didn't help :( It looks like people have the same issue again and again for the last 7 years and unity doesn't bother to fix faything :D thera are hundreds of topics on fotums and still no clear answer.

@@golosbezdoka Have you tried asking on the official Unity Discord? There is an "animation" channel there (I sometimes poke my nose there too). There is some complexity with root motion, clip types, etc. On Discord its easier to share screenshots etc.

@@extraordinarytv3483 oh, thanks! creating a Discord account :)

@@extraordinarytv3483 I have found an answer. It was on making my animations Humanoid. I'm not sure if it works for objects with wheels but I I'm having humanoid robots so it's ok. Thanks again :)

If you rig bones onto your avatar for eyebrows etc, you can animate those bones instead. Either that, or add blendshapes in Blender or similar (Blender calls them "shape keys").

Not 100% sure I understand exactly what you are doing, but I have discovered there is an official Unity Discord server which has a dedicated Animation channel. Lots of smart people there answering questions like this.

@@XOrdinary99 thanks for the reply. I have a timeline at the start of every scene with a 1 animator track and 4 characters. At the moment the animator track has the 1st characters which i have dragged and droped in the animator track. Lets say user selected the 2nd character. Now i want the animator track to automtically get the 2nd character at the start of the scene via some code or configuration. I will post my thread on discord as well.

@@ggwp8618 I am not sure the "best" way, but maybe you could update the "track bindings" which associate the object to be animated with the animation track? The track asset itself does not know what it is animating. The track bindings are the details that links a game object to the animation track so the animation track knows what to animate.

It might exist, but never heard of it myself. There are other libraries of code you need to use to capture camera, track facial signposts, etc. Gluing the VSeeFace code base directly into Unity would mean it cannot be used with anything else. The VMC protocol greatly simplifies cross platform compatibility, and versioning etc. (Unity changes their platform, so things change.) So technically it is possible - I just have not heard of anyone going that route (and I can understand why they have not).

You can certainly create your own clips - I do that mainly for things like facial expressions though because posing characters is a bit painful in Unity. Using the Animation window you can edit an animation clip. You can record the rotations per bone, but if you use Animation Rigging package you can record the IK positions for hands and legs, which is much easier (but less control). I used to use uMotionPro (I think i was called), but you create your clips in its own format and export to an animation clip. It works, but if you want to make a change you have to go back to its format, change it, and export again. The extra step was a bit annoying.

@@XOrdinary99 Ah, alright then, I thought there was a less painful way XD

VRoid Studio is a free download from Pixiv for creating 3D models and exporting them in VRM file format. (Lots of videos on how to use it on RUclips.) VRM files can be imported directly into PlayAnimaker (I forgot exact command, but it was pretty easy).

@@XOrdinary99 do I use sidequest And then go into the Anna make her file and put the VRM in there? Because I tried that and it didn’t show up and game when I clicked import.

@@MelonyBS If you check the "About" tab for this channel, I just created a Discord server where its easier to chat than RUclips comments. No guarantees on response rates though(!)

Simplifying... Blendshapes in Unity (Shape keys in Blender) is like a series of mesh distortions - move the points near the corner of the mouth up a bit because I want a smile. A "0" strength means don't make any changes to the default face, a "1" means add the full set of changes (relative movements). So a blendshape is like copying the mesh of say the face, then adjusting it for a particular expression (smile, sad, angry, etc). Blendshapes were great for different facial expressions in particular. // AR Kit then came along and said "rather than have one blendshape for angry, lets have 52 little independent blendshapes and use several at once to make expressions". So angry = left and right corners of mouth down, eyebrows down, eyebrows closer together, eyes closed a bit more... etc. In a VRoid Stuido character, you can look at "Face" and if you look on Skinned Mesh Renderer, you will find blendshapes there with slider strengths. // A "blendshape clip" is specific to VRM - it is a set of weights for all the blendshapes. E.g. you can define an "angry" blendshape clip" (really, more like a pose if you ask me) that says "use these weights for all the blendshapes to make the face look angry". The deltas for each blendshape and the base mesh for the face are added together to achieve the final result. (You can also change materials, but ignore that for now.). Does that help?

@@alanjameskent thanks for the explanation onblendshape clips, though, i do already know what blendshapes are it does partially help me understand what the clips are, but i still have no idea how to get them to work

@@notafunctionalhuman1335 *preset (not present!)

It looks like RUclips deletes my responses that contain URLs for some reason (spam protection?), so I created a Discord server to make Q&A easier. See the "About" tab of this channel to find the link. No promises I will see messages immediately!

I put the Transform behavior on each hand then the midi events were wired up up the position x/y values and the rotation value. So moving the controllers was like adjusting sliders. I also used midi events to apply triggers to switch the hand. But character animator now has built in full body tracking from a webcam, so I would look at that first.

It is early on, but I blog and release episodes at extra-ordinary.tv/ - only one out so far, next coming soon. episodes.extra-ordinary.tv/

@@XOrdinary99 哇！居然有神秘客！还挺想知道后面会发生什么，这个故事从剧本到故事板再到动画制作都是您一个人完成的吗？难度大吗？一共需要多久才能从零创作出来成品？

@@maxiaohuimaxiao Yes, I wrote script, designed characters (VRoid Studio), animated (Unity), created web site for publishing. It has taken a long time to learn all the tools. I was planning to blog more on how I do it in case others want to try. Static comics (no motion) would be MUCH quicker. But it has been fun learning it all!

@@XOrdinary99 太棒了，一个人完成的快乐我能想象得到，只需按照自己的想法来创作，完全可以把自己想要的内容讲述出来，真是个不错的方案！

What version of Unity are you using? I just upgraded recently to 2022.1b12 trying to get Rigging Animation and Sequences working together. In a new version there is a new "Feature Set" feature that makes it easier (don't remember when introduced), but waiting for a good stable combination.

ok, im in 2020 for some reason.... dear lord.

@@XOrdinary99 Thanks for the answer. I haven't seen it before realizing myself, that my packages look differently, which was odd. I'm downloading both 2021 and 2022 beta right now. We'll see:) I will take a look at your video to learn this stuff, as I have no idea about Unity:) (Unreal user here, learning for my students who are using Unity :D)

@@Reanimathor I would love to get your opinion on the pros and cons of each! I am using Unity as the VRoid Studio community mainly uses Unity, but UE5 has some cool looking visual capabilities. For me, being able to ask the community for help is probably more important.

(Hmmm, I left a comment using wrong account but cannot view it. Posting again.) I wrote up a blog on version numbers I am using in case helpful. extra-ordinary.tv/2022/04/23/unity-sequences-and-animation-rigging-versions-april-2022-update/

Strange! What version of VRoid Studio, UnivRM, and Unity are you using? I would drag the character into a scene in Unity, then click to expand the character so you can see the Face child object, then click Face and look in the Inpsector panel. Expand the Skinned Mesh Renderer component. In there, expand the Blendshape List. You should see sliders per expression etc. If you drag blink there, does that work? This will help work out if the blendshape is broken or the blendshape clip that references the blendshape. If you want more interactive help, I suggest visiting twitter.com/suvidriel/status/1353650757778735109?s=21 - she has a Discord server with a channel on Unity and Vroid. Easier to share screenshots there.

Hmmm. I replied on phone, but not showing up here. So repeating just in case. I suggest posting to the Character Animator forums - its easier to talk through the issue there (can paste screenshots for example). MIDI has "events" like "note down". In Character Animator in rigging mode you can tell it to "listen for a midi event and bind that to the trigger" so its triggered by a MIDI note press instead of a keyboard key press. (You can do more, like sliders, but if its just triggers then that is just note presses.) There are a few threads on MIDI there too that might help, like... community.adobe.com/t5/character-animator-discussions/midi-channel-numbers-with-character-animator/td-p/10106393

Thank you for the reply. After sending the comment, I checked a lot of different Virtual Midi "drivers", and I found LoopMidi. It works flawlessly with Character Animator and Touch Portal. (I just have to use two strings for one trigger on Touch Portal : 1. [Midi Note ON] - 2. [Midi Note OFF]) Are the Character Animator forums only for Creative Cloud members?

@@-._.-._.-._.-._.-._.- Yes, I used loopmidi as well successfully. I don’t know forum membership rules, but character animator I think is only available with CC subscription.

@@alanjameskent Ah cool! Are you using Touch Portal as well? Yes that is correct (+50€ per month!!)

@@-._.-._.-._.-._.-._.- No, I was using loopMidi to move signals between machines - e.g. HTC Vive on one machine, Character Animator on another.

There are two parts to it. There is the underlying 3D model of the character, which includes mesh adjustments to move the mouth, cheeks, eyes etc - the ARKit library from apple has 52 such little movements for example. Or you can do complete facial expressions all at once. Tools like Blender, Maya, etc can create them. Then there is controlling when they happen. Unity can control when they are used, it does not do a good job to create them. (There are other tools too that can use them.)

I use assets from the asset store then tweak them a bit. I don't have the skill or time to make full blown location scenes like that. That location mainly uses "Town Constructor 3" from the asset store.

@@XOrdinary99 that's awesome ^^ I'll check that out, thanks ^^ also your animationsare awesome as always ^^

In the Console window there will be a stack trace. It usually gives a hint which component is the problem. Normally for me it means I missed dragging the model to a property. ExternalReceiver has "Model" of "External Receiver" script (1 property) and EasyMotionRecorder has 2 (Motion Data Recorder / Animator is the important one for recording, but there is also Motion Data Player / Animator). You have to drag the model in the scene hierarchy for your character to those 3 fields. Otherwise, can you share the Console Window stack trace? I am after the file name and line number to check which field it is.

@@XOrdinary99 Thank you! But I still do not think it is working. What is the best way to send you a screenshot?

@@rachaelsix975 Do you have a Unity forum account? forum.unity.com/threads/evmc4u-and-easymotionrecorder-complete-hack-for-vmc-protocol-live-capture-in-a-window.1181998/ is an example thread you could reply to perhaps?

@@XOrdinary99 Just did! My name is SpasticRobots