Blender + Kinect (Part 5) - COMPLETE Animation Transfer Workflow
HTML-код
- Опубликовано: 17 окт 2024
- Alright, before I show you how to combine the Kinect-Rig with Your-Rig. I wanted to show you what the whole process looks like first. It's important you understand what the target is when you're building a solution- Here is a demo of the workflow in action :)
Microsoft Kinect V2 SDK:
www.microsoft....
Kinect Rig Exporter (Marco's Channel):
• Animating 3D models wi...
Marco's Direct Download Link:
marcojrfurtado....
Official Autodesk FBX Converter:
www.autodesk.c...
Free Female Modified Kinect Rig:
www.theroyalsk...
A HUGE thanks to all the Patrons for pitching in to help purchase the Kinect. There's no way I'd normally be able to afford this hardware, and create tutorials for it if it wasn't for the amazing support on Patreon so thank you so much :)
Required Computer Specs:
www.mathworks....
Xbox One Kinect Sensor Type:
www.ebay.com/s...
Xbox One Kinect PC Adapter Type:
www.amazon.com...
Free Female Base Rig Download:
• Blender 2.82 : (FREE) ...
Animation Speed Tutorials:
• Blender 2.82 : Charact...
If you enjoyed this video, please don't forget to like and subscribe!
You can find my entire Blender 2.8 Rigging Series here:
• Blender 2.82 Rigging T...
Also, you find me on twitter at: / theroyalskies
I also have a small 1$ Patreon perk available for anyone who would like to simply support the channel. Please check it out if you get the chance :)
/ royalskies
If you're a gamer, please check out my new game on steam! It took over 3 years to create and has thousands of hours and heart put into it :)
store.steampow...
As always, thank you so much for watching, please have a fantastic day, and see you around!
Royal Skies -
-------------------------------
Bit of a recap of last the last tutorial. But basically, all you have to do once you have the animation in Blender, is "Append" it to your character -
The longest part is just exporting from Kinect. Hope that helps- !
Damn, it is almost like you could have done the same thing with Mixamo's animations. Turn's out that's a load of crap and your's is much better.
I just want to say thank you, you've done for your RUclips community so much more than every other Blender creator out there, most of them would most likely put these files behind a Patreon subscription or a paid gumroad page, but you are putting so much time and effort and allowing anyone to get them, this kind of generosity is really rare nowadays.
You're very welcome - I try my best to put as much quality as I can for free. It's hard sometimes because I feel like I don't have much to offer the people who do support on Patreon because of that, but I've been very lucky to have amazing support there despite only being able to offer small perks. I'm glad you're enjoying the content though. I'll be sure to keep it up :)
This is way easier than any motion capture tutorial I’ve ever seen
The rig filter isn't available anymore. Is there a way I can download it still? Great set of video's, straight to the point and informative!
for heaven's sake what took me months to slightly have something decent not even working properly you did it in less than 3 min smh lol ggs to you my guy I will be swapping everything to your setup since I use perception neuron. this is why you are the only guy I listen to when it comes to rigging lol with this I will have a full workflow for editing and cleaning mocap data, thank you so much for this ;)
If you wait like a week, I'll have a much better transfer rig that would probably fit your Neuron animations better. This one is designed for Kinect, and it is built in a way to compliment it's strengths and hide it's weaknesses. If you're using Neuron, that means the data you're receiving is going to be much better than the data this rig is expecting. You'd be better off using a rig designed to embrace Neuron's good data, instead of this one which tries to guess what Kinect was trying to do.
But, feel free to reverse engineer your own solution too, just letting you know. The rig would look different if I knew the raw animation was coming from Neuron instead of Kinect -
@@TheRoyalSkies I'm no rush hehe thank you for everything :)
thank you for being so nice to share this to us
is there a way to properly install the female rig all these years later?
because every time i try installing it the link is down or a dead link.
Great video! We spent 6 hours yesterday messing around with the Kinect yesterday using the Kinect and it was super fun! I was wondering how exactly you made the custom rig that you exported the mocap to? Just for us who'd like to integrate the Kinect stuff into our own rigs in the future 😊
Our weeks of hard work taking video form~
I have no idea how you found all that out about importing Kinect animations, but you are obviously some kind of super-person :P It took me weeks just to fail at the end. Thank you very much for your perfectly presented knowledge master!
madlad levels are off the roofs
I might invest in this style of rigging, seems like it will help boost production. Least I could use it as a base, then add on to it. Thanks a lot of all of your videos. I hope it helps that I watch your videos on repeat daily!
Music gets panicky, viewers heart begins racing, "WILL HE FINISH!?" But Royal remains calm all the way through.
Please, the site is down "Website Expired", can you upload it to Mediafire? I wanted the "Free Female Modified Kinect Rig:"
and thanks for helping us so much
Just when I was about to give up on Blender... give my computer to a homeless person and move to the Himalayas... I come across this. Awesome!
Am I understanding this correctly? This method involves the filter file converting the action to be usable with the Kinect rig you provided. This doesn't provide any sort of retargeting. Will that be shown in a future step or will these tutorials only work for the rigs you provide? Without a retargeting solution I don't see how this kinect workflow is going to work for our existing rigs.
So, the filter file just makes sure all the bones are named and sized correctly so you can append them easily to your actual rig, assuming your actual rig has been modified to be manipulated by the Kinect skeleton. Any rig can be modified to be manipulated by the Kinect skeleton. I'll be showing you my particular way in the upcoming videos. But, it doesn't really matter how it the Kinect rig controls your rig, as long as it does because what you are appending is the Kinect Animation. In short, you make adjustments with your rig, after the Kinect rig has outlined most of the animations, I hope that clears things up a bit -
Also, how would you center the fbx animation since it records you at a distance? Everything also is backwards. Its not as straight forward as your flow
I followed the workflow but it just does not work!!! :(((((( pleas help!!! when appending the action, i select it and hit play but it does nothing, just nothing nothing :/
If we have our own mesh(s), how would we go about addin the animation to that, if we havent set up a rig yet and dont want to use someone elses rig?
Hi, im getting this problem at 2:10, right after import theanimation after the conversion, do you know why?
ASCII FBX files are not supported 'C:\\Users\\Dude8\\Desktop\\KINECT\\Converted\\Animation.fbx'
you must convert it
When I append the animation, it doesn't do anything. I added the animation and everything, but nothing happens. Blenda goes face down, but when I start the animation, she doesn't move at all.
Great tutorial
is there a way of using this rig with a FBX file from IPI Recorder/IPI soft using 2 cameras, i have tried following the video using the kinect rig but it didnt work so could it be achieved using one of the others, and great tutorials
hey guy after appending my model is facing the ground and just wiggling about. what did i do wrong?
Awesome but, I don't understand it completely. A rig must be created specifically for the information transfer from the kinect? In this case (Blenda/Blendo).
Or is it possible to have information from the kinect and transfer it to any rig.
Blenda's rig has been modified for Kinect, but you can modify ANY rig to be compatible with Kinect. I'll show you how specifically in the coming tutorials :)
when I go to append I don't see anything that says armature or actions. I'm not sure what I did wrong can someone please help me?
i cant append the male one ...I recorded and exported and opened in blender but i cant find the action
Thanks dude, would love a clean up animation video from ya (like one teaching you what to do to get everything the way you want it) wish blender had a buttersworth filter like mobu
2:10 where can I get the code, is that python code sir?
// oh, i though there were more lines, but 13th line was the last line.. i see..
# after blender2.9, this code works
import bpy, re
ob = bpy.context.active_object
assert ob.type == "ARMATURE"
# assert bpy.context.mode = 'OBJECT' # before blender 2.9
assert bpy.ops.object.mode_set(mode= 'OBJECT') # after 2.9
for thing in [ob, ob.data, *ob.data.bones]:
thing.name = re.sub(r'Skel[0-9]+:', 'Skel:', thing.name)
assert ob.animation_data and ob.animation_data.action
action = ob.animation_data.action
for fc in [*action.fcurves]:
if fc.data_path == "scale":
action.fcurves.remove(fc)
ob.scale = [0.010634]*3
But if we have our own rig, or are using rigs from an addon (like autorig pro) or the UE manikin we should just retarget, right?
did you figure this out?
Is it also possible to have multiple kinects to record at the same time?
Hmm truly interesting I kinda want to reverse engineer how you prep'd Blenda's rig for such a easy transition.
so that easy transition can only be done with Blenda? if we want to add it to anything else, we have to do the other tutorial that hours upon hours or rerigging?
About motion capture I'm useing tracker + finalik ,Asking about
Shoulder problems,
Follow your "Shoulder & Collar Bone Driver it can't input to unity
The unity hum RIG can't match the same
Parent bone. How to fix this !!
That's really weird, the shoulder driver imported to Unity when I tried it like this: ruclips.net/video/D-HDrhHgATo/видео.html&ab_channel=RoyalSkiesLLC
Are you exporting as an FBX??
@@TheRoyalSkies Yes I exporting as FBX file, and I'm doing 5 vive tracker's on my avatar to do mocap
unity humanoid can't match the shoulder - uparm as parents
is male version avaible for kinect as well blenda ?
Wait, will this work for any rig? or only some. Our project uses modified rigify rigs and actually getting everything put together has already been a right nightmare.
Yes, you can modify any rig to do this. As long as your rig is controlled by the Kinect rig, you just have to append new animations to it :)
Can we use PlayStation instead of xbox?
i still feel ike i have no idea how to connect my kinect animation to my character, even after wathcing all the tutorials, i still dont know how to use the file i downloaded of blenda other than the one that clenas up the raw data and save it to then append to my model. which when done does nothing. i have no idea still what youa re doing half the time becasue this is no simple tutorial you apparenlty have to know quite a lto to use this.
Where that play button and actions located?
Awesome. The hardest part now is to get an actor^_^
So, Is it possible to transfer the armature and skin weights from Blenda to my own character?!
Actually yes, you can use an Addon called "Mesh Data Transfer" :)
@@TheRoyalSkies could you do a tutorial on that? Please? Would be a useful 'Part 7' to finish the series off.
scratch that, i just watched part 6 and saw you're going to do that anyways lol Cheers!
Huge tip:
Select the bones with noise on animation open graph editor select all graphs and press ALT + O three times or more.
Is this the hotkey for smoothing? If done wrong, it makes the animation less detailed/crisp. So try to only use this for noisy keys.
Why my animation is super slow? 10second recording is like 100k frames
ive seen this video like a hundred times. i have followed everythign you did step by step. i cannot make it work.
SO, you've finally got your Kinect™ animation into Blender but you have no idea how to Kinect™it to your character..
You're a amazing person. LOL
why is vibration?? the character is vibration... what is the solution ???
It's Kinect's raw data. You fix that in a method called "Clean-up", generally you delete key frames where it vibrates. Blender will usually transition smoothly between the remaining frames -
Thank you BUT I hope to show us this Please
so.. how do i add it to my human model??
also in Mac ?
do you know how to put scenes in sequence?
Wosome 👏👍
Those knees be shakey
How to clear the bone rigs please
Blender animation speedrunning
Dance dance😏
WWWWWWWWWWWWWAAAAAAAAAAAAOOOOOOOOOOOOOOO. I want to put in a request here. MOCAP but not Kinect. There is a MOCAP App - MOCAP Grande. The free version has the needed feature to capture motion. It delivers BVH. Also the bone structure has added bones compared to the regular rig so mapping is a challenge too. Could you look at that as how to get it into Blender if possible.
Have a bunch of empty frames in the animation timeline before the movement actually starts. Like tens of thousands of frames. Ideas?
nevermind. I figured it out
Beginning to think I wasted $25.
Repent and trust in God the Lord most high and be saved! For God so truly loves us all! Never forget! Amen! Cheers royal skies, awesome stuff.
Sothe legs are kinda twitching... how do I remove the twitching.
Easiest way I know is to click the Kinect rig in pose mode and delete the frames responsible for twitching. Blender should automatically transition between the remaining frames -
@@TheRoyalSkies thanks dude.
Is it possible to record 2 people at the same time? That also includes interactions