"During the process of creating, that is when you learn the most. You find solutions to problems and create new pipelines" - this is so so true! Great video!
Just to put this in perspective: she is using at least 47 168$ of hardware, not even including software licenses. So the result is really nice, but it's also very proffesional gear. Not for your average 3D Artist 🥲 Faceware Mark IV $ 28,749 Xsens MVN Link $ 13,630 Manus prime II $4,789
Exactly! haha, I was like shit you quit bartending and bought 50k worth of the highest end gear to make a short for yourself? -- That must have been some seriously nice bar:)
I've been working with unreal engine and 3d applications for 15 years, its really great to see how elements of the engine have become very intuitive for people like yourself to just jump in and create awesome work without years of experience under your belt. Very talented work and I'm glad you are able to express your creativity without a problem using ue5
This is by far the best mocap result I've seen so far. There were no jerky movements and the mouth didn't half way open like other videos I've seen. This is perfect.
The uncanny valley is slowly disappearing. This is gorgeous. Can’t wait to see it in video games, imagine the drama the characters will convey with those realistic expressions.
Having a team just for a dedicated work flow is very helpful. As a solo artist, I struggle alot due to lack of limited online information, funds and time. You all r great and doing 100000x great job than mine 🙂. I m steel limited to use manual key framing for animations.
Not even sure what to say. You are amazing. I'm slowly getting into UE5, focusing on lumen and nanite, however it's hard to ignore how incredible this platform is in so many other aspects. Thank you for sharing this.
This looks amazing but you are portraying that you are getting this quality in real-time but looks as though you did a lot of clean up work in face ware studio and then edited the video together to make it look like it was done in real time. Am I wrong? Also, you mention that you had no experience in this a year ago but you bought $30k in equipment? How much did everything really cost you? Did you invest all that money so you could turn it into a business as a freelance virtual production artist?
Saw you mentioned in an Epic Games metahumans talk at SIGGRAPH in Vancouver today- had to look you up. Incredible work! Especially for a newly self-taught person, this is inspiring!
Brilliant video thank you - I am starting out with performace capture, with the emphasis on performance. Your character's aminmation is so nuanced! Inspired.
Gabriel, its very very cool👍 Thank you for studying this awesome job and sharing your experiences and knowledge with us. Develop further and share with us. We will support you by getting inspiration from you. I hope that transferring your project to UE5 will be a big bang, in the field of animation, graphics, motion capture and much more. Your 3D model is as beautiful as you are🤩 Greetings from sunny Kazakhstan🖐
5:34 "faceware will get you 90 percent of the way there" - Thanks for this stunning video. Question about this one quote: Is there any place where you compare the raw faceware images with the final? And did you ever get more of those jitters solved? For example is the facial tracking you show in this video, say at 1:20, is that raw or processed (by you, by hand). And if it is processed how long did that take per second of video? Did you find it mostly a problem with mouth closures on the explosives? Thanks
By far the most interesting, valuable, insightful look at this world which I have only recently begun to seriously learn. I really appreciate you making this, instantly subbed.
Amazing tech. Little bit of sticker shock when I seen the 30k pricetag (For just the Mark IV Wireless Headcam System). You can't deny the results though. Look fantastic.
I really enjoyed this video. I am proud of you! So, does anyone you know use their Metahuman to livestream? I am having a hard time finding real time content. Thank you!
30 yers exp.. Thats amezing ... its wold take me some month or 2 to make this from scratch in some 3D soft.. With 1 year exp.. Thats Crazy.. Modern Stuff..
Hi! Your video and workflow is amazing! Really open my eys to a new virtual world! I am a blender user and very interested in learning blender / metahuman / Unreal. I am very new to Unreal 5 and very much hope that you can make a in-depth tutorial to help show the steps! It really helps newbie like me try to enter this fun world like you! Also, I love the presentation of your avatar, she looks very pretty! Great work and hope to see more videos from you!
Thank you so much! Wish I knew blender a little better so I know what it is like using a new software. I will be releasing a full course soon for this metahuman motion capture workflow, so stay tuned!
The jitter smoothing looks good, you make UE look real good. I think the reason it still looks stiff at some parts of the face is the rig. Most sliders on the rig is a 2 way axis. So this looks like a great previz but i wonder if it'd be possible to fully utilize the axis on each bone for the final shot somehow.
This is so so helpful, as always Gabriella. You make such clear, awesome videos. Faceware is so great - I just wish they employed someone like you to fix their “how to” videos and help resources. They are outdated and don’t help with common bugs and issues. Btw Faceware studio is heavily dependent on having major contrast between lips and skin, and strong eyebrows. I have pale skin and pale-ish lips, sparse-ish eyebrows, plus a beard/mustache. Faceware Studio doesn’t work unless I wear heavy makeup. :) I have FW studio and also own analyzer/Retargeter which is much more accurate but harder to use. And is buggy with metahumans and maya - crash city! 😂
Thank you! I personally do not have a beard lol so I haven't experienced this issue. I know the beard might confuse the tracker because you really want your mouth visible for it to get good tracking. I also recommend trying the different tracking methods - stationary vs professional head cam options. I have not used the Maya pipeline so I am missing out ;)
Um, not to diminish anything you are doing (it *_is_* extremely impressive), but why are you doing this, and who is funding your project? It all sounds very intense and *_very_* expensive.
Hey Gabriella, It's amazing that you showcase the facial animation quality that can be achieved by a single person. Looking forward to see your continued journey. I have a few questions: 1. How much time did you approximately spend on manual clean-up and additional animation in the video's that you have shown so far? Or what would be a good estimation to achieve your quality level for 1 minute of continued speech animation? 2. Did you fully manually animate the tongue or did you use some tool to help you with this? 3. Can you show a side by side comparison of the raw motion capture data vs the post-processed (incl manual work) version? I'm quite interested in the visual difference. Thanks in advance and keep up the good work!
Thank you for your kind words. To answer your questions: 1. It is hard to give you an approximate time on how long each performance takes for fine tuning. It really depends. The Greek metahuman robot girl took me three days. The one following that, that had more dialogue and took a bit longer. 2. I did animate the tongue manually and used my own reference video to figure out when to drop those keys. I show my process for this in the intro of this video ruclips.net/video/Yxm9qMo9gyQ/видео.html 3. Raw vs processed data..skip to 6:32 ruclips.net/video/S6-JkiqlGRM/видео.html so you can get an idea of what the data looks like raw with the additive layer disabled vs it enabled.
"During the process of creating, that is when you learn the most. You find solutions to problems and create new pipelines" - this is so so true! Great video!
Just to put this in perspective: she is using at least 47 168$ of hardware, not even including software licenses. So the result is really nice, but it's also very proffesional gear.
Not for your average 3D Artist 🥲
Faceware Mark IV $ 28,749
Xsens MVN Link $ 13,630
Manus prime II $4,789
Exactly! haha, I was like shit you quit bartending and bought 50k worth of the highest end gear to make a short for yourself? -- That must have been some seriously nice bar:)
I've been working with unreal engine and 3d applications for 15 years, its really great to see how elements of the engine have become very intuitive for people like yourself to just jump in and create awesome work without years of experience under your belt. Very talented work and I'm glad you are able to express your creativity without a problem using ue5
Thank you so much for your kind words!
Is Blender + UE5 a good choice, from the career standpoint, for somebody starting out in this space?
This is by far the best mocap result I've seen so far. There were no jerky movements and the mouth didn't half way open like other videos I've seen. This is perfect.
Mocap always looks better if you have tens of thousands of dollars to work with
This is the best model I have ever seen. Good for you for giving the proper credits to your contributors :)
The uncanny valley is slowly disappearing. This is gorgeous. Can’t wait to see it in video games, imagine the drama the characters will convey with those realistic expressions.
Talented and beautiful, willing to share her experiences to make others better.
The riggers on this are gods. This blows my mind.
Setting the example for the rest of us, just amazing
Having a team just for a dedicated work flow is very helpful. As a solo artist, I struggle alot due to lack of limited online information, funds and time.
You all r great and doing 100000x great job than mine 🙂. I m steel limited to use manual key framing for animations.
Wowww.... Superb.... 😍 😍
Amazing! Thank you so much for documenting this process and sharing with all of us.
it was the best motivation for me as a demotivated artist these days. thanks.
Not even sure what to say. You are amazing. I'm slowly getting into UE5, focusing on lumen and nanite, however it's hard to ignore how incredible this platform is in so many other aspects. Thank you for sharing this.
What a wonderful person you are!
felt like a lone wolf geeting fed, thanks!
Incredible work Feeding Wolves!
Technology is insane dude,
This is the go to benchmark.
For the people who think this is accessible, all of that is over $40k worth of equipment. Just saying...
You can now do it with a camera or 2
@@criscanto7040 lol I we all wish.
@@TheFunDimension not kidding I work with AI I can translate movement in my camera to UE
@@criscanto7040 can u share ur workflow?
@@criscanto7040 you know it doesn't fucking look anything close to as good as this lmao the hand rigs are insane.
I can’t wait to see this in actual video games
This looks amazing but you are portraying that you are getting this quality in real-time but looks as though you did a lot of clean up work in face ware studio and then edited the video together to make it look like it was done in real time. Am I wrong?
Also, you mention that you had no experience in this a year ago but you bought $30k in equipment? How much did everything really cost you?
Did you invest all that money so you could turn it into a business as a freelance virtual production artist?
The eyes wide open as a sync point is a gem! 👍👏
Saw you mentioned in an Epic Games metahumans talk at SIGGRAPH in Vancouver today- had to look you up. Incredible work! Especially for a newly self-taught person, this is inspiring!
Thank you so much!!!!
Outstanding
Awesome!
This is what the Metaverse should have been!
Brilliant video thank you - I am starting out with performace capture, with the emphasis on performance. Your character's aminmation is so nuanced! Inspired.
Wow, you made an amazing leap. Very cool. Congratulations.
Gabriel, its very very cool👍 Thank you for studying this awesome job and sharing your experiences and knowledge with us. Develop further and share with us. We will support you by getting inspiration from you. I hope that transferring your project to UE5 will be a big bang, in the field of animation, graphics, motion capture and much more. Your 3D model is as beautiful as you are🤩 Greetings from sunny Kazakhstan🖐
fantastic! will sub! Im just starting my journey into unreal and i couldnt be more thrilled! this is great! keep it up!
Congrats! Looks Awesome. This level of tech is ahead of what artist have been trying to do for decades. Totally Next Gen.
5:34 "faceware will get you 90 percent of the way there" - Thanks for this stunning video. Question about this one quote: Is there any place where you compare the raw faceware images with the final? And did you ever get more of those jitters solved? For example is the facial tracking you show in this video, say at 1:20, is that raw or processed (by you, by hand). And if it is processed how long did that take per second of video? Did you find it mostly a problem with mouth closures on the explosives? Thanks
Fantastic!
Ziva looks more true to life to me. I think you should try it.
Thanks so much for showing us the process. Looking forward to learning more.
By far the most interesting, valuable, insightful look at this world which I have only recently begun to seriously learn. I really appreciate you making this, instantly subbed.
Most excellent ... WOW
WOW this is beautiful, how do you syncronise the audio when using a meta human?
so amazing
Amazing tech. Little bit of sticker shock when I seen the 30k pricetag (For just the Mark IV Wireless Headcam System). You can't deny the results though. Look fantastic.
Very well explained. Great work on documenting this and explaining it so succinctly.
this is so good!
Beautiful work.
Thank you for explaining your process.
Subscribed.
This is truly inspiringggg!!Keep going Gabz
Bravo. I love this!! Well done!! Inspiration for me to up my game.
just beautiful
just amazing, really impressive work
excelent video your work is cool, I hope you can execute all your ideas and projects with great success. Blessings.
awesome talking animation
Brilliant
Thank you for this! keep up your amazing work and sharing 😍
Incredible. 😊💯
I would be so happy to invest in these products, as soon as they do away with the ridiculous subscription costs. ^_^
This is crazy awesome!
Dats my Girl!!! GET SOME!!!
Most impressive, a consistent inspiration!
Κάνεις φανταστική δουλειά !!! Συγχαρητήρια !!!
Mind blowing!
I really enjoyed this video. I am proud of you! So, does anyone you know use their Metahuman to livestream? I am having a hard time finding real time content. Thank you!
amazing
Amazing!!!!!❤👍
Amazing job! Thank You!!!
I really admire you!
I love your channel. That's great.
Thanks for this! Amazing work 💥💥. Can’t wait to see what’s next, Feeding Wolves :)
Great work!
really insightful thank you
This is awesome!
Why are the lip animation so much better here than with an iphone and live link?
interesting video you are super talented and a inspiration!
Amazing, excited to see more!
Amazing videos.very inspiring.
3:24 in you answer my question thasnk you very much you are the very very best
30 yers exp.. Thats amezing ... its wold take me some month or 2 to make this from scratch in some 3D soft.. With 1 year exp.. Thats Crazy.. Modern Stuff..
Awesome work! Can't wait to see what you can do in Unreal 5!
Hi gaby, nice project, where can i get the clothes that you used?
damn this is amazing
Hi! Your video and workflow is amazing! Really open my eys to a new virtual world! I am a blender user and very interested in learning blender / metahuman / Unreal. I am very new to Unreal 5 and very much hope that you can make a in-depth tutorial to help show the steps! It really helps newbie like me try to enter this fun world like you! Also, I love the presentation of your avatar, she looks very pretty! Great work and hope to see more videos from you!
Thank you so much! Wish I knew blender a little better so I know what it is like using a new software. I will be releasing a full course soon for this metahuman motion capture workflow, so stay tuned!
@@FeedingWolves Thanks and looking forward for your tutorial! Have a nice day!
Just went on their website to check the pricing and the system (Mark IV) you're using right now is 30 grand usd? Bananas
AMAZING!
The jitter smoothing looks good, you make UE look real good. I think the reason it still looks stiff at some parts of the face is the rig. Most sliders on the rig is a 2 way axis. So this looks like a great previz but i wonder if it'd be possible to fully utilize the axis on each bone for the final shot somehow.
Thank you so much! I am not sure if it is possible to fully utilize the axis on each bone.
like you i am trying to change my life using unreal. Thank you for the inspiration.
Its going to happen sooner than you think! Keep at it!
@@FeedingWolves your so kind, thank you for the nice words!
awesom
Thank you so much will this work on Daz characters too?
This is VERY interesting. How do you do you do such things? Can you make an in depth tutorial??
(Great work Feeding_Wolves, blown away as usual.)
This is so so helpful, as always Gabriella. You make such clear, awesome videos. Faceware is so great - I just wish they employed someone like you to fix their “how to” videos and help resources. They are outdated and don’t help with common bugs and issues. Btw Faceware studio is heavily dependent on having major contrast between lips and skin, and strong eyebrows. I have pale skin and pale-ish lips, sparse-ish eyebrows, plus a beard/mustache. Faceware Studio doesn’t work unless I wear heavy makeup. :) I have FW studio and also own analyzer/Retargeter which is much more accurate but harder to use. And is buggy with metahumans and maya - crash city! 😂
Thank you! I personally do not have a beard lol so I haven't experienced this issue. I know the beard might confuse the tracker because you really want your mouth visible for it to get good tracking. I also recommend trying the different tracking methods - stationary vs professional head cam options. I have not used the Maya pipeline so I am missing out ;)
Inspiring af
Whoa!
Would be nice if the fine lines in the face of the robot lighten up with colors together with emotions..Nice work!!! i like it
Thank you! And yes, now that you mention it, that would be cool if they lit up!!!
@@FeedingWolves 👌🤜🤛❤️
Это супер
Um, not to diminish anything you are doing (it *_is_* extremely impressive), but why are you doing this, and who is funding your project? It all sounds very intense and *_very_* expensive.
I'm still waiting for the last Marylin Monroe film, yet to be completed. When will this be happening???
.
Imagine tech with quality like these in the VR world...
It's coming!!
@@FeedingWolves So we will meet in VR and it will feel like we are meeting in reality? can't wait to see ya!
Hey Gabriella, It's amazing that you showcase the facial animation quality that can be achieved by a single person. Looking forward to see your continued journey. I have a few questions:
1. How much time did you approximately spend on manual clean-up and additional animation in the video's that you have shown so far? Or what would be a good estimation to achieve your quality level for 1 minute of continued speech animation?
2. Did you fully manually animate the tongue or did you use some tool to help you with this?
3. Can you show a side by side comparison of the raw motion capture data vs the post-processed (incl manual work) version? I'm quite interested in the visual difference.
Thanks in advance and keep up the good work!
Thank you for your kind words. To answer your questions:
1. It is hard to give you an approximate time on how long each performance takes for fine tuning. It really depends. The Greek metahuman robot girl took me three days. The one following that, that had more dialogue and took a bit longer.
2. I did animate the tongue manually and used my own reference video to figure out when to drop those keys. I show my process for this in the intro of this video ruclips.net/video/Yxm9qMo9gyQ/видео.html
3. Raw vs processed data..skip to 6:32 ruclips.net/video/S6-JkiqlGRM/видео.html so you can get an idea of what the data looks like raw with the additive layer disabled vs it enabled.
Is it possible to use an Advanced Skeleton rig that uses a Metahuman rig for the face?
amazing feeding woles
Looking great, when is your short film coming out? :)
Thank you! As soon as I get in the swing of things in UE5, still learning all the new tools;)
Stunning amount of information, great video, thank you!