Getting Started with iClone NVIDIA Audio2Face Plugin | iClone Tutorial
HTML-код
- Опубликовано: 23 июл 2024
- www.reallusion.com/iclone/nvi... The Audio2Face tool in Nvidia is an excellent way to get natural-looking facial animation and lip-syncing results for your characters. In this tutorial, you’ll find out how you can import the data from this cutting-edge tool and bring it into iClone to apply to any character you want, and further enhance and edit the results with your own personal touch.
00:00 Intro
00:15 Plug-in Setup
01:38 Character Export & Blendshapes Mapping
03:22 Audio2Face JSON File Export
*"Omniverse Audio2Face" is now known as "NIVIDA Audio2Face".
*Note: Assets shown in this tutorial serve only as reference material.
------
Create natural talking animations with iClone Audio2Face Plug-in:
www.reallusion.com/iclone/nvi...
Download iClone and Audio2Face PlugIns free:
marketplace.reallusion.com/nv...
Learn more from Audio2Face Getting Started Tutorial:
• Getting Started with i...
Try iClone for character animation for 30 days free:
www.reallusion.com/iclone/dow...
✦WATCH MORE
Learn about iClone: www.reallusion.com/iclone/def...
Learn about AccuFACE: mocap.reallusion.com/iclone-m...
✦FOLLOW US
Facebook: / reallusionsoftware
LinkedIn: / 94371
Twitter: / reallusion
Instagram: / reallusionofficial
Magazine: magazine.reallusion.com/
Forum: forum.reallusion.com/default.aspx
✦ONLINE HELP
TUTORIALS: courses.reallusion.com/home/i...
MANUAL: manual.reallusion.com/iClone-...
#iClone #facialanimation #NvidiaAudio2Facce 
Кино
great tutorial. I don't know how many out there are like me, I know your time is valuable--BUT- allowing points to land a bit would be helpful. I mean, I was able to replay stuff but often within 5 seconds you've mentioned 3 steps (or more) and for a plugin like this, not all of us are up to snuff. I had to back track and install Omniverse, then launcher, then find the 3 plugins needed (separate from the Reallusion downloads) for Audio2Face to operate. All doable and maybe this works perfectly, and maybe I'm 3 steps behind and need to get clarity on more basics. Anyway, all installed, all good. lol
I arrived at the same conclusion but can't reproduce all of what he's doing. Especially regarding the "Mark" Autosetup. No matter what I do the silver head doesn't show up the way it does for him in the video. Have to watch other tutorials to figure this out.
I've been waiting for this, thanks!
Thanks RL team for this update. It works great.
Thanks for the tutorial - really appreciate RL staying on top of tech. As great as this, it is very cumbersome. The more cumbersome a tool is the less likely anyone, (especially hobbyists), are going to use it. Very much hope you create something like this for AccuFACE or as Plugin that doesn't require Omniverse.
This is very cool. Thanks for the tutorial.
Wow! works great technology has come a long way
I'm speechless!
wow, thank you
Do you need usp component? I cannot find the check box for export its gray
cool, thanks
hold on. genuin question why would you go through the hustle of using audio2face only to replace the visme with acculips?
In my test, though audio2face works with viseme and expression simultaneously. If you want an accurate lip sync animation and can fine-tune it, the Acculips will be better.
When i cllck the cc base body set up, the work screen glitches
ugh please tell me im not the only one thinking reallusion overcomplicated a simply process just to sell another plugin?
Yes mate that's true
This plugin is free. I think the benefit is to be part of Omniverse. I am not seeing anything amazingly different, but this is new and evolving ai that will only get better. I think the point of it is, the expressions will more accurately reflect the emotion of the audio based on some crazy algorithms. I wasn't entirely impressed with the demonstration but like I said, it will only get better, so I'm in. I didn't have to pay for any of this, did you?
plugin not showing up in iclone anyways
Probably a dumb thing to say, but it would be awesome to have it directly in I Clone.
That is Nvidia technology, They can't just implement it.
let's just be happy this is now easier than ever to implement. the process before, while also nothing that complicated still required a bunch of steps which are now fully scripted so ... super convenient.
windows says that this file contains a virus
100
Kai, I get the Please select "CC_Base_Body" mesh node first, then press the Setup button box after I hit the setup button in the CC Character Auto Setup button. I am unable to continue. Note: I had to wipe my computer just to get the AUDIO2FACE app to open.
just close off that dialog box and click directly on the plug in in the left plane and u will see the option come up in the right plane like normal
Thank you
I am going to try that now
You were right! I clicked on the face and it populated!! Thank you!!!!
I had the old Iclone for 32 bit Windows 8 or something. Can I still upgrade at a discount?
And the old version was all in one and not 20 different programs... How many programs would I need to do what I wanna do? lol
Is the process the same for character creator 4?
Does not worjk, I have iclone v8 installed on a different hard drive along with CCv4 and when I copy the file to bin64 open plugin it is not on the list, I do not want to eat up all my memory on my C drive. Why cant RL have this plugin with a exe file from the RL HUB user account page (always going thru files to add plugings purchased or free that almost never work the 1ft time when the software is not installed on the C drive) Please just make exe file instead of the user moving files around and in the EXE install file add options for locations to install NOT EVERY ONE USES JUST THE C DRIVE FOR EVERYTHING
Is there a place where a complete newbie can find training resources or tutorials for iClone?
The NVIDIA_Audio2Face file appeared in the iClone 8 plugin. However, the CC.Character.Auto.Setup-1.0.0 file does not seem to be an installation file itself. How do I install it?
You can check the video at 1:18 , it is installed in Omniverse A2F
When i already have accuface and acculips, do i still need this?
depends, if you are satisfied with the emotions matching your audio and don't need any further tweaking then no. But this is evolving ai, so greater (and easier?) accuracy should be right around the corner. Eventually, this tech should be pretty close with just an audio file. Expression matching the emotions in the audio.
when i try to 'Add to Cart' it says not available for purchase. Don't see any other way to download
I guess they have (temporarily) pulled the plug, because the download file for the plugin triggered a virus warning (at least it did in Windows) and they are now investigating what's wrong.
can anyone tell where to download the omniverse launcher, i only can find the sdk in nvidia website.
Hi @ChrisD-c9z,
You can download the Omniverse Launcher from the official NVIDIA website:
www.nvidia.com/en-us/omniverse/download/
we need soft cloth physics transfer from iclone to omniverse
friends, I can't add recorded audio. It is not displayed in the audio2face menu. what can I do to make it appear in the menu?
You need to locate the folder first on the track root path, and then select the track in the track name.
The audio file capacity is too small and cannot be found. Try an audio file with a larger capacity.
Acculips is betterm, when i use this the screen of audio2face glitches
TESTING NOW
Why use audio2face? Is it better than acculips? Probably not. What's the benefit of using this method?
You don't need a video clip for this... just audio
Do we delete the old one? Answer is no, I think.
The usd file from iclone dont appear when i open the a2f file in omniverse
make sure you've checked the Include Audio2Face Mesh when you are exporting from iClone
@@prooronkon9499 i did check it and also delete hidden faces then went to audio2face to import tha a2F of usd but when i click it no face appears just all black area
I have the same issue, did you find a solution, are you using a trial version?
@@prooronkon9499 We've clicked that and still it doesn't work
This doesn't work. When we export as .USD with the A2F Mesh Tickbox selected. Sometimes it generates a A2F Folder within the export, but within this, it doesn't have a USD file. Then sometimes, it doesn't generate a A2F Folder at all when exporting. It's seriously broken. I wonder if it's because I'm using a trial version?
Hi @Niall96,
Thanks for the feedback. Please submit your issue with clear screenshots and/or screen recordings to our support team, and we’ll resolve it as soon as possible:
www.reallusion.com/CustomerSupport/User/FAQList.html."
Is this available in 8.4?
yes it is
Out of all the tutorials from Reallusion I find this one very hard to follow as I'm not getting the same results in NVIDIA's software. Especially regarding the CC Autosetup
I'm sorry but this is just too hard for me
The next . Reallusion need update. make tool grafis like grafis blender.
Clunky, buggy and all around ineffective. Importing your own audio is an adventure of its own, with little to no information or help from the forums. Found a post about someone trying to add their own audio and basically getting "shamed" for not having an RTX, because by the NVIDIA employee's explanation, Audio2Face supposedly works only with RTX. This turned out not to be the case at all, the OP figured out that you just need to export at a specific bitrate.
Here's the kicker though; this thing is so broken that within a day, the bitrate solution worked and then it just didn't. On top of that, couldn't even get to the point where you can test the json in Iclone, because the export stops at 100% and doesn't create any files. Probably will get better at some point with this being beta and all, but dear lord people, start employing dudes that actually know how to answer questions rather than read from a Notion script.
I'm facing the same issue of getting stuck at 100 percent. Have you found a solution?
Yes!
For the export portion, you need to change the export to another partition on c because by default it just gets lost, as for the sound you need to rename the wav to have the lower case ending rather than the capslock one@@mohammadfarshoukh
@@blatadej5474 Thank you so much! Your solution worked perfectly and truly brightened my day. I'm incredibly grateful for your help!
@@blatadej5474 Thank you so much! Your solution worked perfectly and truly brightened my day. I'm incredibly grateful for your help!
Thank you so much! Your solution worked perfectly and truly brightened my day. I'm incredibly grateful for your help!