AI Characters in Web Browser using ThreeJS and Reallusion Character Creator | Convai 3JS Tutorial
HTML-код
- Опубликовано: 2 июл 2024
- Convai powers the minds of 3D avatars in virtual worlds. In this video, we’ll be guiding you on integrating Convai’s AI functionalities with a @reallusion Avatar, all on your web browser using Three.js and React. Using Convai, you can effortlessly add complex AI functionalities to your Reallusion character, enabling dynamic natural conversations, scene perception, actions, and various animations. Level up your web projects with Convai today!
Sign up at convai.com to try it out. Also, stay updated with all things Convai by reading our blogs at convai.com/blog.
Write to us at support@convai.com for any queries, bug reports, collab, or business-related engagement.
Reallusion Web example [Github] : github.com/Conv-AI/Reallusion...
RPM Lipsync example (Github): github.com/Conv-AI/RPM-Lipsync/
Blender add-ons: github.com/soupday/cc_blender...
React-three-fiber: docs.pmnd.rs/react-three-fibe...
Three.js: threejs.org/
Actor Core (Reallusion Characters): actorcore.reallusion.com/
Timestamps:
00:00 Intro
00:45 Export Character From Reallusion's CC4
01:17 Export Character Animations
02:38 Setting Up Blender Add-Ons
03:12 Importing Character to Blender
04:54 Exporting Character from Blender
05:05 Set-Up Animations in Blender
06:37 Craft the Character Mind with Convai
07:37 Setting Up the Code
08:04 3D Environment Set-Up
14:09 Importing Crowd Characters from Reallusion
14:54 Set-Up Ready Player Me Characters
15:27 Outro
Follow us on your favorite platforms to stay in touch:
Discord: / discord
LinkedIn: / convaitech
Reddit: / convai
Twitter: / convaitech
Instagram: / conv.ai
Facebook: / convaiofficial
TikTok: / conv.ai
ArtStation: www.artstation.com/convai
Excellent tutorial, congratulations
Is this available for HoloLens 2.0 with Unity?
Can i use it For React Native i wanna build a mobile app with it
Yes! You can use Reactive Native for developing your mobile app.
React Native Integration Documentation: docs.pmnd.rs/react-three-fiber/getting-started/installation#react-native
Can we import .fbx character files
Hey! Thanks for your comment.
Yes you can import .fbx files; check out this documentation for more details: docs.pmnd.rs/react-three-fiber/tutorials/loading-models#loading-fbx-models
We suggest to convert it to .glb using blender to resolve any orientation issues that might occur.
Can I use any version of Blender?
You can use any version for data type (glb, fbx) conversions but for the extension you can follow the docs here: github.com/soupday/cc_blender_tools
@@convai When I do Rebuild Material the texture looks strange
No shet. It can't be real. I'm also a Frontend Developer so I know logically it is real. But Can we use Vtuber instead?
Vtuber is animated image right?
Good grief. Seems WAY more complex that just pulling an FBX into Unity, setting it up in Convai and publishing as a WebGL project.
That is why we let you do both! Sometimes it is advantageous to use unity, sometimes 3js!