Creating Lifelike NPCs in Unity with Reallusion CC4 Characters | Convai Unity Tutorial

Поделиться
HTML-код
  • Опубликовано: 2 июл 2024
  • By the end of this tutorial, you will have a working ‪@reallusion‬ Character Creator 4 NPC that you can talk to and interact with in a 3D web environment using Unity 3D. We will create a character using Reallusion’s Character Creator 4 and then import that character directly into Unity. Next, we will connect that character to Convai’s AI brain and integrate it into your Unity project.
    Convai Unity Plugin: docs.convai.com/api-docs/plug...
    Reallusion Character Creator 4: www.reallusion.com/character-...
    Reallusion Auto Setup for Unity: www.reallusion.com/auto-setup...
    Tutorial Feedback Form: forms.gle/fMTmnrUfwxHnL2BG9
    Chapters:
    0:00 - Intro
    0:10 - What You Will Learn in this Tutorial
    0:25 - Preparing your character in Reallusion CC4
    0:32 - Setup Facial Profile in Reallusion CC4
    0:53 - Add Animations in Reallusion CC4
    1:44 - Export character from Reallusion CC4
    2:28 - Begin Import of character into Unity
    2:38 - Paste Convai API key into Unity project
    2:59 - Import Reallusion Auto Setup into Unity
    4:31 - Import Reallusion CC4 character into Unity project
    5:18 - Create a new Convai scene
    5:33 - Import Reallusion CC4 character into Convai scene
    6:22 - Paste Character ID from Convai website
    6:40 - Test talking to the Reallusion CC4 character
    6:59 - Create a new Animator in Unity
    7:15 - Import and setup animations from Reallusion CC4
    8:38 - Test animations in Unity
    8:48 - Setup lip sync in Unity
    10:57 - Test lip sync for the Reallusion CC4 character
    11:08 - Adding blinking to the Reallusion CC4 character in Unity
    11:40 - Add head and eye tracking to the Reallusion CC4 character in Unity
    12:20 - Add dancing action to the Reallusion CC4 character in Unity
    13:34 - Add Global Actions Settings to Unity
    14:17 - Final results of Reallusion CC4 character in Unity using Convai
    Follow us on your favorite platforms to stay in touch:
    Discord: / discord
    LinkedIn: / convaitech
    Reddit: / convai
    Twitter: / convaitech
    Instagram: / conv.ai
    Facebook: / convaiofficial
    TikTok: / conv.ai
    ArtStation: www.artstation.com/convai
    CC Attribution:
    "Pleasant Porridge" Kevin MacLeod (incompetech.com) (alterations by Premiere Remix)
    Licensed under Creative Commons: By Attribution 4.0 License
    creativecommons.org/licenses/b...

Комментарии • 28

  • @convai
    @convai  5 месяцев назад +3

    ❗IMPORTANT! At 10:04 in the video, the Blendshape shows "Reallusion Plus" already selected. You must now manually change this option from "OVR" to "Reallusion Plus" in order for the lip sync to work. This was due to a recent Unity update that changed the default settings.

  • @HowTuts
    @HowTuts 7 месяцев назад +5

    This will definitely hlep English learners.
    Can you create similar tutorial using Unreal Engine 5.

    • @convai
      @convai  7 месяцев назад +2

      Please check out our Unreal Engine tutorial here (ruclips.net/video/4A1T2leCZRg/видео.htmlfeature=shared) which covers the same topic. We'll be rolling out new videos covering more actions very soon!

  • @luciddreams1623
    @luciddreams1623 7 месяцев назад

    Great, a re-do of the Unreal Engine 5 video would be highly appreciated !!!! Please do a 10 minute UE5.x tutorial from start to finish, including importing the metahuman, and some blueprint things.. I got it to work previously but now I get stuck again. Love sent, great tech !

    • @convai
      @convai  7 месяцев назад +1

      We will be releasing some updated videos for UE5 soon! Please feel free to join our Discord (discord.com/invite/nN6aEB7jub) for technical help in the meantime.

    • @convai
      @convai  7 месяцев назад

      Hey! Heres is with metahuman ruclips.net/video/HHJvY9dmwwg/видео.html

  • @serjserj7850
    @serjserj7850 6 месяцев назад

    Hi, when I try to create character with api. As a result it creates empty ones with the same icon and with no 3d model. How can I solve it?

  • @AL3DStudio
    @AL3DStudio 3 дня назад

    Hi, found your mistake. At 5:40, you didnt tell us to add a plane as that is not in the default Convai scene I open after installing your plug in. and I asked you a question , I have followed your tutorial exactly and my character is still shooting up in to the air. Not anchored to the floor like yours. Please help, I have been waiting for an answer, on youtube not discord. Please add this information to the tutorial. Please do not ask me to go to discord for answers. I'm watching the video to learn and I have found these faults in the tutorial. So I would respect the anser here or a new tutorial. Thanks

  • @Bininandra
    @Bininandra 5 месяцев назад +1

    Hi, this is great thanks. I cant seem to get the lip sync to work. When I change the tongue to CC_Base_Toungue in Convai lip sync it breaks the animation and does not allow me to play the animation. Any help would be much apprecaited.

    • @convai
      @convai  5 месяцев назад

      Have you made this change? At 10:04 in the video, the Blendshape shows "Reallusion Plus" already selected. You must now manually change this option from "OVR" to "Reallusion Plus" in order for the lip sync to work. This was due to a recent Unity update that changed the default settings.
      If that isn't the issue you are experiencing, please join our discord for help. discord.com/invite/nN6aEB7jub

    • @Bininandra
      @Bininandra 4 месяца назад

      hey@@convai Kaan was very helpful in resolving the issue. It was exactly the Blendshape option that caused the issue. Thanks for the reply

  • @HGBfilmsYT
    @HGBfilmsYT 5 месяцев назад +1

    Hi, after I have imported the prefab in to the convai scene and set up convai npc & collider etc. I go in to play view and the idle animation is working but I have no interaction options/ Ui as it seems you do at 6:40?

    • @metricslab5103
      @metricslab5103 4 месяца назад +1

      I have the same issue @convai I load the plugin but the Convai logo and the text windows aren't in the scene or game view...

    • @convai
      @convai  3 месяца назад

      Hello,
      Please update your Convai plugin from Package Manager. If the problem persists, feel free to join our Discord server and let's solve it together. discord.gg/zmxCXF2bRA

    • @issambenhassine2016
      @issambenhassine2016 3 месяца назад

      same

    • @fedisalhi911
      @fedisalhi911 Месяц назад

      @@metricslab5103 did u solve it ? cause i have the same problem

  • @HyperGalaxyEntertainment
    @HyperGalaxyEntertainment 7 месяцев назад +4

    UE5 please

  • @AnnaKim-yw5ko
    @AnnaKim-yw5ko 7 месяцев назад

    Do i have to input data into the Knowledge Bank for NPC interactions to be possible?

    • @convai
      @convai  4 месяца назад

      Hello Nyla from Convai here! No you don't, you only need a minimal backstory and you get to interactions: docs.convai.com/api-docs/convai-playground/playground-walkthrough The knowledge bank is for you to add factual information or more description of the world and maybe specific information about the character.

  • @rezahasny9036
    @rezahasny9036 День назад

    why my character drowning on the floor

  • @AL3DStudio
    @AL3DStudio 19 дней назад

    My character from Iclone, just shoots up into the air as soon as I push play, I've followed this three times, same result. Any suggestions? Thanks

    • @convai
      @convai  15 дней назад

      Hey! Thanks for your comment.
      Your issue could be related to not adding a rigid-body or it could even be a gravity issue. Reach out to us at support@convai.com for more detais!

    • @AL3DStudio
      @AL3DStudio 3 дня назад

      @@convai PLease don't ask me to go to discord, I asked you the question on this platform, where your video is, I have no interest in going to a spam infected area like discord. Thanks. There are steps you have left out in your video.

  • @imofox6380
    @imofox6380 Месяц назад

    I dont have the same options for the lip sync feature - why could this be?

    • @convai
      @convai  Месяц назад

      Hello,
      We apologize for the inconvenience you have experienced. Please join our Discord server and together we can resolve the issue.
      Invite Link: discord.gg/Tm9b3FWFJG

  • @esmaelvarela6680
    @esmaelvarela6680 26 дней назад

    is it possible to insert character from CC using WEBGL?

    • @convai
      @convai  26 дней назад

      Hello @esmaelvarela6680,
      Thanks a lot for your comment.
      Yes, it is possible. You can use Character Creator characters in Unity WebGL.
      We'd be thrilled to have you join our Convai Discord community.
      discord.gg/Tm9b3FWFJG