Convai
Convai
  • Видео 42
  • Просмотров 365 634
Smart AI NPCs For Virtual Worlds Running in Your Web Browser | Convai Unity WebGL Tutorial
In this video, we’ll guide you step-by-step on how to integrate Convai’s AI characters into an immersive virtual experience running on your web browser, using WebGL builds in Unity. Using Convai, you can integrate AI functionalities into any and all virtual avatars, such as the ones created using platforms like Reallusion, Ready Player Me, Metahuman or even custom avatars. These AI Characters can perform really complex actions and animations, talk to you naturally along with lip sync capabilities, and even perceive their virtual surroundings. Start building your AI games and virtual worlds using Convai today!
Sign up at convai.com to try it out. Also, stay updated with our latest innovatio...
Просмотров: 675

Видео

Make 3D AI Characters Act on Your Command | Scene Aware Characters | Convai Unity Tutorial
Просмотров 1,9 тыс.21 день назад
In this video, we’ll guide you on helping your Convai-powered AI NPCs navigate complex verbal instructions and convert them into natural animations within the Unity Engine. Enhance your virtual world and game development by giving your 3D avatars in Unity the ability to perform intelligent actions with ease, perceive their surroundings, and converse with you naturally. Watch as these AI NPCs fe...
Add AI-powered Conversation Capability to Characters in VR Worlds | Convai Unity VR Tutorial
Просмотров 1,1 тыс.21 день назад
In this tutorial, we'll show you how to incorporate Convai into your VR projects, creating a more immersive and interactive virtual environment, filled with AI characters, for your users. With Convai, all your 3D avatars, such as Reallusion, Metahuman, Ready Player Me, or even Custom Avatars become AI-powered, allowing them to perform complex actions and animations, perceive the VR world around...
Interactive AI Reallusion Characters that Execute your Actions | Convai Unreal Engine Tutorial
Просмотров 1,9 тыс.Месяц назад
In this video, we’ll be guiding you on integrating your @reallusion Characters in Unreal Engine 5 with Convai, to add AI functionalities. Using Convai, your Reallusion Characters in UE5 will perceive their virtual surroundings, perform various complex actions, and even interact with you or other AI NPCs within your virtual world. These characters can be interacted with via voice and text, and h...
AI Characters in Web Browser using ThreeJS and Reallusion Character Creator | Convai 3JS Tutorial
Просмотров 6 тыс.Месяц назад
Convai powers the minds of 3D avatars in virtual worlds. In this video, we’ll be guiding you on integrating Convai’s AI functionalities with a @reallusion Avatar, all on your web browser using Three.js and React. Using Convai, you can effortlessly add complex AI functionalities to your Reallusion character, enabling dynamic natural conversations, scene perception, actions, and various animation...
Bring AI Characters to Multiplayer Worlds | Convai Unreal Engine 5 Multiplayer Tutorial
Просмотров 2,5 тыс.Месяц назад
In this tutorial, we’ll show you how you can add Multiplayer functionalities to your AI Metahuman Characters, Ready Player Me Avatars, Reallusion Characters or even Custom AI Avatars in Unreal Engine 5. Convai enables you to create virtual experiences where players and AI characters seamlessly coexist, communicate, and play together. Create amazing virtual experiences with Convai today! Sign up...
Integrate AI Characters with MetaHuman Avatars in Unreal Engine 5 | Convai Unreal Engine Tutorial
Просмотров 3,9 тыс.Месяц назад
In this tutorial, we’ll show you how you can use Convai to add AI functionalities to Metahuman Characters in Unreal Engine 5. Convai enables these Metahuman AI NPCs to perceive their surroundings, perform complex actions and even talk with you or other AI NPCs within your games and virtual worlds. Create amazing virtual experiences in UE5 with Convai today! Sign up at convai.com to try it out. ...
AI Characters with Custom Avatars in Unreal Engine | Convai Unreal Engine Tutorial
Просмотров 1,4 тыс.Месяц назад
In this video, we’re diving deep into the world of Unreal Engine 5 to show you how to seamlessly integrate your own custom-created avatars with advanced AI functionalities using Convai. Unlike traditional avatar engines like Ready Player Me, Metahuman, and Reallusion, this tutorial focuses on custom avatars you’ve designed from scratch. With Convai, your custom avatars transform into AI NPCs th...
Convai Customer Showcase: Second Life from Linden Lab
Просмотров 1,8 тыс.3 месяца назад
We are excited to announce our partnership with @secondlife. Second Life pioneered Virtual Worlds 20 years ago and is pioneering the use of AI NPCs within such a Virtual World. It is a pleasure working with them and bringing conversational and perceptual characters into this world. You can try it out on Second Life now! Click on the link: maps.secondlife.com/secondlife/Darcys Clubhouse/207/38/2...
Project Neural Nexus: Convai's Cyberpunk World | In Collaboration with @unity
Просмотров 23 тыс.3 месяца назад
Project Neural Nexus is Convai's flagship Unity demo developed by Convai's Creative Director Sakura Rabbit along with Convai's Unity Team. Convai has also collaborated with Unity to leverage Behavior, a prerelease feature from Unity Muse, Unity’s AI-powered platform for accelerating real-time 3D and game development. Convai is leveraging Muse’s Behavior feature to augment its perception and act...
Converse, Connect, Convai: Breathing Life into NPCs with Human-Like AI Intelligence
Просмотров 5 тыс.3 месяца назад
In this video, Purnendu Mukherjee, Founder and CEO of Convai shares customer stories, announces New Features and a Tech Demo in collaboration with Unity. Chapters: 00:00 Intro 00:40 What's Convai 02:21 Second Life 06:10 Stormgate 09:17 Carbonated 11:29 War of the Worlds tech demo 12:31 Widow Games 13:13 Insterstate Cowboys 13:31 FBR 14:33 Digimans.ai, Kokutouchichi, PlayerZRO, egemenart, Single...
Location-aware AI characters in Augmented Reality (AR) | Convai Unity Tutorial
Просмотров 5 тыс.4 месяца назад
In this structured guide, we'll show you how you can integrate Convai-powered AI NPCs for an immersive augmented reality (AR) experience! This guide will help you bring your characters to life with AI, enabling natural conversations and interactions. AI NPCs in an Augmented Reality app can be connected with real-world location-aware knowledge, AR games and so much more. Use it for augmented rea...
Convai and Nvidia partner to take AI NPCs to the next level
Просмотров 10 тыс.5 месяцев назад
At Nvidia's special livestream at CES2024, Convai is releasing its latest features of Scene Perception and Action Generation. Convai and Nvidia continue their collaboration to evolve the Kairos demo with the latest Convai and ACE releases. Convai integrated ACE modules Audio2face and Riva ASR for this demo. Follow us on your favorite platforms to stay in touch: Discord: discord.gg/UgxHwne4Vn Li...
AI NPCs Take Action from Conversation | Environment and Object Aware Characters | Convai UE Tutorial
Просмотров 10 тыс.5 месяцев назад
Characters feel life-like if conversations have consequences involving not only verbal responses but also behaviors and actions. This may include interacting with the environment or other characters. Convai’s NPCs can navigate complex verbal instructions and convert them to natural actions in the game engine. For example, characters can perform complex actions such as fetching items, following ...
AI NPCs Talking With Each Other | Convai Unreal Engine NPC to NPC tutorial
Просмотров 8 тыс.5 месяцев назад
Characters in game worlds powered by Convai can chat with each other, share ideas, and even get another NPC to carry out actions. This tutorial showcases how you can add simple blueprints to add this functionality and even provide topics that these characters will talk about. More updates on this feature will be coming out soon along with integrations for Unity and ThreeJS. Here is the download...
Game Jam Results for Convai x AI and Games Game Jam 2023
Просмотров 6886 месяцев назад
Game Jam Results for Convai x AI and Games Game Jam 2023
Creating Lifelike NPCs in Unity with Reallusion CC4 Characters | Convai Unity Tutorial
Просмотров 7 тыс.7 месяцев назад
Creating Lifelike NPCs in Unity with Reallusion CC4 Characters | Convai Unity Tutorial
Convai Game Jam 2023 - In collaboration with AI and Games
Просмотров 2,2 тыс.9 месяцев назад
Convai Game Jam 2023 - In collaboration with AI and Games
Interactive 3D virtual worlds with AI Characters on Your Browser | Convai ThreeJS Tutorial
Просмотров 3,6 тыс.9 месяцев назад
Interactive 3D virtual worlds with AI Characters on Your Browser | Convai ThreeJS Tutorial
AI NPC Takes the Nvidia ACE and Omniverse Team on a Virtual Tour
Просмотров 3,7 тыс.10 месяцев назад
AI NPC Takes the Nvidia ACE and Omniverse Team on a Virtual Tour
Convai Development pipeline and Beta Features | Livestream with Nvidia Supercut
Просмотров 3,2 тыс.10 месяцев назад
Convai Development pipeline and Beta Features | Livestream with Nvidia Supercut
Creating Talking AI Characters in VR and Android | Convai Unreal Engine Tutorial
Просмотров 10 тыс.10 месяцев назад
Creating Talking AI Characters in VR and Android | Convai Unreal Engine Tutorial
AI NPCs are the future of video games - Jensen Huang | Nvidia Convai partnership
Просмотров 7 тыс.Год назад
AI NPCs are the future of video games - Jensen Huang | Nvidia Convai partnership
Interact with AI Characters in 3D from your Browser with Convai's JavaScript SDK
Просмотров 5 тыс.Год назад
Interact with AI Characters in 3D from your Browser with Convai's JavaScript SDK
Adding ReadyPlayerMe Characters and Custom Animations | Convai Unity Plugin Tutorial [Part 2]
Просмотров 5 тыс.Год назад
Adding ReadyPlayerMe Characters and Custom Animations | Convai Unity Plugin Tutorial [Part 2]
How to Add Custom Characters and Animations with Convai Extension in Omniverse
Просмотров 2,5 тыс.Год назад
How to Add Custom Characters and Animations with Convai Extension in Omniverse
Add AI Characters to your Virtual Worlds in Nvidia Omniverse | Convai Omniverse Extension Setup
Просмотров 5 тыс.Год назад
Add AI Characters to your Virtual Worlds in Nvidia Omniverse | Convai Omniverse Extension Setup
Create AI Characters in Unity | Convai Plugin Setup Tutorial [Part 1]
Просмотров 33 тыс.Год назад
Create AI Characters in Unity | Convai Plugin Setup Tutorial [Part 1]
Add Unlimited Knowledge To Make Your Character An Expert | Convai Knowledge Bank
Просмотров 6 тыс.Год назад
Add Unlimited Knowledge To Make Your Character An Expert | Convai Knowledge Bank
Add Live Transcriptions and Events for AI NPCs in Unreal Engine | Convai UE Tutorial [Part 2]
Просмотров 6 тыс.Год назад
Add Live Transcriptions and Events for AI NPCs in Unreal Engine | Convai UE Tutorial [Part 2]

Комментарии

  • @rulg001
    @rulg001 2 часа назад

    Hey that's really cooool, is it possible to do the same with ue5?

  • @aasurjya
    @aasurjya 8 часов назад

    Awesome, Great Job. The works flow is time saving.

  • @LivioAscione
    @LivioAscione 19 часов назад

    As soon as I run the convai game mode and try to send a message (vocal or text) ue5 crashes on Mac OS. Maybe a problem with mic permissions?

  • @josepharnone2861
    @josepharnone2861 21 час назад

    it's great but I would like a widjet to appear when I ask for it, is there a tutorial for that?

  • @AL3DStudio
    @AL3DStudio День назад

    Hi, found your mistake. At 5:40, you didnt tell us to add a plane as that is not in the default Convai scene I open after installing your plug in. and I asked you a question , I have followed your tutorial exactly and my character is still shooting up in to the air. Not anchored to the floor like yours. Please help, I have been waiting for an answer, on youtube not discord. Please add this information to the tutorial. Please do not ask me to go to discord for answers. I'm watching the video to learn and I have found these faults in the tutorial. So I would respect the anser here or a new tutorial. Thanks

  • @sridharansivacoumar9549
    @sridharansivacoumar9549 День назад

    Will Convai work in Hololens?

  • @sridharansivacoumar9549
    @sridharansivacoumar9549 День назад

    Will Convai work in Hololens?

  • @sridharansivacoumar9549
    @sridharansivacoumar9549 День назад

    Will Convai work in Hololens?

  • @sridharansivacoumar9549
    @sridharansivacoumar9549 2 дня назад

    Can't import the character with a free account?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Can we ask this AI characters to load custom animation which we created in Unity? like show me the 3D model or play me this video like that?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Can we ask this AI characters to load custom animation which we created in Unity? like show me the 3D model or play me this video like that?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Can we ask this AI characters to load custom animation which we created in Unity? like show me the 3D model or play me this video like that?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Can we ask this AI characters to load custom animation which we created in Unity? like show me the 3D model or play me this video like that?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Is this available for HoloLens 2.0 with Unity?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Is this available for HoloLens 2.0 with Unity?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Is this available for HoloLens 2.0 with Unity?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Is this available for HoloLens 2.0 with Unity?

  • @isaacjimmanuel6289
    @isaacjimmanuel6289 2 дня назад

    Does Convai works on Hololens 2?

  • @SethTodd-rl6hr
    @SethTodd-rl6hr 3 дня назад

    I have been trying to get a working MetaHuman with ConvAi in UE 5.3, but with VR. Firstly, I notice that the text box does not appear in the view inside VR (Vive Focus 3). The convai chatbot can respond to input, but the input doesn't show up. Any idea why this might be?

  • @user-co1yg1bv5h
    @user-co1yg1bv5h 4 дня назад

    I have a question, I’m trying to make a police style simulator in vr and I was wondering if its possible to have animals like a police k9 where you can give verbal commands without the k9 saying anything or just barks

  • @itsallaboutkyoke
    @itsallaboutkyoke 4 дня назад

    So cool! You guys are definitely the future of games..

  • @christopherrozas2413
    @christopherrozas2413 6 дней назад

    Excelente Convai !!

    • @convai
      @convai 6 дней назад

      Thanks for your comment! We are glad you liked the video :)

  • @MrBastos2010
    @MrBastos2010 6 дней назад

    when you make a tutorial for VR on UE5?

  • @MrBastos2010
    @MrBastos2010 6 дней назад

    Is it possible to use another language besides English?

    • @convai
      @convai 6 дней назад

      You can select a language for your AI NPC from a wide variety of options that are available on the Convai Playground. Happy development!

  • @Dannyabsable
    @Dannyabsable 7 дней назад

    This is very cool - thanks for your hard work on this

    • @convai
      @convai 6 дней назад

      Hey, thanks for your comment! We are glad you liked this video. Be sure to check out our other videos, and subscribe for more helpful content! :)

  • @aneeslubanatamboli5102
    @aneeslubanatamboli5102 7 дней назад

    Hey I have Imported my character to the scene but it does not talk

    • @convai
      @convai 7 дней назад

      Hello! Could you please join our Discord server so that we can investigate and resolve the issue together? Invite Link: discord.gg/Tm9b3FWFJG

  • @mayoutoobid
    @mayoutoobid 7 дней назад

    Would the AI NPC be able to talk offline? Like in a single player game?

    • @convai
      @convai 7 дней назад

      Hey! Thanks for your comment. As of now, the responses are generated via servers. For this, a stable internet connection is required.

  • @RizwanTheWizard
    @RizwanTheWizard 8 дней назад

    Thank you Convai team and the hard work you do! Please make more of these tutorials! Ill watch all of them!

    • @convai
      @convai 7 дней назад

      Hey! We are glad you like the tutorials. Happy development! :)

  • @mattbeets
    @mattbeets 8 дней назад

    If you can't find SpawnActor Convai NPC2NPC MGR in the blueprint, just make SpawnActor from Class, and change the class to NPC2NPC MGR (for N00bs like me) :)

  • @twjohnsontsai
    @twjohnsontsai 11 дней назад

    Hello, after setting up the Metahuman character, in the game, his eyes always wander and cannot focus on the other person. How can I fix this?

  • @frunobontes
    @frunobontes 13 дней назад

    Are the actions not functional on 5.4? I cannot make it move or follow me.

    • @convai
      @convai 13 дней назад

      Hey! Thanks for your comment. Actions are definitely functional on UE 5.4. You can check out our detailed tutorial on AI NPC actions to learn more: ruclips.net/video/phAkEFa6Thc/видео.html

  • @insomniac7532
    @insomniac7532 14 дней назад

    well done! can this be modified to work for web AR projects as well or not yet?

  • @togglesofficial
    @togglesofficial 15 дней назад

    I cant interact with my character with mic. is there anything I have to set up ?! Please let me know. thank you.

    • @convai
      @convai 13 дней назад

      Hi @togglesofficial, there could be an issue with the default microphone, make sure that you have chosen the correct default microphone in the Windows settings. Additionally, there could be another issue blocking the interaction, so make sure to check the logs or share with us on our email support@convai.com

  • @mattbeets
    @mattbeets 16 дней назад

    As a total n00b in this, I thought I was going crazy because my ConvaiBaseCharacter's edit blueprint looked nothing like what's shown on the screen @3:04. But somehow I missed that I had to click on "event graph" (Graphs section on (my) left part of the screen) under graphs inside the edit screen. Just if anyone else was confused like I was :)

    • @mattbeets
      @mattbeets 16 дней назад

      Maybe also worth mentioning that using ElevenLabs voices currently requires first a subscription of 6 or 9$/month for Convai, and also a 99$/month subscription to ElevenLabs

  • @AL3DStudio
    @AL3DStudio 17 дней назад

    My character from Iclone, just shoots up into the air as soon as I push play, I've followed this three times, same result. Any suggestions? Thanks

    • @convai
      @convai 13 дней назад

      Hey! Thanks for your comment. Your issue could be related to not adding a rigid-body or it could even be a gravity issue. Reach out to us at support@convai.com for more detais!

    • @AL3DStudio
      @AL3DStudio День назад

      @@convai PLease don't ask me to go to discord, I asked you the question on this platform, where your video is, I have no interest in going to a spam infected area like discord. Thanks. There are steps you have left out in your video.

  • @AL3DStudio
    @AL3DStudio 19 дней назад

    Awesome!!

    • @convai
      @convai 13 дней назад

      We're glad you like it!

    • @AL3DStudio
      @AL3DStudio 13 дней назад

      @@convai but I do have problems with my avatar being too small and too far away but the best part about the video was you were in the street with Google Maps working that’s what I wanted to say. Can you please do a tutorial and show that right to the end where it’s working like you had it in the video? Thank you.

  • @TheBigLooseGoose
    @TheBigLooseGoose 20 дней назад

    unreal engine support?

    • @convai
      @convai 13 дней назад

      Hey! Thanks for your comment. Check out our Unreal Engine tutorial on adding NPC actions here: ruclips.net/video/phAkEFa6Thc/видео.html

  • @schmutz06
    @schmutz06 20 дней назад

    nice work! i spent a while playing with this earlier with metahuman, in Unreal 5.4.2 (latest stable). I couldn't get the face sync to work unfortunately. I am certain the correct anim class is set to the face, and I have the ConvaiFaceSync component in the stack (tried it in all hierarchies; under ConvaiChatbot, under Root, under face). I was unable to get the navmesh / follow action to work either. The character responded but did nothing. It would turn and face me half the time, and otherwise only look forward. After around 1 hour of starting out, I hit the usage limit. Is it possible to use Ollama / Llama3 local with this to avoid the limit by running all the generative parts locally?

    • @SethTodd-rl6hr
      @SethTodd-rl6hr 3 дня назад

      I am also trying to get a ConvAI metahuman operable, but in 5.3 . Mine also agrees to do some action, like move, but then never does it. Object specified in the details panel so not sure what the issue is.

  • @Buy_YT_Views_641
    @Buy_YT_Views_641 20 дней назад

    The choice of framing in certain shots adds a cinematic quality to the video. It's like watching a beautifully composed visual poem.

    • @convai
      @convai 13 дней назад

      Hey! Thanks for your comment. Glad you liked it!

  • @AL3DStudio
    @AL3DStudio 20 дней назад

    terrible transitions between motions, clunky. That needs work, you need to use much better mocap.

  • @funfz_
    @funfz_ 20 дней назад

    @sakura 🌸 it’s nice to see your work!!! ❤ exciting project

    • @convai
      @convai 13 дней назад

      Thanks for your comment!

  • @unkillablespirits8582
    @unkillablespirits8582 20 дней назад

    omg this is so awesome i cant wait to get mines working

    • @convai
      @convai 13 дней назад

      Hey! Thanks for commenting, and happy development :)

  • @lgtwzrd
    @lgtwzrd 20 дней назад

    As a 3D animator and interactive app developer, I'd really love to see more emotion coming out of those characters. when they talk. Right now they are really stiff, like a person who really can't act, and just reading a teleprompter. There have to be varied facial expressions triggered when certain words pop up, to show happiness, excitement, worry, fear etc. Same goes for the voice inflections that need to be more sophisticated as they follow the meaning of what is said, again to avoid making the character look like they are reading a teleprompter. Not to mention, there needs to be pauses for thought, and eye gazing that shows that kind of thought process instead of that dead eye stare looking at the camera the entire time. Details like that would really give you guys an edge over other companies offering similar solutions.

  • @lgtwzrd
    @lgtwzrd 20 дней назад

    Open ended is nice and all, but it still needs to be confined within the context of the game, or otherwise you break the game immersion. And in that case, how hard is it to define the context, so that the conversation can still sound open ended and less old style NPC?

  • @zhengdonghou178
    @zhengdonghou178 20 дней назад

    It would be better if this is implemented in UE5. I look forward to the relevant tutorials.

    • @convai
      @convai 20 дней назад

      Hello! Thanks for your comment. We have a detailed tutorial on setting AI NPC actions for Unreal Engine projects. You can check it out here: ruclips.net/video/phAkEFa6Thc/видео.html

  • @bobhawkey3783
    @bobhawkey3783 21 день назад

    Don't forget to set the foot IK for animations to checked. This will make them look more grounded when moving.

  • @N1thium
    @N1thium 21 день назад

    I belive those tutorials needs a update

    • @convai
      @convai 13 дней назад

      Hey! Thanks for your suggestion. Please be on the lookout for our new upcoming Unity tutorials, and also read our documentation page to help with setting up your AI Unity projects: docs.convai.com/api-docs/plugins-and-integrations/unity-plugin

  • @aaronjaggars321
    @aaronjaggars321 21 день назад

    Can we import .fbx character files

    • @convai
      @convai 20 дней назад

      Hey! Thanks for your comment. Yes you can import .fbx files; check out this documentation for more details: docs.pmnd.rs/react-three-fiber/tutorials/loading-models#loading-fbx-models We suggest to convert it to .glb using blender to resolve any orientation issues that might occur.

  • @monsieurmarois
    @monsieurmarois 21 день назад

    This is awesome, my NPC can now dance on command. However, since I'm using UE 5.4 I don't have the Convai_Metahuman_Body_Animation and can't finish the tutorial. Anyway I can get around this? Thanks!!!

  • @lucio667
    @lucio667 22 дня назад

    is it possible to use it with oculus ovr instead of openxr?

    • @convai
      @convai 21 день назад

      Hello @lucio667, Yes, you can, but you will need to make a few adjustments. If you'd like, you can join our Discord server, and our Unity team will assist you with that. We'd be thrilled to have you join our Convai Discord community. discord.gg/Tm9b3FWFJG