Ep.4: LLM Chatbot (AI NPC) with a MetaHuman in Unreal Engine 5

MetaHuman in Unreal Engine 5 using a local LLM that also features function calling. Uses the same protocol as OpenAI, therefore compatible with most LLM models out there.
Features:
Real-time Text-to-Speech and Speech Recognition.
Realistic voices.
Can run offline.
Can potentially use any LLM model
No subscription required.
Works on most GPUs
Previous episodes:
Ep.1: • Ep.1: Unreal Engine 5 ...
Ep.2: • Ep.2: Real-Time Facial...
Ep.3: • Ep.3: Real-Time Text-t...

[@clatson]

Can we expect a tutorial for this video? I really want to do it.

[@ThatNerdChris]

Aw, why'd you stop?

[@JOSHUAAGNELW21EC]

sir can you share us the tutorial how you integrated the chatbot

[@evolutionaer2161]

Very nice tutorials. THX!

[@ortohben9304]

Samir u did a nice job

[@thisisriil]

Hello sir, I would like to implemented this feauture in our own apps. Is there anyway that we can contact you for further discussion?

[@hyperind6290]

Please tell me how to get auto hand animations with livelink app in UE5 for metahumans

[@AccentStudio]

Fantastic work! Any news on releasing that software? I know you said you wanted to include more stuff in it first, but honestly I just need the webcam facial/body mocap stuff, no need for the text to speech in my case, if it works I would buy it as is and pay good money for that! Also even If you think it needs more polish work before being commercially ready I would gladly help alpha test it and give you feedback, please reply!

[@SamirManar]

Appreciate your feedback. Thank you. Can you PM me?

[@MrBetyko]

Nice one ! I'm looking todo exactly the same. Do you provide any project or plugin.

[@LeslieChew]

Sir, do you have a github link for this? I will like to try my hand at it. Thank you.

[@LorandNagy_89]

What about calling a function to move and build and see internal and external camera :D

[@Kanermi]

sir we need a tutorial