ChatterUI: Run LLM on Your Phone, Even Offline!

Поделиться
HTML-код
  • Опубликовано: 3 фев 2025

Комментарии • 19

  • @sujonislam-g4f
    @sujonislam-g4f 20 дней назад

    Good man

  • @neuralfalcon
    @neuralfalcon  3 месяца назад +1

    05:20 llama 3.2 gave the wrong answer Factorial of 5.
    06:07 Factorial of 5 is 120

  • @Rightpath-dr7ys
    @Rightpath-dr7ys 2 месяца назад +1

    Plz make video on how can setup alltak tts software on pc in simple method

  • @The_oli4
    @The_oli4 Месяц назад

    I did the exact steps but it just gives random characters as an output, with the model you used

    • @neuralfalcon
      @neuralfalcon  Месяц назад +1

      It may be a ChatterUI app problem or a low memory issue. I don't know the exact reason because I only spent 40 minutes on the app. Report the issue here: github.com/Vali-98/ChatterUI/issues

  • @Rightpath-dr7ys
    @Rightpath-dr7ys 2 месяца назад +1

    Make a video for free voice cloning software in pc in all languages hindi also plz help mein

    • @neuralfalcon
      @neuralfalcon  2 месяца назад

      For Hindi only xtts v2 and rvc voice cloning available or go for eleven Labs. There are many websites but all paid or credit system.

    • @neuralfalcon
      @neuralfalcon  2 месяца назад

      My NVIDIA GTX 1650 has only 4GB of VRAM, which limits my ability to run most models on my local PC.

    • @Rightpath-dr7ys
      @Rightpath-dr7ys 2 месяца назад

      @neuralfalcon plz make video for long text voice cloning software for free in many languages like hindi

  • @ManananggalNaStroke-x5w
    @ManananggalNaStroke-x5w Месяц назад

    🤦that dam app is insane it keeps blabbering unnecessary stop or did i do wrong? why cant the developer fix its default even tho the model is decent but the app is not it will still not work properly

    • @ManananggalNaStroke-x5w
      @ManananggalNaStroke-x5w Месяц назад

      the model is from openai and it works properly on other offline ai but everytime i import a model here it all ends up in a mental hospital 🙄

    • @neuralfalcon
      @neuralfalcon  Месяц назад

      ​@@ManananggalNaStroke-x5w LOL, can you tell me the names of those models so I can try them on my phone? That way, I can be sure it's the app causing the problem .

    • @ManananggalNaStroke-x5w
      @ManananggalNaStroke-x5w Месяц назад

      @@neuralfalcon I don't think I can post a link here. Sys will probably delete my comment before it can reach anyone. So yeah, the names... just the names. This one ChatGPT-2.V2.Q4_K_S works on Layla Lite, but it sometimes breaks for unknown reasons, and Layla is a slow app, so I ditched that and hugged PocketPal, which made me satisfied. But, I didn't give up on ChatterUI, so I tried trial and error, and finally, I could run Llama 3.2 3B without it going insane. It was actually the template's fault. So yeah, maybe if you could please provide the right template for GPT-2? And for this one gpt2.Q8_0, I could not get it to work with any app, maybe just ChatterUI and PocketPal. I’d skip LaylaLite because it was so slow. No wonder the icon looks like a caterpillar.

    • @ManananggalNaStroke-x5w
      @ManananggalNaStroke-x5w Месяц назад +1

      @@neuralfalcon ChatGPT-2.V2.Q4_K_S gpt2.Q8_0 and just like that it got deleted maybe i should just not include proper grammar at all 🤦 yt is indeed too harsh with its users when it comes to comments it keeps deleting this and that 😡

    • @ManananggalNaStroke-x5w
      @ManananggalNaStroke-x5w Месяц назад

      @@neuralfalcon since yt delete my first reply i want to tell you again that this chatgpt-2 works on layla app while the 2nd gpt2 do not therr is actually 4 apps 1 is untested can be found in playstore the other is also in playstore which is layla and pocketpal ...pocketpal and chatterui can be found in github