Chat with your Documents Privately with Local AI using Ollama and AnythingLLM

Поделиться
HTML-код
  • Опубликовано: 30 сен 2024

Комментарии • 10

  • @VincentCodesFinance
    @VincentCodesFinance  4 месяца назад

    👍 Please like if you found this video helpful, and subscribe to stay updated with my latest tutorials. 🔔
    ❤ You can support this channel by buying me a ☕: buymeacoffee.com/codesfinance

  • @drkvaladao776
    @drkvaladao776 4 месяца назад +2

    Very nice, easy to follow and set up even if you are not a programer like me, I'm using it with Llama 3 at the moment. Subscribed for more content like this.

  • @Alex29196
    @Alex29196 4 месяца назад +1

    AnythingLLM won't be able to outperform any local inference UI, lacking voice output like Ollama web UI and others, plus inference runs much slower than Msty, ollama CLI and LMstudio.

    • @VincentCodesFinance
      @VincentCodesFinance  4 месяца назад

      I agree that the UI is inferior to pretty much all the other ones I tried. As for inference speed, I configured it to use my local Ollama installation, so the speed is the same. The one use case where I found AnythingLLM better than WebUI is for document search (Msty doesn't have it yet). I haven't tried LMstudio yet but it's high on my list.

    • @Alex29196
      @Alex29196 4 месяца назад

      @@VincentCodesFinance Try Msty inferece spped is really fast, i run a low en laptop, with 4g vram 16gb ram. Hope it helps

  • @englishmimics
    @englishmimics 4 месяца назад

    Thank you so much Vincent for taking the time to create and share that amazing video with us. Your effort is truly appreciated.

  • @englishmimics
    @englishmimics 4 месяца назад

    Vincent, I've seen all your tutorials on ChatGPT-like clones, but I'm still unsure which one to install on my computer! Could you please advise me on which one you recommend, considering I'm not a coding pro? I just want to avoid any unnecessary headaches!

    • @VincentCodesFinance
      @VincentCodesFinance  4 месяца назад

      So far the easiest to install and use is Msty. However, it does not super documents (yet), it is just a pure chat for now.