How to run an LLM Locally on Ubuntu Linux

Поделиться
HTML-код
  • Опубликовано: 20 авг 2024
  • Here's a step by step guide to running a ChatGPT like LLM on your own machine with Ollama. Includes how to install Ollama on your machine, how to access it with CURL, Python, and how to install a web interface.
    Perfect for beginners to LLMs.
    Instructions from this article:
    www.jeremymorg...
    Ollama website:
    ollama.com/
    Open WebUI:
    github.com/ope...
    NVidia Container Toolkit:
    docs.nvidia.co...
    ---
    Follow me on RUclips: www.youtube.co...
    Yell at me on Twitter: / jeremycmorgan
    Check out my Blog: www.jeremymorg...

Комментарии • 2

  • @dipanwitadutta3008
    @dipanwitadutta3008 Месяц назад

    It is very important to show how to close Ollama Web UI? And will that port will always be occupied? Once I close the browser Tab how to restart everything?

  • @mufeedco
    @mufeedco 2 месяца назад

    Thank you, great guide. How can I configure Oobabooga text-generation-webui with Open WebUI?