Ollama on Kubernetes: ChatGPT for free!

Поделиться
HTML-код
  • Опубликовано: 20 ноя 2024

Комментарии • 16

  • @SteveHarris-mi9ou
    @SteveHarris-mi9ou День назад

    It's a cool setup to use to run a RAG setup locally as well - nice going.

  • @oscarandresdiazmorales7180
    @oscarandresdiazmorales7180 10 дней назад

    Excelente video! Me encantó cómo explicaste el proceso de implementar Ollama en Kubernetes. Gracias por compartir tu conocimiento!

  • @Techonsapevole
    @Techonsapevole 11 дней назад +2

    I use docker compose but i was curious about k8s

  • @zulhilmizainudin
    @zulhilmizainudin 8 дней назад

    Looking forward for the next video!

    • @mathisve
      @mathisve  2 дня назад

      You can find the video here: ruclips.net/video/Yomo2DnL9NA/видео.html

    • @zulhilmizainudin
      @zulhilmizainudin День назад

      @@mathisve thanks!

  • @MuhammadRehanAbbasi-j5w
    @MuhammadRehanAbbasi-j5w 9 дней назад +1

    Would really like the video on how to add a GPU to this, both locally and on the cloud.

    • @mathisve
      @mathisve  8 дней назад +2

      Stay tuned for that video! I'm working on it as we speak, should be out later this week!

  • @HosseinOjvar
    @HosseinOjvar 10 дней назад

    Helpful tutorial
    thank you

  • @samson-olusegun
    @samson-olusegun 12 дней назад +1

    Would using a k8s job to make the pull API call suffice?

    • @mathisve
      @mathisve  11 дней назад +1

      Yes and no! On paper, if you only had one pod this could work. But the API call needs to be made every time a new Ollama pod is scheduled (unless you're using a PVC mounted to the pod to store the model). As far as I'm aware it's not possible to start a Kubernetes job at the creation of a new pod without using an operator.

  • @Sentientforce
    @Sentientforce 11 дней назад

    Can you please advise how to run ollama in k3d cluster in wsl2- windows 11 and docker desktop environment. The issue I’m not able to solve is making gpu visible in a node.

  • @unclesam007
    @unclesam007 5 дней назад

    here i cant deploy a simple laravel app on k8s🤒

    • @mathisve
      @mathisve  День назад

      Do you need help with deploying Laravel on Kubernetes?