Running Ollama in Colab (Free Tier) - Step by Step Tutorial

Поделиться
HTML-код
  • Опубликовано: 13 дек 2024

Комментарии • 9

  • @khlifimohamedrayen1303
    @khlifimohamedrayen1303 Месяц назад +1

    Thank you very much for this tutorial! I was having many problems running the ollama server on colab without the colabxterm... You're such a life saver!

  • @mohamadadhikasuryahaidar7652
    @mohamadadhikasuryahaidar7652 Месяц назад +1

    thanks for the tutorial

  • @VenkatesanVenkat-fd4hg
    @VenkatesanVenkat-fd4hg 3 месяца назад +3

    Great share, insightful share as always...Are u using obs studio for recording....by Senior Data Scientist....

    • @AboniaSojasingarayar
      @AboniaSojasingarayar  3 месяца назад +1

      Glad it helped.
      Not really! Just using the built-in recording and iMovie to edit it.

  • @enia123
    @enia123 2 месяца назад +1

    thank you I was studying something related, but my computer's performance was very poor due to lack of money. I had a problem with ollama not working in Colab, but it was resolved! thank you I would like to test a model created in Colab. Is there a way to temporarily run it as a web service?

    • @AboniaSojasingarayar
      @AboniaSojasingarayar  2 месяца назад +1

      Most welcome.
      Great and glad to hear that finally it worked.
      1. Of course we can use the flask API and ColabCode package to serve your mode via endpoint in ngrok temporary URL.
      github.com/abhishekkrthakur/colabcode
      2. And another way is using flask and flask-ngrok.
      pypi.org/project/flask-ngrok/
      pypi.org/project/Flask-API/
      Sample code for reference:
      from flask import Flask
      from flask_ngrok import run_with_ngrok
      app = Flask(__name__)
      run_with_ngrok(app)
      @app.route("/")
      def home():
      return "Hello World"
      app.run()
      If needed I'll try to do a tuto on this topic in future.
      Hope this helps:)

    • @enia123
      @enia123 2 месяца назад

      @@AboniaSojasingarayar thank you Have a nice day~