Ollama Web UI (ChatGPT-ish) - Local AI FTW!!!
HTML-код
- Опубликовано: 10 сен 2024
- Ollama Web UI: A User-Friendly Web Interface for Chat Interactions. ChatGPT-Style Web Interface for Ollama 🦙
My Ollama Tutorial - • Ollama on CPU and Priv...
Features ⭐
🖥️ Intuitive Interface: Our chat interface takes inspiration from ChatGPT, ensuring a user-friendly experience.
📱 Responsive Design: Enjoy a seamless experience on both desktop and mobile devices.
⚡ Swift Responsiveness: Enjoy fast and responsive performance.
🚀 Effortless Setup: Install seamlessly using Docker for a hassle-free experience.
💻 Code Syntax Highlighting: Enjoy enhanced code readability with our syntax highlighting feature.
✒️🔢 Full Markdown and LaTeX Support: Elevate your LLM experience with comprehensive Markdown and LaTeX capabilities for enriched interaction.
📥🗑️ Download/Delete Models: Easily download or remove models directly from the web UI.
🤖 Multiple Model Support: Seamlessly switch between different chat models for diverse interactions.
⚙️ Many Models Conversations: Effortlessly engage with various models simultaneously, harnessing their unique strengths for optimal responses. Enhance your experience by leveraging a diverse set of models in parallel.
🤝 OpenAI Model Integration: Seamlessly utilize OpenAI models alongside Ollama models for a versatile conversational experience.
🔄 Regeneration History Access: Easily revisit and explore your entire regeneration history.
📜 Chat History: Effortlessly access and manage your conversation history.
📤📥 Import/Export Chat History: Seamlessly move your chat data in and out of the platform.
🗣️ Voice Input Support: Engage with your model through voice interactions; enjoy the convenience of talking to your model directly. Additionally, explore the option for sending voice input automatically after 3 seconds of silence for a streamlined experience.
⚙️ Fine-Tuned Control with Advanced Parameters: Gain a deeper level of control by adjusting parameters such as temperature and defining your system prompts to tailor the conversation to your specific preferences and needs.
🔐 Auth Header Support: Effortlessly enhance security by adding Authorization headers to Ollama requests directly from the web UI settings, ensuring access to secured Ollama servers.
🔗 External Ollama Server Connection: Seamlessly link to an external Ollama server hosted on a different address by configuring the environment variable during the Docker build phase. Additionally, you can also set the external server connection URL from the web UI post-build.
🔒 Backend Reverse Proxy Support: Strengthen security by enabling direct communication between Ollama Web UI backend and Ollama, eliminating the need to expose Ollama over LAN.
🔗 Links 🔗
Ollama Web UI - github.com/oll...
Download Ollama here - ollama.ai/
Ollama Model library - ollama.ai/libr...
❤️ If you want to support the channel ❤️
Support here:
Patreon - / 1littlecoder
Ko-Fi - ko-fi.com/1lit...
🧭 Follow me on 🧭
Twitter - / 1littlecoder
Linkedin - / amrrs 
Наука
This is Amazing! Thanks Not only that I learned about ollama but also this very neat web-ui, Runs extremely well on my MBPro M2 with 32GB of mem (Mistral)
Glad it helped! Really happy 😊
No s*** it runs well on MacBook M2 pro, with 32GB ram hahaha :) Sorry, had to say this. Congrats
Any difference between lm studio and this?
bye bye ChatGPT! Great stuff. 🙂
how can i speed up ollama general response generation ? im using a model wich takes ages to generate a response
When I open the web UI along with my local LLM Lllama 2, I can see GPT-4 and GPT-4o in the choose LLM dropdown. Do you know what is causing this?
Can run it with my pdf and offline
Or you have video for run it offline with pdf
ollama-webui works really well, do you know how to integrare RAG function calling with it?
create a master ai that will manage tasks to smaller ai, such as text to speech, speech to text, text to text, translator ai and a few others, to do this in very simple terms you need to set up several independent ai and then add them an ai so they can communicate with each other.
can i modify logos and the background in the docker itself? If yes then pls tell, if no then how could i build frontend pls guide me
a little late to this one, mainly cause I'd given up on these local web ui options... but this is incredibly well done!
Try this once as well - ruclips.net/video/hX8pt_drIck/видео.html
Does it do anything better? Like does it do better quantisation for speedup? Whats the inference time? Better?
hey, Answer this. what type of models are generally better for rag / agent systems? base model, chat model or instruct model. Maybe they are same, i am asking , i don't know.
. i did not watch the video. will do while eating.
This video goes through some of the items - ruclips.net/video/Ce0OKpMhvXw/видео.html
Generally if i were to do RAG or Agent today, I'd start with Mistral!
i get the error on my root server there is no ollama installed but if it try ollama run openhermes in terminal its work
I think a mixture of OpenAI Chat and Playground features would be great also in this Web UI, so we'd be able to use system prompt presets and settings like temp on thread level, which I think is a must.
Is there an interface that is like playground from open ai?
the docker command does not work it tells me it has been deprecated
Can I connect this with N8n and api?
Thanks for posting!
Thanks for your video! I always get this error: Connection Issue or Update Needed
Oops! It seems like your Ollama needs a little attention.
We've detected either a connection hiccup or observed that you're using an older version. Ensure you're on the latest Ollama version
(version 0.1.16 or higher) or check your connection.
Can I build a chatbot using ollama?
Could you make a video on where the login page is at in ollama web ui, I want to make it to my liking
Please elaborate your request
Is it possible to use our own fine-tuned models with ollama and it's webui?
Yes you can use it. It can be defined in the model card . ruclips.net/video/C0GmAmyhVxM/видео.htmlsi=TMGdUYElCoApN4yi
Dear 1littlecoder❤ would you please so kind to cover how to plug my own GGUF files into ollama?
This would have it covered ruclips.net/video/C0GmAmyhVxM/видео.html
Thanks bro
this is so cool
can this ollama be used as api? i.e. I want to use responses with python to be used in agents.
Yes
ruclips.net/video/C0GmAmyhVxM/видео.htmlsi=7nlvt7P67GLDPg5c
Thank you bro, can we integrate it in kali linux using shell gpt?
haha you beat me to it
Lmao, I just gave a thanks, and youtube removed my comment.
@1littlecoder I hope the amount is not removed too :)
What's strange is that I already had replied to it as well and yet the comment was gone 😭
F docker. Let's install things like real Men on bare metal.