Tim Carambat
Tim Carambat
  • Видео 48
  • Просмотров 834 798
Create fine-tuned models with NO-CODE for Ollama & LMStudio!
👋 Hey everyone,
Back with a new video highlighting a super cool feature that we just added into AnythingLLM where you can create a full fine-tuned model from your chats and documents and run that **locally** with Ollama and LMStudio - no privacy issues or vendor lock-in. At AnythingLLM we believe models trained from your data are your models - we don't gatekeep this technology or restrict you to a single provider.
**This is not a local service** If you want to fine-tune a model locally you can export your data directly from AnythingLLM and do this yourself. A locally running no-code trainer video will be coming soon - subscribe to get notified!
Downloading AnythingLLM: anythingllm.com/downlo...
Просмотров: 28 164

Видео

Unlimited AI Agents running locally with Ollama & AnythingLLM
Просмотров 127 тыс.4 месяца назад
Hey everyone, Recently in AnythingLLM Desktop, we merged in AI Agents. AI Agents are basically LLMs that do something instead of just replying. We support both tool-call-enabled models like OpenAI but have even now have a no-code way to bring AI agents to every open-source LLMs like with Ollama or LMStudio. Now, with no code required, you can take any LLM and get automatic web scraping, web-bro...
Stop paying for ChatGPT with these two tools | LMStudio x AnythingLLM
Просмотров 260 тыс.6 месяцев назад
In this video, we are installing two user-friendly tools that make downloading, running, and managing a powerful local LLM to replace ChatGPT. Seriously. Today, with only a desktop computer with a retail GPU, and two free applications you will get a fully private Local LLM RAG chatbot running in less than 5 minutes! This is no joke - the teams at LM Studio and AnythingLLM are now fully integrat...
Unleash the power of Local LLM's with Ollama x AnythingLLM
Просмотров 118 тыс.6 месяцев назад
Running local LLMS for inferencing, character building, private chats, or just custom documents has been all the rage, but it isn't easy for the layperson. Today, with only a single laptop, no GPU, and two free applications you can get a fully private Local LLM RAG chatbot running in less than 5 minutes! This is no joke - the teams at Ollama and AnythingLLM are now fully compatible, meaning tha...
Custom AI Chatbot for Websites using any LLM | No-Code | Open-Source
Просмотров 12 тыс.6 месяцев назад
In a world of pay-per-token LLMs you probably have looked everywhere to get your Local or Cloud-hosted LLM model to act like an AI assistant on your website - well now with AnythingLLM it is free and open source! Today, we are going to create an AI chatbot for our website trained on the data from our own website! All of this is built into the AnythingLLM cloud or our self-hosted version you can...
🔐 Deploy a PRIVATE Chroma vector database on Render.com | tutorial
Просмотров 1,5 тыс.9 месяцев назад
Hey everyone, In Discord & RUclips, I have seen a ton of people looking for an even easier option for deploying Chroma on more "user-friendly" server instance providers like Render.com Render is like AWS, but if they cared about their customers. I am a customer of Render and that simplicity and ease of use comes at a cost! This deployment of Chroma (v0.4.18) is super easy but it will cost you a...
🚀 Deploy a PRIVATE Chroma Vector DB to AWS | Step by step 🚀
Просмотров 3,3 тыс.9 месяцев назад
Cloudformation template: s3.us-west-1.amazonaws.com/public.mintplexlabs.com/chromadb-with-api-key.json Script to reboot Docker: gist.github.com/timothycarambat/754969f00b9815459153ff4f66a5910f Hey there! This is the second video in a three-part series on how to launch Chroma (trychroma.com) and have it be fully private with no unauthorized access so you can store your vectors without worrying a...
How to run a private Chroma Vector Database locally in 5 mins!
Просмотров 22 тыс.9 месяцев назад
Hey everyone, I wanted to take some time to show how simple it is to get Chroma (trychroma.com), an open-source vector database, to run locally on your machine so you can use it with AnythingLLM (github.com/Mintplex-Labs/anything-llm) or other popular services as well as even secure the data between updates and use API key authentication! Watch the AWS or Render videos for how to take these sam...
AnythingLLM | How to get a Private Uncensored ChatGPT using Mistral-7B, LLama2, & more
Просмотров 10 тыс.10 месяцев назад
Another update is hot off the press for AnythingLLM, a fully open-source and private ChatGPT equilivant software you can use. Now, we support using custom LLM models you can run on your machine or servers you own. Now, you can use models like Mistral-7B, CodeLlama, Falcon-40B, and others and get a ChatGPT experience more! Github: github.com/Mintplex-Labs/anything-llm Hosted: useanything.com Con...
OpenAI just launched custom ChatGPTs for all pro users!!
Просмотров 24210 месяцев назад
OpenAI just launched custom ChatGPTs for all pro users!!
ChatGPT displays random dudes selfie in thread!
Просмотров 43010 месяцев назад
Link below! a user reported that during a programming question thread chat GPT 3.5 responded with a picture of a random man selfie during response. chat.openai.com/share/ba0faec8-bd98-46ee-a010-fe871709bc5d
[FREE] AnythingLLM v2 | The last document chatbot you will ever need
Просмотров 49 тыс.10 месяцев назад
AnythingLLM is an open-source full-stack "Chat with your documents" application that is constantly evolving and will enable you to chat with your documents in a private and enterprise environment. Lean more: useanything.com GitHub: github.com/Mintplex-Labs/anything-llm Chapters 0:00 What is AnythingLLM & what’s new?0:46 Where to find on GitHub 1:29 Onboarding - Introduction 1:51 Onboarding - LL...
Launch a Private AI Document Chatbot in 10 minutes! | Open Source
Просмотров 8 тыс.Год назад
AnythingLLM is a private, customizable, and extendable single or multi-user document chatbot software. useanything.com In this video, we will show how to deploy a working instance of AnythingLLM in 10 minutes! While this method is more expensive to run it can be a quick solution for a proof-of-concept! AnythingLLM supports multiple vector databases like Chroma, Pinecone, QDrant, and Weaviate as...
VectorAdmin | The universal GUI for vector databases
Просмотров 10 тыс.Год назад
VectorAdmin | The universal GUI for vector databases
AnythingLLM | The easiest way to chat with your documents using AI | Open Source!
Просмотров 32 тыс.Год назад
AnythingLLM | The easiest way to chat with your documents using AI | Open Source!
why I even built @congressstockwatcher .its a free tool for public good!
Просмотров 305Год назад
why I even built @congressstockwatcher .its a free tool for public good!
How to add partytown.js to your website for 10x gains
Просмотров 6 тыс.Год назад
How to add partytown.js to your website for 10x gains
OpenAI is building a Github CoPilot Killer with ChatGPT? & How to find it
Просмотров 2,2 тыс.Год назад
OpenAI is building a Github CoPilot Killer with ChatGPT? & How to find it
[No-Code] Mint an NFT with ANY ERC-20 token using Rampp.xyz
Просмотров 5492 года назад
[No-Code] Mint an NFT with ANY ERC-20 token using Rampp.xyz
Create an ERC-1155 Collection without code | Rampp.xyz
Просмотров 1,5 тыс.2 года назад
Create an ERC-1155 Collection without code | Rampp.xyz
Token-Gated Discounts for your Shopify store without code!
Просмотров 2,1 тыс.2 года назад
Token-Gated Discounts for your Shopify store without code!
Launch a No-code minting website to earn ETH | Rampp.xyz
Просмотров 2,4 тыс.2 года назад
Launch a No-code minting website to earn ETH | Rampp.xyz
Listing your Smart Contract on OpenSea & Airdrop without code | Rampp.xyz
Просмотров 2,2 тыс.2 года назад
Listing your Smart Contract on OpenSea & Airdrop without code | Rampp.xyz
Deploying your NFT smart contract without code! | Rampp.xyz
Просмотров 1,3 тыс.2 года назад
Deploying your NFT smart contract without code! | Rampp.xyz
Create an NFT Smart Contract WITHOUT CODE | ERC-721A | Rampp.xyz
Просмотров 3,3 тыс.2 года назад
Create an NFT Smart Contract WITHOUT CODE | ERC-721A | Rampp.xyz
Upload NFTs to IPFS without any code! | Rampp.xyz
Просмотров 2,4 тыс.2 года назад
Upload NFTs to IPFS without any code! | Rampp.xyz
Using Hashlips to create a custom NFT collection | Rampp.xyz
Просмотров 1,5 тыс.2 года назад
Using Hashlips to create a custom NFT collection | Rampp.xyz
[Web3] Using OpenSea's API to display NFTs with Javascript!
Просмотров 17 тыс.2 года назад
[Web3] Using OpenSea's API to display NFTs with Javascript!
Decentralizing your NFT project with Rampp + IPFS
Просмотров 1,9 тыс.2 года назад
Decentralizing your NFT project with Rampp IPFS
[Web3] Using Web3.js to login with Ethereum + read and modify smart contracts!
Просмотров 21 тыс.2 года назад
[Web3] Using Web3.js to login with Ethereum read and modify smart contracts!

Комментарии

  • @MarkStarkoff
    @MarkStarkoff 5 часов назад

    I can only get the no Persistence option to register into Docker. I run exactly what is prescribed, I have Docker open. I keep getting the return from the terminal that says - "docker run" requires at least 1 argument. very frustrating I have no idea why this seems to work for everyone else, but not on my machine. I am also unable to see the Port after running the localhost:8000 command in the browser

  • @kozmonot
    @kozmonot 13 часов назад

    Is there a model that can give real references for academic writing? Can we add articles and books to that model?

  • @DesignerRPA
    @DesignerRPA 18 часов назад

    Thank for share, I wonder when working with file, how many lenght then it can be handle?

  • @IAMTHEMUSK
    @IAMTHEMUSK 2 дня назад

    Why don't you activate the agent by default?

  • @musmurstarcraft1083
    @musmurstarcraft1083 3 дня назад

    It's a paid promotion and it doesn't mention it at the beginning of the video.

    • @TimCarambat
      @TimCarambat 3 дня назад

      @@musmurstarcraft1083 how is it a paid promotion if I built it?

  • @anwhelan
    @anwhelan 7 дней назад

    Hey. Nice to meet you. I’ve just come across this now and honestly, this couldn’t come at a better time. I already realised the potential of AnythingLLM and was looking at how to utilise it as I’m building some text to action agents and your video just accelerated my path to objective. I have subscribed and look forward to more of your posts. Nice work 👍🙏👍

  • @AmmarAli-yp9gg
    @AmmarAli-yp9gg 8 дней назад

    I am curious to know if anything LLM has code interpretation capabilities like running it if not I would love to work on that and also if it is I am going to do some awsomawesomegs with it.

  • @aaron6235
    @aaron6235 9 дней назад

    I am using linux. How do I find all the text files that I scrapped? I want to move it to another pc

  • @keithhunt8
    @keithhunt8 11 дней назад

    When trying to chat with the A.I. model through AnythingLLM rather than Ollama, I noticed that the model seems to be incapable of identifying its model designation. It now only knows itself as "assistant" or "AI powered assistant".

    • @TimCarambat
      @TimCarambat 11 дней назад

      @@keithhunt8 this is due to the system prompt we use for workspaces. Change it for your needs, when you use ollama directly there is no system prompt unless defined in the model file. This is overwritten when using ollama via api if you pass in a system prompt, which anythingllm does

  • @baltin80
    @baltin80 12 дней назад

    This is by far the best AI Agents video. I've starred the github repo and will use AnythingLLM now ! :) Thanks a lot for all the info and for making this available for everyone. Legend

  • @LisaClarkLive
    @LisaClarkLive 13 дней назад

    ​@TimCarambat Im pretty tech savvy but no coding. I keep meaning to learn but what's the point now, right? I have committed to a MAAAAAASSSSIVE project that combines a together-working group (huge number) of agents thoroughly trained in all sciences theory, logic, geology, history, theology, ancient languages and a deep deep breakdown of biblical anthropology, historiography and character study, with scripture combinations to allow preachers to prepare sermons promptly and thoroughly, students to learn deeper, Christians to understand the things they are struggling with, Jews to see the references between old and new testament, educate the generally curious, resulte argument if even only in ones own mind, to understand how and why those things all fit together like a custom fact glove, including the big bang theory and Einstein's relativity theory between time and space expansion, to all, in the end, hope to lead some to Christ. We just don't generally have the resources to work that puzzle, at least for painfully logical people. It's called The Crimson Project. We are just starting to build the agents that will help gather the data necessary for all that and help organize, market and to map it out. I have been watching videos for days and ran across this. Things are still mudfully clear on where it will live but I'm starting to at least lose the headache due to multiple options. Still, one that fully works as intended, where intended, for who it's intended... long way off, for me. I still have to get familiar with GitHub AND Azure, l it do I??? (CHAT GPT feels Azure is best for such a project... Haha) Thank you for what you're doing. It's been at least a little enlightening. I'm having a little trouble grasping where they eventually function. Anything LLM is so far the fastest, easiest and most quickly-accurate, for long term memory, but still... Running out and offering the whole ball of wax to the public? That's going to be a long road.

  • @spalmgre9167
    @spalmgre9167 14 дней назад

    It is unclear how to use or do the Cutomization to the Chatbot. I think you would benefit from showing also how to do this on WP. It can seam to you like the same way as on other platforms but to us users we hardly are able to do it on ower own (WP) platform. If you know then you can but if not then you dont know how to begin. I like to use AnywereLMM as a backend to our website and CRM (our own dev) and need an api.

  • @ruanjiandiguo
    @ruanjiandiguo 15 дней назад

    This is so amazing!

  • @stevenmancilla6936
    @stevenmancilla6936 15 дней назад

    this video is extremely boring and useless, it only helped me to lose more time trying to use this shitty web worker

  • @user-or4ix8ng7x
    @user-or4ix8ng7x 16 дней назад

    Your llm being able to do an api post and use the return data back as rag would be the best. Do you have that yet?

  • @K600K300
    @K600K300 17 дней назад

    I have loved everything llm since the beginning.

  • @spartanmod3
    @spartanmod3 17 дней назад

    Awesome presentation.

  • @mansurabdulkadar1358
    @mansurabdulkadar1358 18 дней назад

    Excellent work🎉 , Offline- RAG-Opensource!!! Very useful, working well in my pc. at 5:46 when I type & select ollama, base url is detected automatically 👍 thank you for this master piece Anything LLM👏👏

  • @beissel_glitch
    @beissel_glitch 18 дней назад

    Can you make a complete video on the installation of Docker Anything LLM please ??

  • @beissel_glitch
    @beissel_glitch 18 дней назад

    Can you make a complete video on the installation of Docker Anything LLM please ??

  • @sai_ai-z1c
    @sai_ai-z1c 20 дней назад

    Wow, AI research tools are really changing the game! As a researcher, I've found SmythOS to be a game-changer for automating complex workflows. It's amazing how AI agents can now collaborate to tackle big research challenges.#SmythOS #AItools

  • @fluffsquirrel
    @fluffsquirrel 20 дней назад

    This is absolutely absurd. Thank you so much, this is an incredible project and I hope it gets more attention. I'm sold!

  • @JayantHudar
    @JayantHudar 22 дня назад

    Great. Thanks a ton. I was searching for this precise thing. I need to talk to you. How do i do that?

  • @atanudasgupta
    @atanudasgupta 22 дня назад

    also how can I add some custom tools?

  • @atanudasgupta
    @atanudasgupta 22 дня назад

    this is a great tool indeed, installed it and works great !. Could you help me understand how you got Ollama models to have function call to work, I find it errors out when I use with langchain. Appreciate your help. It seems to work ok in Anything LLM, at least better than using langchain

  • @themax2go
    @themax2go 22 дня назад

    support for mem0 long term triple-mem-db support and sciphi/triplex embeddings model via ollama for contextual graph?

  • @scottpark2395
    @scottpark2395 23 дня назад

    I guess I'm just not smart enough to get to use these tools. I can to this video trying to find out what you mention @5:55 about the Ollama URL, I can't find out how to get this you say when Ollama launches but I can't even get it to do that, it is installed but how do I get to that URL? I really am trying to learn how to do this but it seems everyone can figure it out but me.

  • @scottpark2395
    @scottpark2395 23 дня назад

    @6:37 you mention copy paste from Ngrok? What is this? where do I find the URL to paste for this, can you make a more beginner step by step of this you go so fast over it, I'm basically going frame by frame trying to understand everything you go over so fast. I'm stuck on the LLM preferences page on Anything LLM trying to figure out where I get this URL and it stays waiting for URL to load chat model selection.

  • @Martelus
    @Martelus 24 дня назад

    What's the best small quantized model to work with agent?

    • @TimCarambat
      @TimCarambat 24 дня назад

      @@Martelus llama3.1 Q4 does okay honestly

  • @abstractradio1969
    @abstractradio1969 24 дня назад

    Hi Followed instructions ... When I try to import a document, I get an error message : "Error 1: the documents failed to add. The specified module could not be found" and it refers to \\?\C:\program files\ .. \onnxruntime_binding.node. This file is present on the system - I have checked. Running in debug, I get: [nativeembedder] The native embedding model has never been run and will be downloaded right now ... [nativeembedder] Failed to download model from primary URL. Using fallback error : addDocumenttoNamespace The specified model could not be found \\?\C:\program files\ .. \onnxruntime_binding.node Again, I can confirm that the file is there. So am unable to import docs for training - please can someone help me in working out how to get AnythingLLM to download the native embedding model?

  • @greensynergy
    @greensynergy 25 дней назад

    waiting for local install video

  • @DouglasThompson_Profile
    @DouglasThompson_Profile 25 дней назад

    @tim carabat - Legend! Can you show how Anthing LLM can interface / co-ordinate / use your defined oLlama's Agents?

  • @KilianSchmelmer
    @KilianSchmelmer 25 дней назад

    If I may ask.... my powerPC with a GPU where Ive installed LM Studio, is in the same room, but connected by wire to the same Network as I am with my Laptop that is using WiFi. Both devives have NordVPN with Meshnet options, allowing to simulate LANConnections ... However, I cant fully connect to the LM Studio (CORSHeaders on). In AnythingLLM it doesnt list the available models.

  • @mohamedalichakroun6967
    @mohamedalichakroun6967 26 дней назад

    Thanks for the video, Tim! Quick question: Will this work with scanned PDFs, or is it only for digital PDFs?

  • @trentadams5582
    @trentadams5582 28 дней назад

    FOR ANYONE THATS CURIOUS UNSLOTH DOES THIS FREE

    • @TimCarambat
      @TimCarambat 28 дней назад

      I don't know how many times I said this in the video, but this is not for people who know how to use libraries like Unsloth. Unsloth is amazing, but you still have to know how to code AND have a GPU you can even use. Funny enough, for the promised local version I am using Unsloth because it's so simple. Sure you can run their colab example but that isn't even close to what everyday people need. The issue is not gatekeeping, it's making it easy and accessible to those who probably dont even have a GPU they can use to fine-tune. Hell, even if you go to unsloths website they dont offer this for free. The LIBRARY for custom code is free, their hosted version is still paid and is not even open to the public.

  • @blazar8565
    @blazar8565 28 дней назад

    Hi, Thanks for the tutorial. I am making a RAG within AnythingLMM. I use: 1. LM studio : Llamma 3.1 8b. 2.Connected to AnythingLLM 3.New Workspace. Question: What did you choose under setting: Chat: LM studio or Ollama? and Agent:... LM Studio or Ollama? Thanks!

    • @TimCarambat
      @TimCarambat 28 дней назад

      Used Ollama for both using the same 3.1 8B model for agent and workspace

    • @blazar8565
      @blazar8565 19 дней назад

      Oh, I have been using LM Studio for both the chat and the agent. And I have been getting a lot of mistakes from the RAG! I will set up a new workspace now and will be using Ollama. Thank you very much for your answer and especially for making this great app/tool/AI.

    • @blazar8565
      @blazar8565 19 дней назад

      @@TimCarambat One more question; To be clear; In the setting for LLM Preference: There it should be LM Studio i guess? The LM Studio Base URL is then the same as in LM Studio.

  • @thiagoeidisumida9200
    @thiagoeidisumida9200 29 дней назад

    this not worked as expected. i can do request without any token

  • @EmsurfShark
    @EmsurfShark Месяц назад

    I'm sorry, I'm aware that it may be an incredibly stupid question, but If my LLM runs on the virtual Linux under Windows, then do i need the Linux or the Windows version of AnythingLLM?:) I'm sorry again about it.

  • @jeffniekamp1044
    @jeffniekamp1044 Месяц назад

    Self Promotion for AnythingLLM

  • @kniiz
    @kniiz Месяц назад

    thanks for video, only thing coming to mind for me rn, is a struggle with docs, files, etc beeing spread all over between 5 disks and would love to not go through it all my self to see it a file is duped, and yea, short words, i need an orginaizer.

  • @kniiz
    @kniiz Месяц назад

    Cant make a custom any LLM ?

  • @matthewmuller
    @matthewmuller Месяц назад

    Is there a way to include the knowledge from the RAG assets into fine tuning? Can you fine tune with multi modal assets?

  • @kingdelo1
    @kingdelo1 Месяц назад

    Hi Tim, I recently installed your software, and in my Set Up list, I cannot obtain the embedded code because the software does not have an icon for it.

    • @TimCarambat
      @TimCarambat Месяц назад

      @@kingdelo1 you are confusing the desktop client (local and single player) with our self hosted solution, which I use in this video as the desktop client did not exist at the time. We don't enable the chat widget on desktop because you would have to expose your desktop to the public internet, which is not safe! docs.anythingllm.com/features/chat-widgets

  • @mmar5896
    @mmar5896 Месяц назад

    Thanks for building anything llm with these features. For many days I was searching for better UI than a terminal and more features for ollama models. And you have done it. Thank you very much.

  • @BrentLeVasseur
    @BrentLeVasseur Месяц назад

    Is there an AI that we can use to fact check with citations the output given by the AI so we don’t get “hallucinations” which is politically correct speech for AI gas lighting.😂

  • @BrentLeVasseur
    @BrentLeVasseur Месяц назад

    Will we see an iOS version to run on iPads like the new M4 iPad Pro?

  • @automatalearninglab
    @automatalearninglab Месяц назад

    This is so cool! 🎉🎉🎉🎉❤

  • @iamarto
    @iamarto Месяц назад

    You are awesome <3

  • @ShadowCoder-w5b
    @ShadowCoder-w5b Месяц назад

    Hey, How to deploy chroma vector in AWS without using docker.

  • @hanuman_thaifoodmaster
    @hanuman_thaifoodmaster Месяц назад

    Thank you