How to Set up and Use PrivateGPT and LocalGPT

Поделиться
HTML-код
  • Опубликовано: 7 янв 2025

Комментарии • 45

  • @konstantinlozev2272
    @konstantinlozev2272 Год назад +8

    These RAG solutions are basically chunking the contents into 2-3 paragraph long chunks, doing a semantic search and then putting out the results as a context for the chat function.
    It's normal that they do not perform well on summarisation.

  • @sivasangaranv6787
    @sivasangaranv6787 Год назад +3

    It's very much useful to me for my studies. Thank you ma'am

  • @John_Krone
    @John_Krone Год назад +3

    Perfect explainer. I have a mac also so this was golden. Thanks

  • @kshitijdesai2402
    @kshitijdesai2402 Год назад +2

    I have tried it before, what you are using are raw models, however large you use, it needs to be finetuned for the task that you wish to perform which is in this case, the answer that you are expecting, otherwise they don't seem to be practical enough as of now.

  • @VaibhavPatil-rx7pc
    @VaibhavPatil-rx7pc 11 месяцев назад +1

    Excellent !🤗

    • @kajalsharma09
      @kajalsharma09 8 месяцев назад

      Hello have you successfully run this

  • @rrzz1513
    @rrzz1513 Год назад +3

    What are differences between PrivateGPT and Local GPT?

  • @PetarBanicevic-j8t
    @PetarBanicevic-j8t 6 месяцев назад

    "just install poetry" - do I have to integrate them or its done by install script of privateGPT?

  • @MuhammadDanyalKhan
    @MuhammadDanyalKhan Год назад

    Does private GPT or localGPT allow stacking of model? i.e. giving query to model that is best suited to answer?

  • @vetonrushiti19
    @vetonrushiti19 6 месяцев назад

    does localgpt work in a ubuntu machine without nvidia gpu?

  • @coder-bm2jb
    @coder-bm2jb Месяц назад

    for localGPT i am getting this error while installing requirements.txt:
    note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for chroma-hnswlib
    Failed to build chroma-hnswlib
    ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (chroma-hnswlib)
    please help to solve this.

  • @otomakannioc8213
    @otomakannioc8213 Год назад +3

    I like LLMs as long as they come along in such sympathic manner as presented in this video ;-)

  • @manu_ovg
    @manu_ovg 7 месяцев назад

    Which Mac you have ? M1 or M2 ?
    Because this looks fast

  • @Pure_Science_and_Technology
    @Pure_Science_and_Technology 11 месяцев назад

    What embedding model is being used?

  • @narendrakd
    @narendrakd Год назад +2

    Hi MAM, I want to know can i ingest multiple files and i have 1000 docuemts pdf,txt and docs & i want to create graphical user interface based chat bot,can i ? can you please guide me mam.

    • @sru_0119
      @sru_0119 4 месяца назад

      have you done it? if so can u please help me

  • @mochammadrevaldi1790
    @mochammadrevaldi1790 9 месяцев назад

    halo thankyou for the tutorial. can you explain how to use posgreSQL mode for vectorstore database privateGPT?

    • @kajalsharma09
      @kajalsharma09 8 месяцев назад

      Hii can you please help me in this

  • @golyandro
    @golyandro Год назад

    Teşekkürler, tam aradığım şey.

  • @justthestuff3324
    @justthestuff3324 Год назад

    GPT4All does this now, right?

  • @therohitdas_com
    @therohitdas_com Год назад +1

    Why did you skip the part where we need to build the llama.cpp with METAL support? It should have been included in this tutorial.

    • @browny334
      @browny334 Год назад

      how to do this?

    • @therohitdas_com
      @therohitdas_com Год назад

      ​@@browny334 go to the Installation section of the privateGPT and then search(cmd+f) OSX GPU support

  • @kaistriban
    @kaistriban Год назад +1

    Great video. Thanks. On Mac giving the command git clone I got a xcrun error and apparently is not an uncommon error. I solved it by reinstalling xcode giving the command in the terminal: xcode-select --install

  • @Andreas-z5o
    @Andreas-z5o Год назад

    ERROR: Could not find a version that satisfies the requirement autoawq (from versions: none)
    ERROR: No matching distribution found for autoawq
    why do I get this error for localGPT

    • @verslemonde6208
      @verslemonde6208 Год назад

      you may not need it and can comment it out if you don't want to build your own quantised models.

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w Год назад

    like to see privategpt with Ollama?

  • @dascoder7473
    @dascoder7473 Год назад

    great joB, thank you

  • @kajalsharma09
    @kajalsharma09 8 месяцев назад

    Hello, anyone please help me i am getting error again and again

  • @Derouz
    @Derouz 4 месяца назад

    If AI is so advanced, couldn't they create installers similar to those in Windows to make it easier to install these programs without having to manipulate code?

  • @ldandco
    @ldandco Год назад

    The face of AssemblyAI is just gorgeous

  • @browny334
    @browny334 Год назад

    localGPT does not work on Mac unfortunately

  • @DanielArnolf
    @DanielArnolf 9 месяцев назад

    We call yaml extension "Yamel"

  • @ozanpress
    @ozanpress Год назад +1

    Bu ablamiz Turk sanirim :)

  • @pabloronald7362
    @pabloronald7362 Год назад

    Thanks for the video. Interesting! Although bionicgpt looks much more robust for running files locally.

  • @PetarBanicevic-j8t
    @PetarBanicevic-j8t 6 месяцев назад

    Its bit superficial guide, flat emotions... I can read readme myself. Yaml is read YAM-uhl.

  • @user_375a82
    @user_375a82 Год назад +2

    I'm not subscribing at $20 a month when $5 is the right price. All these Corps are price fixing. £20 is absurdly high. Even Amazon Prime is only $5 a month.

    • @jaybestnz
      @jaybestnz 8 месяцев назад

      God it's incredible how ungrateful people are. At this time, businesses are throwing billions of dollars into these platforms in the hope of maybe winning and maybe making money in the future.
      This tech just 5 years ago was via Watson, and would be $150k to have access to the licences for a fraction of this tech and power.
      If you are doing these tasks in a business setting you should be easily able to save hundreds of dollars by using this (eg a lawyer able to review files faster and more accurately).
      I strongly suggest if you don't like the price, learn coding and form a company that can do this, and then charge less. It's a free market.

  • @ddhruvarora
    @ddhruvarora 9 месяцев назад

    if you have mac M1 chip, then GPU is not necessary, the power of Mac M1

  • @TheGooch111
    @TheGooch111 Год назад +1

    You asked if there was a quicker way to say Y-A-M-L (.yaml), it's like Camel, but with a Y.

    • @AssemblyAI
      @AssemblyAI  Год назад +2

      I was going to say that but doubted myself for a second thinking it would sound funny. :D Thank you though! - Mısra

  • @StripedLime
    @StripedLime 9 месяцев назад

    *Unstructured [pdf]* gives an error on macbook