Easy RAG Setup - Load Anything into Context - Mistral 7B / ChromaDB / LangChain

Поделиться
HTML-код
  • Опубликовано: 10 дек 2024
  • НаукаНаука

Комментарии • 33

  • @matten_zero
    @matten_zero 10 месяцев назад +8

    This is why I left my previous industry to go full time in AI. Only place where people collaborate and share their code and knowledge for free. This is awesome. Last time I used lang chain it had some collisions but I think I'm ready to give it another shot.

    • @huyked
      @huyked 10 месяцев назад +2

      Do you think this openness will last, or only because it's novel at the moment?
      Also, if I may ask, what was your previous industry?

    • @matten_zero
      @matten_zero 10 месяцев назад

      @@huyked I've been watching from a distance and can tell you this isn't a one off. The nature of a lot software devs if open source. You can basically download anything you need to build an app for free and there are tons of people who upload courses for free. This is not a temporary phenomenon at all. I was in biopharma and that industry boy of boy is there A LOT of gatekeeping. Just to purchase a research article to do your research you're paying $100 to RENT an article. Just let that sink in. That's not to mention bureaucracy, regulations, busy work for the sake of busy work etc.
      Meanwhile I can download Python and almost every library for FREE and build useful products. Even talking about makes me mad thinking about it!

    • @JC.72
      @JC.72 10 месяцев назад

      ​@@huyked if u mean the openness from open source community, the idea always been around and flourished since the start of www and digital age. linux/android/risc-v/blockchain/etc and the short answer is, it will surely last, as a user/hoarder of the open source community, the thing is that 99% of the time if there is a closed source proprietary company doing similar software, the paid version is almost always better. however, as more people getting involved in open source, along with open source growing or businesses which have both open/close software involvement, i am seeing open source being even more competitive now. blender software is a good example of that. on top of that, i think some are realizing AI is potentially overpowered, and some people feel wary to share away all of personal data to the large corporations for free, this could be another reason why we might see even more people involved for various reasons other than just another tech trend opportunity.

    • @User_1795
      @User_1795 9 месяцев назад

      The corps are just riding off the backs of open source and will keep it all for them selves.

  • @nannan3347
    @nannan3347 10 месяцев назад +7

    It's unbelievable how brave, or deranged, this man is for setting a chunk_size of 500 instead of 512, and a chunk_overlap of 50 instead of 64

    • @crachingk6061
      @crachingk6061 10 месяцев назад +1

      Can you tell me why?

    • @CristianOrihuelaTorres
      @CristianOrihuelaTorres 7 месяцев назад +1

      @@crachingk6061 is simply a heuristic that’s been adopted by the community. There are no studies have decisively shown that using powers of two is optimal in any way for selecting hyperparameters such as batch size and the number of nodes in a given layer.

    • @user-wp8yx
      @user-wp8yx 7 месяцев назад +1

      I wouldn't have had the guts. What a man!

  • @MattJonesYT
    @MattJonesYT 10 месяцев назад +3

    More langchain vids please! Especially making custom agents! samwitteveenai has a lot of great source material

  • @michaelwallace4757
    @michaelwallace4757 10 месяцев назад

    Awesome video. I'd love to see the follow up video to the "Website Automation - Case Study Part 1"

  • @pietrobecqtattus4762
    @pietrobecqtattus4762 10 месяцев назад

    You should work on the project 01 with KillianLucas, everything you’ve done so far is sooooo damn good !!
    I’ve recently heard about Natural-Functions, a 7B function calling model, I don’t know if you’re interrested in this topic but this would certainly be a great video to watch to better understand this concept !!
    Thanks for your job !!!

  • @vapornate
    @vapornate 10 месяцев назад +1

    great summary video. been looking for this solution

  • @NightSpyderTech
    @NightSpyderTech 10 месяцев назад

    This is awesome! I was needing an updated local RAG system.

    • @carstenli
      @carstenli 10 месяцев назад

      Not (yet) fully local, though. But you could add the Ollama Embedding API to the mix.

  • @mayorc
    @mayorc 10 месяцев назад +1

    Nice work on this.

  • @peter102
    @peter102 10 месяцев назад

    this is actually insane lmfao. awesome video

  • @micbab-vg2mu
    @micbab-vg2mu 10 месяцев назад +1

    Great project - thank you for sharing:)

  • @blacktyg3r
    @blacktyg3r 10 месяцев назад +1

    How big the context can be? If we consider keeping very long chat history, what would be best approach to make it efficient? Love your content, you hooked me in good time lol!

  • @clubbuzz
    @clubbuzz 10 месяцев назад +1

    I became a member. How can I get access to the complete files?

  • @paullachance6393
    @paullachance6393 10 месяцев назад

    Hello, nice work - unfortunately the github redirect in the members section is not working (404 error).

  • @williamdownes2032
    @williamdownes2032 10 месяцев назад

    having an issue with talk5.py... says no module named 'text'

    • @williamdownes2032
      @williamdownes2032 10 месяцев назад

      (openvoice) C:\Users\wildo\easy-rag>python talk5.py
      Traceback (most recent call last):
      File "C:\Users\wildo\easy-rag\talk5.py", line 9, in
      from api import BaseSpeakerTTS, ToneColorConverter
      File "C:\Users\wildo\easy-rag\api.py", line 9, in
      from text import text_to_sequence
      ModuleNotFoundError: No module named 'text'

    • @williamdownes2032
      @williamdownes2032 10 месяцев назад

      I figured out i needed to copy the "text" folder from the low-latency-sts project. After some other issues that required some additional pip installs I got it running! Works great! Looking forward to building upon this! Thanks for all your hard work putting these things together!

  • @sanjidnet
    @sanjidnet 7 месяцев назад

    Why do we need openai if we are using mistral?

    • @Roy-h2q
      @Roy-h2q 7 месяцев назад

      I believe he say, for the text embedding

  • @mattobrien6854
    @mattobrien6854 10 месяцев назад

    I keep getting "ImportError: cannot import name 'OpenAI' from 'openai'" Does anyone have a fix? I've installed and uninstalled openai multiple times.

  • @BetaPug
    @BetaPug 10 месяцев назад

    Hi. The github file is different from the one you are using in the video. Did you link the wrong repository? The one in the link (in the description) seems to use only openAi server and not the local LLM. Maybe I'm missing something. (sorry to bother you but It's really interesting)

    • @carstenli
      @carstenli 10 месяцев назад

      He mentioned that you can get the full version as a member.

    • @BetaPug
      @BetaPug 10 месяцев назад

      @@carstenliThankyou