FAISS Vector Library with LangChain and OpenAI (Semantic Search)

Поделиться
HTML-код
  • Опубликовано: 26 фев 2024
  • In this video, we take a look at the Facebook AI Similarity Search (FAISS) vector library. Through a few examples, we will grab a document, chunk it, set up embeddings, and search through it.
    Interested in discussing a Data or AI project? Feel free to reach out via email or simply complete the contact form on my website.
    📧 Email: ryannolandata@gmail.com
    🌐 Website & Blog: ryannolandata.com/
    🍿 WATCH NEXT
    OpenAI/Langchain Playlist: • How to Build Your Firs...
    Vector Embeddings: • LangChain (OpenAI) Vec...
    Langchain Chains: • LangChain Chains for B...
    Streamlit Langchain: • Learn to Build Excitin...
    MY OTHER SOCIALS:
    👨‍💻 LinkedIn: / ryan-p-nolan
    🐦 Twitter: / ryannolan_
    ⚙️ GitHub: github.com/RyanNolanData
    🖥️ Discord: / discord
    📚 *Practice SQL & Python Interview Questions: stratascratch.com/?via=ryan
    WHO AM I?
    As a full-time data analyst/scientist at a fintech company specializing in combating fraud within underwriting and risk, I've transitioned from my background in Electrical Engineering to pursue my true passion: data. In this dynamic field, I've discovered a profound interest in leveraging data analytics to address complex challenges in the financial sector.
    This RUclips channel serves as both a platform for sharing knowledge and a personal journey of continuous learning. With a commitment to growth, I aim to expand my skill set by publishing 2 to 3 new videos each week, delving into various aspects of data analytics/science and Artificial Intelligence. Join me on this exciting journey as we explore the endless possibilities of data together.
    *This is an affiliate program. I may receive a small portion of the final sale at no extra cost to you.
  • НаукаНаука

Комментарии • 27

  • @varunsharma9757
    @varunsharma9757 4 месяца назад +2

    Brother saw some of your other videos as well , you are doing a superb job here. It feels bad when I see quite a low response from the audience even though your videos are exceptionally knowledgable . keep working hard bro you will grow , best wishes

    • @RyanNolanData
      @RyanNolanData  4 месяца назад +2

      Thanks man I’m going to continue to push and learn/post videos. Working on getting leetcode out weekly now with a few other vids.

  • @amalasebastian9968
    @amalasebastian9968 3 месяца назад +1

    hey, I want to see how embeddings look/is stored in vectorStore. I want to store the embeddings in a CSV format. I am using FAISS only. How to store it in CSV format?

  • @genie52
    @genie52 3 месяца назад

    hey man this is _really_ good work!! keep on going!

  • @MehreenMunsif
    @MehreenMunsif 2 месяца назад

    similarity_search gives 4 most similar texts? because I'm getting from 0th to 3rd index results when i query something.

  • @stanTrX
    @stanTrX Месяц назад

    Thanks, how can we apply it to tables such as csv or even sqlite tables?

  • @palanikumarmsc
    @palanikumarmsc 2 месяца назад

    When I do date related query with FAISS why FAISS not returning perfect result? Do I need to update query for Vector search?

  • @m4rc1_n4ch0s
    @m4rc1_n4ch0s 4 месяца назад

    Great video!

  • @chukiatsakjirapapong933
    @chukiatsakjirapapong933 Месяц назад

    Hi bro, Great Video. Hope to see next!

  • @eugenmalatov5470
    @eugenmalatov5470 Месяц назад

    Just a question: FAISS is now using only CPU not GPU. I have Windows. How can I get FAISS run with my GPU? If not what alternative vectorbases should I use? It makes a large difference in terms of performance doesnt it?

  • @vikramn2190
    @vikramn2190 2 месяца назад

    Absolutely brilliant and useful video. You are the REAL rockstar (no pun intended :))!
    If you are ever looking for content ideas .... here's one:
    Do a video on building a RAG pipeline on AWS Bedrock. The AWS platform is phenomenal but the documentation is often confusing. And they have a ton of really useful features (like Guardrails).

    • @RyanNolanData
      @RyanNolanData  2 месяца назад

      I haven’t used AWS yet. I’m trying to get thrown into a few AWS projects at work but no luck :/ I do want to learn AWS and make vids on it.

  • @MehreenMunsif
    @MehreenMunsif 2 месяца назад

    I don't understand the difference between query and retriever. Can someone help me understand this?

  • @pavankumartalari387
    @pavankumartalari387 3 месяца назад

    Small Doubt did you pay for OPENAI api key ? Because I have not paid it .
    If we pay only we would able to use the Embedding models ?

    • @RyanNolanData
      @RyanNolanData  3 месяца назад

      I didn’t pay when I made this video. I had to pay last week for gpt vision

    • @pavankumartalari387
      @pavankumartalari387 3 месяца назад

      @@RyanNolanData thank you so much, learnt a lot from this video.

  • @ralphanthony5198
    @ralphanthony5198 Месяц назад

    Great video! Good job. Love Metallica as well!!!

  • @EulerKernighan
    @EulerKernighan 2 месяца назад

    Hi Ryan, you have now idea how this video of yours was good for me. I really appreciate it. Do you know how I can replace the OpenAI stuff and Jan AI (Jan is an offline AI thing that you can download to your computer and remove the dependency from cloud providers/service/internet connection. Thanks again! Keep the good stuff coming! btw, who would say Metallica would help learning AI, huh? LOL

    • @RyanNolanData
      @RyanNolanData  2 месяца назад +1

      Haha glad you like the Metallica. I haven’t heard of jan AI but maybe something to look at in the future. I’m about to crush out a series on dbt so will look after

    • @EulerKernighan
      @EulerKernighan 2 месяца назад

      @@RyanNolanData tagged along! Can't wait to learn more stuff!

  • @user-tp9bg7sz1t
    @user-tp9bg7sz1t 3 месяца назад

    Hey bro, this is an amazing tutorial, it would be great if you share the code link

    • @RyanNolanData
      @RyanNolanData  3 месяца назад +1

      I need to add it on GitHub. I’m just so behind with it