Weaviate • Vector Database
Weaviate • Vector Database
  • Видео 240
  • Просмотров 339 890
MIPRO and DSPy with Krista Opsahl-Ong! - Weaviate Podcast #103
Hey everyone! Thank you so much for watching the 103rd Weaviate Podcast with Krista Opsahl-Ong from Stanford University. Krista is the lead author of MIPRO, short for Multi-prompt Instruction Proposal Optimizer, and one of the leading developers and scientists behind DSPy!
This was such a fun discussion beginning with the motivation of Automated Prompt Engineering, Multi-Layer Language Programs (also commonly referred to as Compound AI Systems), and their intersection. We then dove into the details of how MIPRO achieves this and miscellaneous topics in AI from Structured Outputs to Agents, DSPy for Code Generation, and more!
I really hope you enjoy the podcast! As always, more than happy to...
Просмотров: 1 157

Видео

Implementing RAG using Generative Search in Weaviate
Просмотров 25314 дней назад
In this video, we utilize Weaviates generative search capabilities to implement RAG in our Next.js application. We also do some prompt engineering to define how we want our LLM to interact with the data we send it from Weaviate The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Find out more about generative search and RAG in Weaviate here: weaviate.io...
Semantic Search Queries with Next.js Server Actions
Просмотров 12314 дней назад
In this video, we build a search component in Next.js that users can use to input queries and trigger searches. We then use server actions in Next.js to make semantic search queries to our Weaviate database. The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Learn more about semantic search in Weaviate here: weaviate.io/developers/weaviate/search/simil...
Retrieving data from Weaviate
Просмотров 9514 дней назад
In this video, we retrieve data from Weaviate using raw retrieval and semantic search. We explore various filters and adjustments we can make to our data retrieval like filters and limits. The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Learn more about Retrieval Augmented Generation with these resources: - Weaviate Javascript Client Page: weaviate....
Importing Data into Weaviate
Просмотров 9614 дней назад
In this video, we bulk import a JSON file of Wikipedia data with 10k objects into Weaviate Importing created Embeddings for each object and storing them alongside each other. The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Learn more about Retrieval Augmented Generation with these resources: - Weaviate Javascript Client Page: weaviate.io/developers/...
Creating a Collection in Weaviate
Просмотров 8814 дней назад
In this video, we create a collection in our Weaviate database using the Weaviate Typescript client. We set our vectoriser to use the Cohere multilingual model to generate embeddings and our generative search to use OpenAI’s GPT-4 model. The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Find out more about Cohere and other models we support on our int...
Installing the Weaviate Typescript client
Просмотров 10014 дней назад
In this video, we install and set up the Weaviate Typescript client for our Next.js project. To get the Admin keys and cluster URL for your .env file, go to console.weaviate.cloud/cluster-details/ You can find the Weaviate Client page here: weaviate.io/developers/weaviate/client-libraries/typescript/typescript-v3 The code for this project can be found here: github.com/weaviate-tutorials/next-ve...
Setting up your Next.js project
Просмотров 11514 дней назад
In this lesson, we set up our Next.js project from an existing template. You can access the template here: github.com/malgamves/next-vector-search-base-course The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Learn more about Retrieval Augmented Generation with these resources: - Weaviate Javascript Client Page: weaviate.io/developers/weaviate/client-...
Setting up a Weaviate Cluster on Weaviate Cloud
Просмотров 11314 дней назад
We set up a free sandbox cluster in Weaviate Cloud in this lesson! The code for this project can be found here: github.com/weaviate-tutorials/next-vector-search Sign up for Weaviate Cloud here: console.weaviate.cloud/ Learn more about Retrieval Augmented Generation with these resources: Weaviate Javascript Client Page: weaviate.io/developers/weaviate/client-libraries/typescript/typescript-v3 We...
An Introduction to RAG Apps with Weaviate and Next.js
Просмотров 28314 дней назад
Welcome to our course on building RAG apps in Weaviate with Next.js. In this course, we’ll create a project from scratch with Next.js using the Weaviate Typescript client. This is great for anyone looking to go from zero to something with RAG and Vector embeddings. Find the rest of the video for this course in this playlist: ruclips.net/p/PLTL2JUbrY6tUaE8TYCVYItnwvDknJyeFL The code for this pro...
AI-Native Development with Guy Podjarny and Bob van Luijt - Weaviate Podcast #102!
Просмотров 23921 день назад
AI is completely transforming how we build software! But how exactly? What does it mean for a software application to be AI-Native versus AI-Enabled? How many other aspects of software development and creativity are impacted by AI? Guy Podjarny is a co-founder of Snyk, a remarkably successful Cybersecurity company. He is now back on the founder journey, diving into AI-Native Development with Te...
Chat with your code: RAG with Weaviate and LlamaIndex
Просмотров 330Месяц назад
Chat with your code: RAG with Weaviate and LlamaIndex
Scaling Pandas with Devin Petersohn - Weaviate Podcast #101!
Просмотров 273Месяц назад
Scaling Pandas with Devin Petersohn - Weaviate Podcast #101!
Generative UIs with Lucas Negritto and Bob van Luijt - Weaviate Podcast #100!
Просмотров 6332 месяца назад
Generative UIs with Lucas Negritto and Bob van Luijt - Weaviate Podcast #100!
Advanced AI Agents with RAG
Просмотров 6 тыс.2 месяца назад
Advanced AI Agents with RAG
ACORN with Liana Patel and Abdel Rodriguez - Weaviate Podcast #99!
Просмотров 5722 месяца назад
ACORN with Liana Patel and Abdel Rodriguez - Weaviate Podcast #99!
Window Search Tree with Josh Engels - Weaviate Podcast #98!
Просмотров 3772 месяца назад
Window Search Tree with Josh Engels - Weaviate Podcast #98!
Vector Quantization: The Vector Clubhouse Episode 2
Просмотров 2262 месяца назад
Vector Quantization: The Vector Clubhouse Episode 2
AI Renaissance Berlin - AI Buzzwords
Просмотров 1752 месяца назад
AI Renaissance Berlin - AI Buzzwords
The Future of Search with Nils Reimers and Erika Cardenas - Weaviate Podcast #97!
Просмотров 1,1 тыс.2 месяца назад
The Future of Search with Nils Reimers and Erika Cardenas - Weaviate Podcast #97!
Deep Learning with Letitia Parcalabescu - Weaviate Podcast #96!
Просмотров 4353 месяца назад
Deep Learning with Letitia Parcalabescu - Weaviate Podcast #96!
All Your Vector Embeddings Are Belong To You
Просмотров 7763 месяца назад
All Your Vector Embeddings Are Belong To You
Open Source RAG running LLMs locally with Ollama
Просмотров 26 тыс.3 месяца назад
Open Source RAG running LLMs locally with Ollama
Guest Lecture: Vector Quantization Techniques with Etienne | Brown University CSCI
Просмотров 4563 месяца назад
Guest Lecture: Vector Quantization Techniques with Etienne | Brown University CSCI
DSPy End-to-End: Meetup in San Francisco
Просмотров 5 тыс.3 месяца назад
DSPy End-to-End: Meetup in San Francisco
Google Cloud Marketplace with Dai Vu and Bob van Luijt - Weaviate Podcast #95!
Просмотров 3334 месяца назад
Google Cloud Marketplace with Dai Vu and Bob van Luijt - Weaviate Podcast #95!
ParlayANN with Magdalen Dobson Manohar - Weaviate Podcast #94!
Просмотров 3484 месяца назад
ParlayANN with Magdalen Dobson Manohar - Weaviate Podcast #94!
Zain and JP chat about: Vector embedding models for AI
Просмотров 1,2 тыс.4 месяца назад
Zain and JP chat about: Vector embedding models for AI
RAGKit with Kyle Davis - Weaviate Podcast #93!
Просмотров 7414 месяца назад
RAGKit with Kyle Davis - Weaviate Podcast #93!
Generate Multimodal Datasets for AI Prototypes
Просмотров 7795 месяцев назад
Generate Multimodal Datasets for AI Prototypes

Комментарии

  • @dodmedium
    @dodmedium 5 дней назад

    this video contains no info.... not clear why we needed a separate video for this

  • @thannon72
    @thannon72 11 дней назад

    Friendly advice - you need to introduce your topics before speaking about them. This industry is just getting going, and already strange terminology and acronyms are appearing. You are both talking about very basic concepts, but for some reason speaking in another language that makes it impossible to follow. The only reason that anything is confusing is because people assume listeners know what they know.

  • @istvandarvas3372
    @istvandarvas3372 11 дней назад

    Guys! This was awesome! Thanks!

  • @joser100
    @joser100 11 дней назад

    my brain just broke-down on minute 25... I love the in-depth view, pity i was not to level... Luckily we got back to my level soon after... Very good interview...

  • @ConnorShorten
    @ConnorShorten 11 дней назад

    Thank you so much for joining the podcast Krista! It was awesome getting to discuss all these things with you! Go MIPRO and Go DSPy!!

  • @beckbeckend7297
    @beckbeckend7297 23 дня назад

    So there is no direct access to the embeddings storage, i.e. not in the same runtime, only fetching them via API. Which is basically clones vectors in the memory of a server(s) where Weaviate is located. Would be more useful to be able to work directly with the embeddings inside persistence layer. Performing clustering algorithms, launching different regressions algorithms etc. The only benefit i see, is the removal of the round-trip of the data stored in the vector database. I.e. app <-> vector database. As all of the module logic can be implemented in the app, no need to develop module for that.

  • @harrykang9055
    @harrykang9055 28 дней назад

    Is there anywhere I can find this great power point?

  • @stephenkiilu8579
    @stephenkiilu8579 Месяц назад

    Excellent! I found the video very useful

  • @mklobucaric
    @mklobucaric Месяц назад

    Thanks, great video.

  • @rickyS-D76
    @rickyS-D76 Месяц назад

    Another great video by Zain. It will be great of you can share the slides or links used in the slides. Thanks in advance.

  • @BanditZA
    @BanditZA Месяц назад

    Bros head is about to fall off

  • @jagrat12354
    @jagrat12354 Месяц назад

    I wonder if it can read data from a sql database directly ?

  • @anubisai
    @anubisai Месяц назад

    Think it's pronounced Gleaner as in you glean info from other info. Thank for the video.

  • @darkmatter9583
    @darkmatter9583 Месяц назад

    can you share code please?

  • @snehotoshbanerjee1938
    @snehotoshbanerjee1938 Месяц назад

    Great discussion!!

  • @divyaraj-rana
    @divyaraj-rana Месяц назад

    Really amazing innovation by Weaviate team! Their workshops speaks about their groundbreaking applications and making it open-source.

  • @user-xi2hx1wo1p
    @user-xi2hx1wo1p Месяц назад

    is there an implementation for this out there ?

  • @culeforever5408
    @culeforever5408 Месяц назад

    great video

  • @MudroZvon
    @MudroZvon Месяц назад

    I used RAG in my life coach RUclipsr AI character in Telegram. Prepared a lot of AI processed data of him, with fine-grained segments. The most amazing AI experience for me yet - JulienHimselfBot

  • @ChristopherG-k4n
    @ChristopherG-k4n Месяц назад

    In the description

  • @iva1389
    @iva1389 2 месяца назад

    super exciting episode

  • @VincentFulco
    @VincentFulco 2 месяца назад

    Congrats Everyone. Well done indeed. Kudos!

  • @NERDDISCO
    @NERDDISCO 2 месяца назад

    I love this video! Thank you very much!!!

  • @connor-shorten
    @connor-shorten 2 месяца назад

    Thank you so much for joining Lucas! Odapt!! Super interesting example of an AI-native application, really loved the discussion of native multimodality as well!

  • @GeorgeFoxRules
    @GeorgeFoxRules 2 месяца назад

    This is gotta be one of the weirdest videos I’ve ever seen on RUclips. The content is so awesome and great but the camera creates some kind of a surreal image. It’s like hyper realism or something. The image quality is so immersive. It’s almost distracting so weird.

    • @thunken
      @thunken 2 месяца назад

      they're just using front lighting and a short camera focal length thing... relax...

    • @thunken
      @thunken 2 месяца назад

      actually... looks like a technique where the background is blurred... but the person is in sharp focus...

    • @thunken
      @thunken 2 месяца назад

      might be green screen

    • @philipvollet
      @philipvollet 2 месяца назад

      @@thunken@thunken Nope, no green screen, all in person, at the AI Campus in Berlin. It's the cam and blurring setup, but this is by intent

    • @thunken
      @thunken 2 месяца назад

      @@philipvollet it’s nice.

  • @syedabilgrami6603
    @syedabilgrami6603 2 месяца назад

    feels like I am watching bunch of robots talking

  • @PixelProRanger-cv5ii
    @PixelProRanger-cv5ii 2 месяца назад

    Is this a generated video?

  • @restrollar8548
    @restrollar8548 2 месяца назад

    Like the tech, but the health use case is really clunky and very simple. Medical data is messy and you would obviously be asking patients most of these questions, not an LLM!

  • @ocin3055
    @ocin3055 2 месяца назад

    Verba ist wirklich ein super Tool, bin sehr begeistert! Integriert ihr auch GraphRAG (von Microsoft) in das Tool?

  • @MrAnkitnakra
    @MrAnkitnakra 2 месяца назад

    Very helpful , I am able to set up on local host , however not able to ingest data, trying to upload a PDF

  • @etiennedilocker9729
    @etiennedilocker9729 2 месяца назад

    Love this! Thanks for the shoutout. I love that the signal processing example for quantization is now named after me, but I have to say I didn't come up with it, either. The Wikipedia article for quantization actually mentions the Analog-Digital-Converter example. I think I probably got it from there 🙃

  • @HAMLTN
    @HAMLTN 2 месяца назад

    I Have an idea that you could implement.

  • @ConnorShorten
    @ConnorShorten 2 месяца назад

    Thank you so much for joining the podcast both! I loved learning about ACORN to improve Vector Search with Filtering. The whole journey of learning about ACORN has also really helped my understanding of HNSW more broadly. Super exciting as always to see more research in Approximate Nearest Neighbor Search!

  • @drtristanbehrens
    @drtristanbehrens 2 месяца назад

    Richtig nice!

  • @kevon217
    @kevon217 2 месяца назад

    Always look forward to Connor’s hyped introductions. Great discussion. Nils sentence transformer work got me into this space in the first place. Looking forward to further advancements in multi-attribute embeddings. Would love more podcasts on sota embeddings and new directions. Been meaning to try out newer approaches like nv-embed and gritlm. Have you explored these?

  • @AdamLichty
    @AdamLichty 2 месяца назад

    Is the console only available for cloud instances? Or is there a way to have a local console or something for local docker instances?

  • @connor-shorten
    @connor-shorten 2 месяца назад

    Thank you so much for joining Josh! Learned so much from this conversation! Window Search Tree!

  • @dshorten1766
    @dshorten1766 2 месяца назад

    Another great podcast!

  • @KOTAGIRISIVAKUMAR
    @KOTAGIRISIVAKUMAR 2 месяца назад

    can anyone help me with the alternatives to the verba?

  • @Hits-Sandbox
    @Hits-Sandbox 2 месяца назад

    Wow, Victoria, is a natural in front of the Camera, perfect presentation and body language movement just right for the level of presentation required. It almost looks like she went to school for acting, NLP and Micro Expression presentation for marketing.

  • @saulyarhi675
    @saulyarhi675 2 месяца назад

    This is beautiful. I'm working with 5 classmates (electromechanical and software engineering college) on a proyect, we developed a tiny robot able to chat with patients as a co therapist, using a raspberry pi and a LLM. But the hallucinations are way too dangerous here, so i suggested to my team we start implementing RAG. Generating and "validating" the psychology database is really, really, really time consuming, it's hard, tricky and it takes a long time to have good quality examples, but we are pretty sure it's gonna be 100% worth it. I just had knowledge of Ollama and i would love to try out Verba in our prototype, so people in need can start getting attention and we can right away start recollecting data from the final model already deployed. I would love to collaborate with you guys, I'm such an enthusiast of opensource communities and corporations, and I loved the concept you evoke so much. <3

  • @Groe07
    @Groe07 2 месяца назад

    With all that nodding he must be listening to Kanye.

  • @ai_charlesk
    @ai_charlesk 2 месяца назад

    Cool video, but please fix the volume, it gets really low. There are many easy ways to keep a constant volume, even by using a simple phone app. RAG is much more complex than volume levels!!

  • @MichaelFeil-wx4ml
    @MichaelFeil-wx4ml 2 месяца назад

    Question ruclips.net/video/DFqd34ikTH0/видео.html - rewriting 5B tokens with 1$/1M tokens inferences is ~5000$. Nils cites this number as "hunderts of millions" - Where is this number coming from? Thats 1000x.

  • @Pregidth
    @Pregidth 2 месяца назад

    This is very cool! Thank you! Can I distribute just the chat interface without the configuration behind?

  • @ayeshaimran
    @ayeshaimran 2 месяца назад

    Excellent convo! My team and I are just about to start working on a RAG system for a client and I have to admit we didn’t give embedding models much consideration but now will definitely spend some time optimising the best embedding model for our use case. 🙌🏼

  • @Weaviate
    @Weaviate 3 месяца назад

    Additional resources: - Product quantization blog (weaviate.io/blog/pq-rescoring) - Binary quantization blog (weaviate.io/blog/binary-quantization) - Weaviate Academy: Vector compression (weaviate.io/developers/academy/py/compression) - Weaviate Documentation: Vector quantization (weaviate.io/developers/weaviate/concepts/vector-quantization) - Lecture: Vector Quantization (Etienne at Brown University) (ruclips.net/video/0diVrgyQwXA/видео.html) - Hugging Face Blog: Binary and Scalar Embedding Quantization (huggingface.co/blog/embedding-quantization)

  • @JohnPamplin
    @JohnPamplin 3 месяца назад

    Your "All Your Base Are Belong To Us" ending just earned a subscription from me. WHAT YOU SAY!

  • @miguelovallevillamil4953
    @miguelovallevillamil4953 3 месяца назад

    Great!!!