Getting started with DSPy tutorial

Поделиться
HTML-код
  • Опубликовано: 22 сен 2024
  • DSPy is a new framework for developing LLM programs. It chains LLM calls to build robust systems, where the output of one LLM call becomes the input of the next. Each LLM call acts as a function that takes text as input and produces text as output.
    DSPy is a new programming model inspired by PyTorch that provides significant control over LLM programs. The Signature abstraction streamlines LLM program codebases by encapsulating prompts and structured input/output data. DSPy's compiler optimizes instructions for each LLM program component while sourcing task examples.
    In this video, we will review the core concepts of DSPy and walk through the introduction notebooks that demonstrate how to compile a simple retrieve-then-read RAG program and more. I hope you enjoy it!
    Notebook: github.com/sta...
  • НаукаНаука

Комментарии • 21

  • @kevon217
    @kevon217 7 месяцев назад +3

    Great walkthrough. Been having a lot of fun with DSPy.

  • @andresdavidguerreroduran6126
    @andresdavidguerreroduran6126 5 месяцев назад

    Thanks for sharing this review about DSPy, it's amazing. I'm very excited about this framework.
    However, I don't understand how to create a DSPy system capable of sending different queries in a single request. For example, imagine that the program receives queries={'key_1':'query1', 'key_2':'query2', ...}, snippets={'key_1':'snippets1','key_2':'snippets2' , ...} and returns the response in JSON format answer={'key_1':'answer1', ...,key_n:'answer2'} in a single call. That is, I have been able to design a zero-shot program that is capable of answering different questions in a single call, but it is not at all intuitive when it comes to optimizing it.
    P.S. To make the output a dictionary I used 'type_predictors', that is, Output(Basemodel) defines each of the keys key_1,key_2, etc...

  • @franciericalves7076
    @franciericalves7076 7 месяцев назад +1

    I really like this!

  • @mulderbm
    @mulderbm 5 месяцев назад

    27:17 I like that 🤣 because it's awesome

  • @RobertoMartin1
    @RobertoMartin1 6 месяцев назад

    This seems like one-way, what if I wanted to reflect on the LLM's output? like if I asked it to write code and then invoke exec to run it but get an error, how can I update context and try again?

  • @homayun22
    @homayun22 4 месяца назад

    i would be helpful if you could show what line(s) of code you are refering to, it's sometimes hard to guess

  • @jacekwojcieszynski8368
    @jacekwojcieszynski8368 5 месяцев назад

    Does Qdrant work with OpenAI embeddings? Does Qdrant DSPy work with OpenAI embeddings?

  • @freedom_aint_free
    @freedom_aint_free 6 месяцев назад +1

    I've thought that DSPy was something like "Digital Signal Processing e.g. DSP for Python" ;-0

    • @bryonmccoy9078
      @bryonmccoy9078 6 месяцев назад +1

      They changed the name after the second revision. It's now pronounced DS"pie" DSPy

  • @ppbroAI
    @ppbroAI 7 месяцев назад

    Why the default llm is always openai when gemini pro access is free?

    • @qdrant
      @qdrant  6 месяцев назад +2

      we have been seeing better quality and performance with openai. have you seen different?

    • @ppbroAI
      @ppbroAI 6 месяцев назад

      @@qdrant I mean, why not have gemini as an option at least ?

    • @RobertoMartin1
      @RobertoMartin1 6 месяцев назад +1

      @@ppbroAI I agree with qdrant, gemini is just not there yet

  • @TimothyBeamish-w1b
    @TimothyBeamish-w1b Месяц назад

    This video is great but also wildly similar to this other video: ruclips.net/video/41EfOY0Ldkc/видео.html

  • @benstern8772
    @benstern8772 6 месяцев назад

    Flipper?

  • @AirTable-j5g
    @AirTable-j5g 6 месяцев назад +5

    Sadly dont want to sound harsh but your accent and monotone is putting me to sleep :(

    • @truliapro7112
      @truliapro7112 6 месяцев назад +6

      This is complex topic and alot of people trying to explain but this one is the best.

    • @Vylerr
      @Vylerr 6 месяцев назад

      ???
      @@truliapro7112

    • @gregsLyrics
      @gregsLyrics 2 месяца назад +1

      Perhaps your ears need a tune-up. I love foreign language accents. I love learning new things. I love this channel's wisdom. This lecture and tutorial is one of the very best available.