LLM Evaluation With MLFLOW And Dagshub For Generative AI Application

Поделиться
HTML-код
  • Опубликовано: 19 окт 2024

Комментарии • 29

  • @krishnaik06
    @krishnaik06  4 месяца назад +14

    Subscribe if you want to become a Data Scientist :)

    • @jaisingh1292
      @jaisingh1292 4 месяца назад

      Hi Krish can you please take a look at dvc and mlflow and can they be combined and used for gen ai , the demand for LLMops is increasing. For cloud its fine but industries want on prem solution as well it would be great if you can make any video on the same

    • @DarkShadow-bq5yb
      @DarkShadow-bq5yb 4 месяца назад

      can you create video for Data engineering using LLMs

    • @HimanshuGupta-ps3ib
      @HimanshuGupta-ps3ib 4 месяца назад

      Great video Krish! Watching your content from USA.

  • @surbhirohilla5139
    @surbhirohilla5139 3 месяца назад

    You deserve more appreciation for this

  • @YorkYongYeo
    @YorkYongYeo 4 месяца назад

    thanks for sharing this! just what i needed for reference. Liked and looking forward to the one for RAG evaluation

  • @pratiksitapara8962
    @pratiksitapara8962 4 месяца назад

    Great video on Evals! Thanks!
    But It would be great to see or if you could make a video on Evaluating RAG on Traditional metrics? What insights we can get by using traditional evals or automatic evals? What is the current SOTA methods for RAG Evals!?

  • @anubhavsarkar5745
    @anubhavsarkar5745 Месяц назад

    Very Helpful Video Krish.
    Can you please show us the same LLM Model Evaluation using MLFlow, but using HuggingFace LLMs instead of OpenAI ? I am facing a lot of issues in adding payment method to the OpenAI platform.

  • @SantoshYadav-f4r4s
    @SantoshYadav-f4r4s 3 месяца назад

    Hi Krish ! This is excellent video, will you be able to make a video on Azure AI Prompt flow, please?

  • @2dapoint424
    @2dapoint424 4 месяца назад +2

    Krish, @10:15 in VS code what is that cat like icon on top right next to the run button?

  • @prayagbrahmbhatt6375
    @prayagbrahmbhatt6375 4 месяца назад

    Need a video explanation on promptfoo, an opensource LLM evaluation library.

  • @GiovanneAfonso
    @GiovanneAfonso 3 месяца назад

    Incredible content, thank you +1sub

  • @harikrishnank913
    @harikrishnank913 3 дня назад

    Could you share open source evaluation strategies without relying upon openai

  • @pavanpraneeth4659
    @pavanpraneeth4659 4 месяца назад

    Awesome please in future show how to integrate this with aws bedrock please

  • @sourabhsomdeve1373
    @sourabhsomdeve1373 Месяц назад

    Nice

  • @shriharinair1999
    @shriharinair1999 4 месяца назад +1

    can you from now on focus more on non paid apis?

  • @arpitqw1
    @arpitqw1 3 месяца назад

    what is the use of daghub ?, same once can see in local tracking server.

  • @adityamaurya9521
    @adityamaurya9521 21 день назад

    Can we do this with Mistral API keys ?

  • @RishiRajxtrim
    @RishiRajxtrim 4 месяца назад

    Good evening

  • @ashishdayal172
    @ashishdayal172 4 месяца назад

    sounds like tensorflow hub

  • @skyplanet9858
    @skyplanet9858 Месяц назад

    Dear Kirish, thank you very much for the great video. Dagshub is an Israeli company that's complicit in genocide. I wish you could explore another tool.

  • @ridj41
    @ridj41 4 месяца назад

    Krish honestly the content has become a bit uninteresting tbh from the past few videos.
    Would love if you try out some new kind of projects, some advanced ones to use in our resumes using GenAi

    • @krishnaik06
      @krishnaik06  4 месяца назад +3

      brother this is really important. I usually make all the videos based on the job market :)

  • @TheNiyatiSrivastavaChannel
    @TheNiyatiSrivastavaChannel 17 дней назад

    Is anyone facing error:
    mlflow.exceptions.MlflowException: API request to endpoint /api/2.0/mlflow/runs/create failed with error code 403 != 200. Response body: '' I have tried everything I knew but this autentication error is not going