Hi Krish can you please take a look at dvc and mlflow and can they be combined and used for gen ai , the demand for LLMops is increasing. For cloud its fine but industries want on prem solution as well it would be great if you can make any video on the same
Great video on Evals! Thanks! But It would be great to see or if you could make a video on Evaluating RAG on Traditional metrics? What insights we can get by using traditional evals or automatic evals? What is the current SOTA methods for RAG Evals!?
Very Helpful Video Krish. Can you please show us the same LLM Model Evaluation using MLFlow, but using HuggingFace LLMs instead of OpenAI ? I am facing a lot of issues in adding payment method to the OpenAI platform.
Krish honestly the content has become a bit uninteresting tbh from the past few videos. Would love if you try out some new kind of projects, some advanced ones to use in our resumes using GenAi
Is anyone facing error: mlflow.exceptions.MlflowException: API request to endpoint /api/2.0/mlflow/runs/create failed with error code 403 != 200. Response body: '' I have tried everything I knew but this autentication error is not going
Subscribe if you want to become a Data Scientist :)
Hi Krish can you please take a look at dvc and mlflow and can they be combined and used for gen ai , the demand for LLMops is increasing. For cloud its fine but industries want on prem solution as well it would be great if you can make any video on the same
can you create video for Data engineering using LLMs
Great video Krish! Watching your content from USA.
thanks for sharing this! just what i needed for reference. Liked and looking forward to the one for RAG evaluation
You deserve more appreciation for this
Great video on Evals! Thanks!
But It would be great to see or if you could make a video on Evaluating RAG on Traditional metrics? What insights we can get by using traditional evals or automatic evals? What is the current SOTA methods for RAG Evals!?
Hi Krish ! This is excellent video, will you be able to make a video on Azure AI Prompt flow, please?
Very Helpful Video Krish.
Can you please show us the same LLM Model Evaluation using MLFlow, but using HuggingFace LLMs instead of OpenAI ? I am facing a lot of issues in adding payment method to the OpenAI platform.
Nice
Need a video explanation on promptfoo, an opensource LLM evaluation library.
Awesome please in future show how to integrate this with aws bedrock please
Krish, @10:15 in VS code what is that cat like icon on top right next to the run button?
copilot
Is it possible to do RAG evaluation with Mlflow? Can you please make a video on RAGAS or any other good RAG evaluation tool... thanks
Good evening
what is the use of daghub ?, same once can see in local tracking server.
Could you share open source evaluation strategies without relying upon openai
Incredible content, thank you +1sub
Can we do this with Mistral API keys ?
can you from now on focus more on non paid apis?
sounds like tensorflow hub
Krish honestly the content has become a bit uninteresting tbh from the past few videos.
Would love if you try out some new kind of projects, some advanced ones to use in our resumes using GenAi
brother this is really important. I usually make all the videos based on the job market :)
Is anyone facing error:
mlflow.exceptions.MlflowException: API request to endpoint /api/2.0/mlflow/runs/create failed with error code 403 != 200. Response body: '' I have tried everything I knew but this autentication error is not going