Evaluating LLM Applications with External Evaluation Pipelines in Langfuse
HTML-код
- Опубликовано: 19 сен 2024
- Langfuse offers multiple evaluation methods for LLM Applications. Have a look here for an introduction: langfuse.com/d...
Consider implementing an external evaluation pipeline for full customizability if you need:
- More control over when traces get evaluated. You could schedule the pipeline to run at specific times or responding to event-based triggers like Webhooks.
- Greater flexibility with your custom evaluations, when your needs go beyond what’s possible with the Langfuse UI
- Version control for your custom evaluations
- The ability to evaluate data using existing evaluation frameworks such as DeepEval, OpenAI Evals, Langchain Evaluators
Learn more: langfuse.com/d... - Наука