Evaluating LLM Applications with External Evaluation Pipelines in Langfuse

Поделиться
HTML-код
  • Опубликовано: 19 сен 2024
  • Langfuse offers multiple evaluation methods for LLM Applications. Have a look here for an introduction: langfuse.com/d...
    Consider implementing an external evaluation pipeline for full customizability if you need:
    - More control over when traces get evaluated. You could schedule the pipeline to run at specific times or responding to event-based triggers like Webhooks.
    - Greater flexibility with your custom evaluations, when your needs go beyond what’s possible with the Langfuse UI
    - Version control for your custom evaluations
    - The ability to evaluate data using existing evaluation frameworks such as DeepEval, OpenAI Evals, Langchain Evaluators
    Learn more: langfuse.com/d...
  • НаукаНаука

Комментарии •