Это видео недоступно.
Сожалеем об этом.
Tips to Prevent Prompt Injection & Toxicity // Boris Selitser // MLOps Podcast
HTML-код
- Опубликовано: 9 июл 2024
- Navigating the AI Frontier: The Power of Synthetic Data and Agent Evaluations in LLM Development // MLOps podcast #241 with Boris Selitser, Co-Founder and CTO/CPO of Okareo.
A big thank you to @latticeflow for sponsoring this episode! LatticeFlow - latticeflow.ai/
Boris Selitser delves into the nuances of managing AI prompt injections and ensuring application integrity. He highlights the humorous yet serious nature of jailbreaking datasets and shares practical tips for building robust AI applications. By focusing on filtering out off-topic inputs and maintaining the application's purpose, Boris offers valuable insights to prevent potential embarrassments and keep your AI systems on track.
// Abstract
Explore the evolving landscape of building LLM applications, focusing on the critical roles of synthetic data and agent evaluations. Discover how synthetic data enhances model behavior description, prototyping, testing, and fine-tuning, driving robustness in LLM applications. Learn about the latest methods for evaluating complex agent-based systems, including RAG-based evaluations, dialog-level assessments, simulated user interactions, and adversarial models. This talk delves into the specific challenges developers face and the tradeoffs involved in each evaluation approach, providing practical insights for effective AI development.
// Bio
Boris is Co-Founder and CTO/CPO at Okareo. Okareo is a full-cycle platform for developers to evaluate and customize AI/LLM applications. Before Okareo, Boris was Director of Product at Meta/Facebook, where he led teams building internal platforms and ML products. Examples include a copyright classification system across the Facebook apps and an engagement platform for over 200K developers, 500K+ creators, and 12M+ Oculus users. Boris has a bachelor’s in Computer Science from UC Berkeley.
// MLOps Jobs board
mlops.pallet.xyz/jobs
// MLOps Swag/Merch
mlops-community.myshopify.com/
// Related Links
docs.okareo.com/blog/data_loop
docs.okareo.com/blog/agent_eval
The Real E2E RAG Stack // Sam Bean // MLOps Podcast #217 - • The Real E2E RAG Stack...
RecSys at Spotify // Sanket Gupta // MLOps Podcast #232 - • RecSys at Spotify // S...
-------------- ✌️Connect With Us ✌️ ------------
Join our slack community: go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: mlops.community/
Connect with Demetrios on LinkedIn: / dpbrinkm
Connect with Boris on LinkedIn: / selitser