Applied GenAI: A Real-World Story of Shipping Software Products - April 2024

This is the recording of the April 2024 Meetup of the Houston Azure User Group: www.meetup.com...
Abstract:
In this talk, our speaker will be sharing their real-world journey of applying Azure OpenAI Models such as GPT-3.5-Turbo and GPT-4 to both customer-facing applications and internal use cases. This will include a discussion of the actual challenges faced, the steps taken to achieve a production-ready implementation and what lies ahead.
This talk will cover:
- The problem statement and the challenges faced by the Presenter and his team in the fast-moving AI space
- Guardrail specifications, prevention of prompt injection attacks, dataset pre-processing capability and pipeline, decisions on the right custom dataset and the technology used for indexing, querying, and updating content datasets
- The technology stack used and it's architecture
- The App capabilities used for a conversational assistant, such as response streaming, response retries, response formatting, user feedback per assistant response and Evaluation flows
- The tooling used, the infrastructure setup, application and penetration testing, load and performance testing, and more.
Your speaker tonight is local community member Vin Kamat, a Principal Architect at H&R Block. Vin is based in Houston and will be presenting in-person!