Todd Sharp - Experimenting with Hardware and AI to Create Dynamic Live Streaming User Experiences

In this session, we'll take a look at various hardware and AI based experiments aimed at creating unique user experiences to enhance live streaming applications.
What if we could truly automate multi-cam live streams and make them accessible to both UGC and PGC streamers? In this session, we’ll look at one solution for automated multi-cam streams by utilizing millimeter wave human presence sensors to automatically composite multiple cameras or switch a stream’s source camera when appropriate.
What about using computer vision to analyze live stream chat or even frames to determine a broadcaster or viewers sentiment? We'll look at a real life "mood ring" that changes colors based on the sentiment as determined by AI/ML.
Have you ever looked into PTZ cameras for your live streams but realized just how expensive they are? We'll see how to build your own PTZ camera with some hardware and a video game controller.
These experiments might not be practical or cost effective, but they'll inspire you to think beyond traditional approaches and add new levels of interactivity to your live streaming applications.
This talk was presented at Demuxed '23, a conference for video nerds in San Francisco featuring amazing talks like this one.