Data failures are inevitable but how you manage them can define the success of your operations. In this episode, we dive deep into the challenges of data engineering and AI with Brendan Frick, Senior Engineering Manager, Data at GumGum. Brendan shares his unique approach to managing task failures and DAG issues in a high-stakes ad-tech environment.
Brendan discusses how GumGum leverages Apache Airflow to streamline data processes, ensuring efficient data movement and orchestration while minimizing disruptions in their operations.
Key Takeaways:
(02:02) Brendan’s role at GumGum and its approach to ad tech.
(04:27) How GumGum uses Airflow for daily data orchestration, moving data from S3 to war...