Elevating Data Quality: Great Expectations and Airflow at PepsiCo

Поделиться
HTML-код
  • Опубликовано: 17 окт 2024
  • Presented by Russell Lamb at Airflow Summit 2023.
    Discover PepsiCo’s dynamic data quality strategy in a multi-cloud landscape. Join me, the Director of Data Engineering, as I unveil our Airflow utilization, custom operator integration, and the power of Great Expectations. Learn how we’ve harmonized Data Mesh into our decentralized development for seamless data integration. Explore our journey to maintain quality and enhance data as a strategic asset at PepsiCo.

Комментарии •

Следующие
Автовоспроизведение
Preventative Metadata Building for data reliability with DataHub, Airflow, & Great Expectations46:50Preventative Metadata Building for data reliability with DataHub, Airflow, & Great Expectations
Preventative Metadata Building for data reliability with DataHub, Airflow, & Great ExpectationsApache Airflow
Просмотров 1,3 тыс.
How Data Engineering Works14:14How Data Engineering Works
How Data Engineering WorksAltexSoft
Просмотров 453 тыс.
Airflow and Control-M: Where Data Pipelines Meet Business Applications in Production21:44Airflow and Control-M: Where Data Pipelines Meet Business Applications in Production
Airflow and Control-M: Where Data Pipelines Meet Business Applications in ProductionApache Airflow
Просмотров 25
Buffalo Bills vs. New York Jets Game Highlights | NFL 2024 Season Week 612:35Buffalo Bills vs. New York Jets Game Highlights | NFL 2024 Season Week 6
Buffalo Bills vs. New York Jets Game Highlights | NFL 2024 Season Week 6NFL
Просмотров 1,9 млн
SEVENTEEN (세븐틴) 'LOVE, MONEY, FAME (feat. DJ Khaled)' Official MV03:35SEVENTEEN (세븐틴) 'LOVE, MONEY, FAME (feat. DJ Khaled)' Official MV
SEVENTEEN (세븐틴) 'LOVE, MONEY, FAME (feat. DJ Khaled)' Official MVHYBE LABELS
Просмотров 28 млн
DRAGON BALL LEGENDS "REVEALS ＆ STUFF #39"13:33DRAGON BALL LEGENDS "REVEALS ＆ STUFF #39"
DRAGON BALL LEGENDS "REVEALS ＆ STUFF #39"Bandai Namco Entertainment
Просмотров 200 тыс.
@ClarentKP - IA02:52@ClarentKP - IA
@ClarentKP - IAClarent
Просмотров 553 тыс.
Deep dive in to the Airflow scheduler43:06Deep dive in to the Airflow scheduler
Deep dive in to the Airflow schedulerApache Airflow
Просмотров 14 тыс.
Lakehouse data validation with Great Expectations in Microsoft Fabric36:18Lakehouse data validation with Great Expectations in Microsoft Fabric
Lakehouse data validation with Great Expectations in Microsoft FabricLearn Microsoft Fabric with Will
Просмотров 4,9 тыс.
DataOps in action with Nessie, Iceberg and Great Expectations22:14DataOps in action with Nessie, Iceberg and Great Expectations
DataOps in action with Nessie, Iceberg and Great ExpectationsDremio
Просмотров 1,2 тыс.
Preventative Metadata: Building for Data Reliability with DataHub, Great Expectations, and Airflow27:41Preventative Metadata: Building for Data Reliability with DataHub, Great Expectations, and Airflow
Preventative Metadata: Building for Data Reliability with DataHub, Great Expectations, and AirflowDataHub
Просмотров 1,2 тыс.
Data Lineage with OpenLineage and Airflow50:44Data Lineage with OpenLineage and Airflow
Data Lineage with OpenLineage and AirflowAstronomer
Просмотров 9 тыс.
What's next for GX and Airflow - a new GreatExpectationsOperator21:14What's next for GX and Airflow - a new GreatExpectationsOperator
What's next for GX and Airflow - a new GreatExpectationsOperatorGreat Expectations
Просмотров 1 тыс.
Data Quality Framework & Methodologies - Data Professionals58:53Data Quality Framework & Methodologies - Data Professionals
Data Quality Framework & Methodologies - Data ProfessionalsModelware Systems
Просмотров 3,4 тыс.
Always know what to expect from your data with great_expectations51:53Always know what to expect from your data with great_expectations
Always know what to expect from your data with great_expectations650 AI Lab
Просмотров 8 тыс.
ETL | AWS Glue | AWS S3 | Data Quality | AWS Glue Data Quality in ETL Pipeline30:43ETL | AWS Glue | AWS S3 | Data Quality | AWS Glue Data Quality in ETL Pipeline
ETL | AWS Glue | AWS S3 | Data Quality | AWS Glue Data Quality in ETL PipelineCloud Quick Labs
Просмотров 4,8 тыс.
ТРЕШ ОБЗОР фильма УРОДИНА [теперь пластические операции бесплатные, но и обязательные]29:36ТРЕШ ОБЗОР фильма УРОДИНА [теперь пластические операции бесплатные, но и обязательные]
ТРЕШ ОБЗОР фильма УРОДИНА [теперь пластические операции бесплатные, но и обязательные]TerlKabot channel
Просмотров 273 тыс.
ITZY "GOLD" M/V03:20ITZY "GOLD" M/V
ITZY "GOLD" M/VJYP Entertainment
Просмотров 7 млн
Это было очень близко...00:10Это было очень близко...
Это было очень близко...Аришнев
Просмотров 3,4 млн
GAYAZOV$ BROTHER$ - Про Малиновую Ладу, фейковый голос и конкуренцию / Опять не Гальцев30:41GAYAZOV$ BROTHER$ - Про Малиновую Ладу, фейковый голос и конкуренцию / Опять не Гальцев
GAYAZOV$ BROTHER$ - Про Малиновую Ладу, фейковый голос и конкуренцию / Опять не ГальцевПлюшки
Просмотров 195 тыс.
Тиктокерша Травила Людей Розовым Соусом31:46Тиктокерша Травила Людей Розовым Соусом
Тиктокерша Травила Людей Розовым СоусомSolek
Просмотров 318 тыс.
Когда друг зашел домой за водой00:46Когда друг зашел домой за водой
Когда друг зашел домой за водойКЕРЯ
Просмотров 88 тыс.
ARGENTINA vs. BOLIVIA [6-0] | RESUMEN | ELIMINATORIAS SUDAMERICANAS | FECHA 1010:08ARGENTINA vs. BOLIVIA [6-0] | RESUMEN | ELIMINATORIAS SUDAMERICANAS | FECHA 10
ARGENTINA vs. BOLIVIA [6-0] | RESUMEN | ELIMINATORIAS SUDAMERICANAS | FECHA 10CONMEBOL
Просмотров 9 млн
Big or Small challenge 😂 Sour lemon gum or small nachos box? 🧐 #shorts Best video by Hmelkofm00:29Big or Small challenge 😂 Sour lemon gum or small nachos box? 🧐 #shorts Best video by Hmelkofm
Big or Small challenge 😂 Sour lemon gum or small nachos box? 🧐 #shorts Best video by HmelkofmHmelkofm
Просмотров 3,4 млн