![Astronomer](/img/default-banner.jpg)
- Видео 165
- Просмотров 409 826
Astronomer
США
Добавлен 3 янв 2017
Astronomer is the commercial developer of Apache Airflow, a community-driven open-source tool that's leading the market in data orchestration. We're a global, venture-backed team of learners, innovators and collaborators working to build an Enterprise-grade product that makes it easy for data teams at Fortune 500’s and startups alike to adopt Apache Airflow.
From Task Failures to Operational Excellence at GumGum with Brendan Frick
Data failures are inevitable but how you manage them can define the success of your operations. In this episode, we dive deep into the challenges of data engineering and AI with Brendan Frick, Senior Engineering Manager, Data at GumGum. Brendan shares his unique approach to managing task failures and DAG issues in a high-stakes ad-tech environment.
Brendan discusses how GumGum leverages Apache Airflow to streamline data processes, ensuring efficient data movement and orchestration while minimizing disruptions in their operations.
Key Takeaways:
(02:02) Brendan’s role at GumGum and its approach to ad tech.
(04:27) How GumGum uses Airflow for daily data orchestration, moving data from S3 to war...
Brendan discusses how GumGum leverages Apache Airflow to streamline data processes, ensuring efficient data movement and orchestration while minimizing disruptions in their operations.
Key Takeaways:
(02:02) Brendan’s role at GumGum and its approach to ad tech.
(04:27) How GumGum uses Airflow for daily data orchestration, moving data from S3 to war...
Просмотров: 25
Видео
Building Modern Data Apps:Choosing the Right Foundation and Tools
Просмотров 4512 часов назад
From in-product dashboards to recommendation engines, data apps play an increasingly vital role in enabling data-driven decision making at today's organizations. The ability to quickly distill large volumes of data down into key trends, relevant insights, and prescriptive actions that employees, partners, and customers can access on demand is incredibly useful. As such, data apps can be valuabl...
From Sensors to Datasets: Enhancing Airflow at Astronomer with Maggie Stark and Marion Azoulai
Просмотров 72День назад
A 13% reduction in failure rates - this is how two data scientists at Astronomer revolutionized their data pipelines using Apache Airflow. In this episode, we enter the world of data orchestration and AI with Maggie Stark and Marion Azoulai, both Senior Data Scientists at Astronomer. Maggie and Marion discuss how their team re-architected their use of Airflow to improve scalability, reliability...
Mastering Data Orchestration with Airflow at M Science with Ben Tallman
Просмотров 69День назад
Mastering the flow of data is essential for driving innovation and efficiency in today’s competitive landscape. In this episode, we explore the evolution of data orchestration and the pivotal role of Apache Airflow in modern data workflows. Ben Tallman, Chief Technology Officer at M Science, joins us and shares his extensive experience with Airflow, detailing its early adoption, evolution and t...
Welcome to The Data Flowcast
Просмотров 4914 дней назад
Welcome to The Data Flowcast: Mastering Airflow for Data Engineering & AI - the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolvin...
Enhancing Business Metrics With Airflow at Artlist with Hannan Kravitz
Просмотров 7721 день назад
Data orchestration is revolutionizing the way companies manage and process data. In this episode, we explore the critical role of data orchestration in modern data workflows and how Apache Airflow is used to enhance data processing and AI model deployment. Hannan Kravitz, Data Engineering Team Leader at Artlist, joins us to share his insights on leveraging Airflow for data engineering and its i...
Cutting-Edge Data Engineering at Teya with Alexandre Magno Lima Martins
Просмотров 39028 дней назад
Data engineering is constantly evolving and staying ahead means mastering tools like Apache Airflow. In this episode, we explore the world of data engineering with Alexandre Magno Lima Martins, Senior Data Engineer at Teya. Alexandre talks about optimizing data workflows and the smart solutions they've created at Teya to make data processing easier and more efficient. Key Takeaways: (02:01) Ale...
Airflow Strategies for Business Efficiency at Campbell with Larry Komenda
Просмотров 700Месяц назад
Managing data workflows well can change the game for any company. In this episode, we talk about how Airflow makes this possible. Larry Komenda, Chief Technology Officer at Campbell, shares how Airflow supports their operations and improves efficiency. Larry discusses his role at Campbell, their switch to Airflow, and its impact. We look at their strategies for testing and maintaining reliable ...
How Laurel Uses Airflow To Enhance Machine Learning Pipelines with Vincent La and Jim Howard
Просмотров 128Месяц назад
The world of timekeeping for knowledge workers is transforming through the use of AI and machine learning. Understanding how to leverage these technologies is crucial for improving efficiency and productivity. In this episode, we’re joined by Vincent La, Principal Data Scientist at Laurel, and Jim Howard, Principal Machine Learning Engineer at Laurel, to explore the implementation of AI in auto...
How Vibrant Planet's Self-Healing Pipelines Revolutionize Data Processing
Просмотров 1052 месяца назад
Discover the cutting-edge methods Vibrant Planet uses to revolutionize geospatial data processing and resource management. In this episode, we delve into the intricacies of scaling geospatial data processing and resource allocation with experts from Vibrant Planet. Joining us are Cyrus Dukart, Engineering Lead, and David Sacerdote, Staff Software Engineer, who share their innovative approaches ...
How Vibrant Planet is Making the World’s Ecosystems More Resilient with Fully-Managed Apache Airflow
Просмотров 612 месяца назад
Vibrant Planet is an eco-tech startup that uses geospatial processing to collect massive amounts of data on the world’s forests, orchestrating all this data through Apache Airflow. They originally self-hosted their own Airflow environments, but soon faced scaling issues. In evaluating hosted solutions, they ultimately selected Astro, which helped free up valuable time for their engineering team...
Driving Next-Gen AI Applications with AWS and Astronomer
Просмотров 1963 месяца назад
Artificial Intelligence is shaping how modern organizations make decisions, drive critical business outcomes, and support their customers and stakeholders. But behind the innovation is a continually changing set of requirements and best practices that are key to the success of getting AI into production. In this webinar, resident AI/ML experts from AWS and Astronomer explore: real world applica...
The Power of Airflow in Modern Data Environments at Wynn Las Vegas with Siva Krishna Yetukuri
Просмотров 1,1 тыс.3 месяца назад
Understanding the critical role of data integration and management is essential for driving business success, particularly in a dynamic environment like a luxury casino resort. In this episode, we sit down with Siva Krishna Yetukuri, Cloud Data Architect at Wynn Las Vegas, to explore how Airflow and other tools are transforming data workflows and customer experiences at Wynn Las Vegas. Key Take...
The Future of AI in Data Engineering With Astronomer’s Julian LaNeve and David Xue
Просмотров 9543 месяца назад
The world of data orchestration and machine learning is rapidly evolving, and tools like Apache Airflow are at the forefront of these changes. Understanding how to effectively utilize these tools can significantly enhance data processing and AI model deployment. This episode features Julian LaNeve, CTO at Astronomer, and David Xue, Machine Learning Engineer at Astronomer. They delve into the in...
Powering the Texas Rangers World Series Win With AI on Airflow with Alexander Booth
Просмотров 6313 месяца назад
The integration of data and AI in sports is transforming how teams strategize and perform. Understanding how to harness this technology is key to staying competitive in the rapidly evolving landscape of baseball. In this episode, we sit down with Alexander Booth, Assistant Director of Research and Development at Texas Rangers Baseball Club, to explore the intersection of big data, AI and baseba...
How Trellix Modernized their Data Stack and Eliminated Airflow Management Overhead with Astronomer
Просмотров 613 месяца назад
How Trellix Modernized their Data Stack and Eliminated Airflow Management Overhead with Astronomer
Apache Airflow: Where Data Engineers and ML Engineers Meet
Просмотров 1833 месяца назад
Apache Airflow: Where Data Engineers and ML Engineers Meet
Reliable Data Orchestration for AI Applications
Просмотров 1163 месяца назад
Reliable Data Orchestration for AI Applications
Airflow 2.9.0 Release: Meet The Contributors with Ryan Hatter and Ankit Chaurasia
Просмотров 1714 месяца назад
Airflow 2.9.0 Release: Meet The Contributors with Ryan Hatter and Ankit Chaurasia
2024 Apache Airflow: Trends and Insights
Просмотров 4316 месяцев назад
2024 Apache Airflow: Trends and Insights
How Kiwi.com Achieves Shorter Time to Value with Astronomer
Просмотров 796 месяцев назад
How Kiwi.com Achieves Shorter Time to Value with Astronomer
How Astronomer Helps Faire Deliver Critical Data on Time
Просмотров 636 месяцев назад
How Astronomer Helps Faire Deliver Critical Data on Time
Astronomer Gives Custom Ink the Bandwidth to Focus on Key Business Initiatives
Просмотров 216 месяцев назад
Astronomer Gives Custom Ink the Bandwidth to Focus on Key Business Initiatives
How Collibra Delivers Critical Analytics with Astronomer
Просмотров 486 месяцев назад
How Collibra Delivers Critical Analytics with Astronomer
Managing Airflow across multiple teams
Просмотров 3196 месяцев назад
Managing Airflow across multiple teams
DAG writing for data engineers and data scientists
Просмотров 6746 месяцев назад
DAG writing for data engineers and data scientists
Astronomer Democratizes Data Engineering with Microsoft Azure
Просмотров 1436 месяцев назад
Astronomer Democratizes Data Engineering with Microsoft Azure
The Astronomer Champions Program for Apache Airflow
Просмотров 2077 месяцев назад
The Astronomer Champions Program for Apache Airflow
How the World’s Best ML Teams Get AI into Production
Просмотров 1277 месяцев назад
How the World’s Best ML Teams Get AI into Production