Flexible Scheduling with Automation in Data Engineering (A Dagster Deep Dive)

Поделиться
HTML-код
  • Опубликовано: 9 июл 2024
  • Data Engineering is all about automation, and the smarter your toolset, the more you can automate and the more you can optimize.
    In this session, Pedram Navid, head of developer relations and analytics at Dagster Labs, shares insights into how to use Dagster's flexible scheduling options to automate and optimize your data platform.
    You can join future sessions and catch past sessions here: dagster.io/events/dagster-dee...
    You will find the Dagster repo for these sessions here: bit.ly/DagDemo
    Be sure to bookmark (star) the Dagster repo for future reference: github.com/dagster-io/dagster
    00:00 Introduction to Automation
    03:12 Schedules
    04:35 Sensors
    06:40 Auto-materialize policies
    07:24 What we will build - our sample project and demo
    23:30 Questions
  • НаукаНаука

Комментарии • 2

  • @hungnguyenthanh4101
    @hungnguyenthanh4101 4 месяца назад

    Please send me link Git repo on video

    • @dagsterio
      @dagsterio  4 месяца назад +1

      Try: github.com/dagster-io/devrel-project-demos