Dagster: Modern Data Platform Orchestration

As organizations grow so does the complexity and number of tools. In small data teams it is not uncommon to be responsible for more systems than there are team members. Without a strong orchestration layer to hold these systems together, many workflows are held together with one-off jobs and shaky deployments.
Dagster is a modern framework for defining jobs that treats the data platform as an application. Jobs can be parameterized and iterated on locally before moving into the cloud and interacting with production services. Using Dagster as the foundation for a modern data platform ensures that all data stakeholders can easily interact with their data and build out specific pipelines to maximize value without having to worry about underlying infrastructure.
Presenter: Dennis Hume @Dutchie

[@debangshub9084]

Thanks a lot for this wonderful video. Trying to learn something that is as new and on the move as Dagster is always a challenge and updated videos like these really makes the process a whole lot easier. Again, thank you very much for your efforts! :)

[@Fat1Dada]

Great video !! I was a bit dogmatic about airflow since I used it to upgrade from old dumb crontab, but I see there is no reason to hang on tightly to a particular framework when there could be something better and simpler to use.
Thanks for the intro to dagster

[@pramitpdash8890]

Thanks for this very helpful video!

[@constantfear]

Great presentation I'm deciding what to use for a very small project with the intention of learning a new automation tool ! Thanks for this I might ping you on LinkedIn when I get it working