How to easily test your Airflow DAGs with the new dag.test() function
HTML-код
- Опубликовано: 13 мар 2023
- This “Live with Astronomer” session covers how to use the new `dag.test()` function to quickly test and debug your Airflow DAGs directly in your IDE. Using the `dag.test()` function speeds up iterative development by running tasks in a single, serialized Python process that does not require running Airflow.
Questions covered in this session include:
How does the `dag.test()` function work and what version of Airflow do I need to use it?
What are the prerequisites for the environment I run `dag.test()` in?
Which operators does `dag.test()` work best with?
How can I test argument-specific DAG runs with `dag.test()`?
Learn more about testing and debugging DAGs in this guide (docs.astronomer.io/learn/test...) and in the official Airflow documentation (airflow.apache.org/docs/apach.... All code shown during this event can be found in this repo. (github.com/astronomer/dag-tes...) - Наука
Tamara Fingerlinm, your approach of 'Live with an Astronomer' is really cool and organized. I gained some nice insights about the topic I am struggling with. Thank you so much!
❤
Thanks so much, Tamara is the best!
Great!
Gracias
Hi, will the dag.test() applied for complex tasks such as SparkSubmitOperator() ? 🙏