Hi Marc. That's a nice tutorial and a very elegant approach! I have a question though. Can I alternatively create a template python file where all the dag logic is placed inside a class and use instances of this class constructed with different arguments to build actual dags? This way I don't need jinja2 and a separate dag generator, because actual dags inherit from a template class and are therefore available right away.
Hello, good class. It's been so long. Looking forward to the new version classes. Please do a video on how to do local module imports from cloud storage services and maybe handling tokens and secrets on airflow.
Can you give any details/resources on How can we incorporate error handling to account for errors in any dag configs(broken dags) without causing all to fail
Hi Marc, Stuck at one place. My python operator calling a function. I want to iterator over this operator. Basically I have a dynamic list. This list having random items. So python operator should create the task as per number of items in a list Could you help on this Thanks in advance
Hi Marc. That's a nice tutorial and a very elegant approach! I have a question though. Can I alternatively create a template python file where all the dag logic is placed inside a class and use instances of this class constructed with different arguments to build actual dags? This way I don't need jinja2 and a separate dag generator, because actual dags inherit from a template class and are therefore available right away.
thanks for share Marc, impressive method to save time and keep our project simple and scalable, keep your great work
Thank you 🙏
really cool. Thanks
Hello, good class. It's been so long. Looking forward to the new version classes. Please do a video on how to do local module imports from cloud storage services and maybe handling tokens and secrets on airflow.
thank you !! that's really nice
Can you give any details/resources on How can we incorporate error handling to account for errors in any dag configs(broken dags) without causing all to fail
Marc, in the input from the yaml, can i call a python file?
my dags are not appearing on the Airflow UI, any help here
You have to do pyton tuto too
Hi Marc,
Stuck at one place.
My python operator calling a function.
I want to iterator over this operator.
Basically I have a dynamic list. This list having random items. So python operator should create the task as per number of items in a list
Could you help on this
Thanks in advance
Go check out task mapping 😉
@@MarcLamberti i am using airflow 2.2.3 version