Hi Marc. That's a nice tutorial and a very elegant approach! I have a question though. Can I alternatively create a template python file where all the dag logic is placed inside a class and use instances of this class constructed with different arguments to build actual dags? This way I don't need jinja2 and a separate dag generator, because actual dags inherit from a template class and are therefore available right away.
Hello, good class. It's been so long. Looking forward to the new version classes. Please do a video on how to do local module imports from cloud storage services and maybe handling tokens and secrets on airflow.
Hi these videos have been very useful. I’ve also been trying to implement on_failure_callback. But can’t seem to be getting it working. Would you be able to help?
Can you give any details/resources on How can we incorporate error handling to account for errors in any dag configs(broken dags) without causing all to fail
Hi Marc, Stuck at one place. My python operator calling a function. I want to iterator over this operator. Basically I have a dynamic list. This list having random items. So python operator should create the task as per number of items in a list Could you help on this Thanks in advance
Hi Can this method be deployed in MWAAA (aws as well)?
thanks for share Marc, impressive method to save time and keep our project simple and scalable, keep your great work
Thank you 🙏
really cool. Thanks
Hi Marc. That's a nice tutorial and a very elegant approach! I have a question though. Can I alternatively create a template python file where all the dag logic is placed inside a class and use instances of this class constructed with different arguments to build actual dags? This way I don't need jinja2 and a separate dag generator, because actual dags inherit from a template class and are therefore available right away.
Hello, good class. It's been so long. Looking forward to the new version classes. Please do a video on how to do local module imports from cloud storage services and maybe handling tokens and secrets on airflow.
thank you !! that's really nice
Hi these videos have been very useful. I’ve also been trying to implement on_failure_callback. But can’t seem to be getting it working. Would you be able to help?
You have to do pyton tuto too
Marc, in the input from the yaml, can i call a python file?
Can you give any details/resources on How can we incorporate error handling to account for errors in any dag configs(broken dags) without causing all to fail
my dags are not appearing on the Airflow UI, any help here
Hi Marc,
Stuck at one place.
My python operator calling a function.
I want to iterator over this operator.
Basically I have a dynamic list. This list having random items. So python operator should create the task as per number of items in a list
Could you help on this
Thanks in advance
Go check out task mapping 😉
@@MarcLamberti i am using airflow 2.2.3 version