Airflow Sensors | FileSensor | How to use Sensors, Poke, Reschedule and more

In this video on Airflow FileSensor we will learn to use FileSensor for sensing file having some naming convention like DATA_YYYYYMMDD.csv. We will use File Connection, Task Instance, XCom Push Pull concepts.
Apache Airflow Sensors are a special type of Operator that are designed to do exactly one thing - wait for something to occur. It can be time-based, or waiting for a file, or an external event, but all they do is wait until something happens, and then succeed so their downstream tasks can run.
Airflow is a platform to programmatically author, schedule, and monitor workflows.
Use Airflow to author workflows as Directed Acyclic Graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. The rich user interface makes it easy to visualize data pipelines running in production, monitor progress, and troubleshoot issues when needed.
Connect with us on Whatsapp : + 91 8939694874
Website Blog: k2analytics.co...
Write to me at : [e-mail]