Can you please share the link that contains all DAG operators? Also, when using PythonOperator with some custom data wrangling scripts (i.e. loading data into a Dataframe) is the memory used the "Airflow Database"? Is it recommended to trigger other services for this kind of data handling through AirFlow (i.e. Spark)?
Can you please share the link that contains all DAG operators? Also, when using PythonOperator with some custom data wrangling scripts (i.e. loading data into a Dataframe) is the memory used the "Airflow Database"? Is it recommended to trigger other services for this kind of data handling through AirFlow (i.e. Spark)?
Any examples about connecting to on premise database via ssh from cloud composer ?
Perfect
'don't fall behind composer versions' also 'we're 6 years behind the latest python version'