Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform
HTML-код
- Опубликовано: 30 сен 2021
- In the first product spotlight video, we are covering Google Cloud Composer, a fully managed Airflow service.
Composer provides a highly available and scalable Airflow installation with awesome monitoring and logging out of the box.
Composer leverages lot of other Google Cloud Services such as Google Kubernetes Engine, Google App Engine, Google Cloud Storage, Cloud PubSub and more.
___________________________________________________________________
Cloud Composer Versions : cloud.google.com/composer/doc...
Sample DAG : gist.github.com/kaysush/85f56...
___________________________________________________________________
I regularly blog and post on my other social media channels as well, so do make sure to follow me there as well.
Medium ► lnkd.in/dPu9iKi
GitHub ► github.com/kaysush
LinkedIn ► lnkd.in/d5AtTna
RUclips ► lnkd.in/dt-XAWY
#GoogleCloudPlatform #GoogleComposer #Airflow
awesome video
great video to understand composer
Really insightful.Thanks Sushil
Great content and explanation
Great video and clear explanation ,Thank you so much 👍
Great content and very informative. Keep up the good work. Cheers☺️
Good work, it is really helpful. Thanks a lot
Good explanation! Thanks a lot
Awesome - please make more use cases on this topic
Great content & explanation.!
Great video! Thank you very much
You are amazing man, please make more videos on composer and dataflow
great explain about the product
What a video! Thanks Man! You’re the best!!! I catch a legacy project and I’m suffering to build the same environment to run my tests. I don’t know where to seek help. I’m newbie in GCP. I have no idea if I run the tests in my local computer or if I use a copy of the project in the cloud, but the second option I have no idea how to do.
Very well explained. Just one question, do we need additional compute instance or gke instance to execute compute intensive functions like training a machine learning model, or processing a data from GCS bucket?
Very Good Content ,Could you create more videos on GCP .Thank you so much for putting your efforts 👍
great content, please make more video on this GCP composer and GKE with airflow,
hello sir i m creating composer environment but here is image version please assist me how to create
Hi Sishil
Great video.
Can you help or make a video on how to Create a basic Airlfow DAG to move a csv file from one location to another.
Hi Sushil, Thanks for this great content, Please make video of using git with cloud composer
hello sir i m creating composer environment but here is image version please assist me how to create
hello sir i m creating composer environment but here is image version please assist me how to create
Sushil.. I'm really messed up with airflow cost.. Please tell me how configure airflow_monitoring - schedule interval ?
Can you add the provider package here, i am trying to add mongo db but i am failing to add its provider package here
Sir i want to join your session gco
Do we need to pay for Composer , even if any process is not running in composer?
Yes. The machines for running scheduler are always running.