Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform

Поделиться
HTML-код
  • Опубликовано: 30 сен 2021
  • In the first product spotlight video, we are covering Google Cloud Composer, a fully managed Airflow service.
    Composer provides a highly available and scalable Airflow installation with awesome monitoring and logging out of the box.
    Composer leverages lot of other Google Cloud Services such as Google Kubernetes Engine, Google App Engine, Google Cloud Storage, Cloud PubSub and more.
    ___________________________________________________________________
    Cloud Composer Versions : cloud.google.com/composer/doc...
    Sample DAG : gist.github.com/kaysush/85f56...
    ___________________________________________________________________
    I regularly blog and post on my other social media channels as well, so do make sure to follow me there as well.
    Medium ► lnkd.in/dPu9iKi
    GitHub ► github.com/kaysush
    LinkedIn ► lnkd.in/d5AtTna
    RUclips ► lnkd.in/dt-XAWY
    #GoogleCloudPlatform #GoogleComposer #Airflow

Комментарии • 27

  • @saleenapatel
    @saleenapatel 11 месяцев назад +1

    awesome video

  • @dineshkakade9979
    @dineshkakade9979 2 года назад +2

    great video to understand composer

  • @justdoittomorrow7119
    @justdoittomorrow7119 2 года назад +2

    Really insightful.Thanks Sushil

  • @bageshgupta2332
    @bageshgupta2332 2 года назад +2

    Great content and explanation

  • @DileepKumar-ko6cy
    @DileepKumar-ko6cy 2 года назад +1

    Great video and clear explanation ,Thank you so much 👍

  • @dileepreddy7469
    @dileepreddy7469 Год назад +1

    Great content and very informative. Keep up the good work. Cheers☺️

  • @amnihs394
    @amnihs394 2 года назад +2

    Good work, it is really helpful. Thanks a lot

  • @udaypatel83
    @udaypatel83 2 года назад

    Good explanation! Thanks a lot

  • @binoypaul4030
    @binoypaul4030 2 года назад

    Awesome - please make more use cases on this topic

  • @JenilCalcuttawala
    @JenilCalcuttawala 2 года назад

    Great content & explanation.!

  • @ATPuKc
    @ATPuKc Год назад

    Great video! Thank you very much

  • @dharmendra811
    @dharmendra811 2 года назад

    You are amazing man, please make more videos on composer and dataflow

  • @febriyantabidin
    @febriyantabidin 2 года назад

    great explain about the product

  • @leleuf3
    @leleuf3 Год назад

    What a video! Thanks Man! You’re the best!!! I catch a legacy project and I’m suffering to build the same environment to run my tests. I don’t know where to seek help. I’m newbie in GCP. I have no idea if I run the tests in my local computer or if I use a copy of the project in the cloud, but the second option I have no idea how to do.

  • @pratikshirbhate8026
    @pratikshirbhate8026 Год назад

    Very well explained. Just one question, do we need additional compute instance or gke instance to execute compute intensive functions like training a machine learning model, or processing a data from GCS bucket?

  • @DileepKumar-ko6cy
    @DileepKumar-ko6cy Год назад

    Very Good Content ,Could you create more videos on GCP .Thank you so much for putting your efforts 👍

  • @anonymous-ze5fg
    @anonymous-ze5fg 2 года назад +5

    great content, please make more video on this GCP composer and GKE with airflow,

    • @khurramkhan5878
      @khurramkhan5878 5 месяцев назад

      hello sir i m creating composer environment but here is image version please assist me how to create

  • @shivakumaryadav8997
    @shivakumaryadav8997 Год назад +1

    Hi Sishil
    Great video.
    Can you help or make a video on how to Create a basic Airlfow DAG to move a csv file from one location to another.

  • @sudhirkenguva4095
    @sudhirkenguva4095 2 года назад +1

    Hi Sushil, Thanks for this great content, Please make video of using git with cloud composer

    • @khurramkhan5878
      @khurramkhan5878 5 месяцев назад

      hello sir i m creating composer environment but here is image version please assist me how to create

  • @khurramkhan5878
    @khurramkhan5878 5 месяцев назад

    hello sir i m creating composer environment but here is image version please assist me how to create

  • @ExploreWithArghya
    @ExploreWithArghya Год назад

    Sushil.. I'm really messed up with airflow cost.. Please tell me how configure airflow_monitoring - schedule interval ?

  • @presha8041
    @presha8041 6 месяцев назад

    Can you add the provider package here, i am trying to add mongo db but i am failing to add its provider package here

  • @amalkumar5201
    @amalkumar5201 Год назад

    Sir i want to join your session gco

  • @kakaji_cloud8106
    @kakaji_cloud8106 2 месяца назад

    Do we need to pay for Composer , even if any process is not running in composer?

    • @kaysush
      @kaysush  Месяц назад

      Yes. The machines for running scheduler are always running.