Thanks a lot . This is really helpful. One question - here source is CSV file . What changes are required to be done if the source is "Oracle on premise data" . I actually tried with Datastream but due to limitation at client end, we are asked to use Dataflow. I tried to check but could not get any specific detail . Could you please suggest any reference here from oracle connection point of view ?
I am unable to create a GCP Composer environment. After around 45 minutes it shows the error "Some of the GKE pods failed to become healthy". I have configured the setting and given the necessary access. I am using composer-2.7.0-airflow-2.7.3. But it failed to create the environment. Can you please help with this? Thanks.
I will appreciate your effort. If possible could you please specify the way to replicate the same by end user step by step if you create storage bucket and create the script file and to save the same in which location so that we will follow you to understand in detail the way to achieve the same in different scenario. Hope you understand.
This is very useful, thanks. Can we trigger trigger Apache Beam pipeline on Dataflow without using Template? I think Template is mandatory with composer 2
Thanks a lot . This is really helpful. One question - here source is CSV file . What changes are required to be done if the source is "Oracle on premise data" . I actually tried with Datastream but due to limitation at client end, we are asked to use Dataflow. I tried to check but could not get any specific detail . Could you please suggest any reference here from oracle connection point of view ?
Sure. Please find the link below
precocityllc.com/blog/configuring-cloud-composer-for-oracle-databases/
Thanks for the link. It's really helpful.
I am unable to create a GCP Composer environment. After around 45 minutes it shows the error "Some of the GKE pods failed to become healthy".
I have configured the setting and given the necessary access. I am using composer-2.7.0-airflow-2.7.3. But it failed to create the environment. Can you please help with this? Thanks.
Useful video
Thanks a lot
I will appreciate your effort. If possible could you please specify the way to replicate the same by end user step by step if you create storage bucket and create the script file and to save the same in which location so that we will follow you to understand in detail the way to achieve the same in different scenario. Hope you understand.
This is very useful, thanks. Can we trigger trigger Apache Beam pipeline on Dataflow without using Template? I think Template is mandatory with composer 2
True
Thanks!
😊
It is better to provide a step by step note through Google drive.
Sure 😊