too hurry not able to understand it as you are switching tabs and doing all the things and not mentioning where you are writing the code. The course should be designed so that even beginner should be able to understand it. please make a pin to pin point to point explanation video so that everyone can understand it. Thanks in advance ❤
I am getting below error while trying to run dataflow job: import apache_beam as beam ModuleNotFoundError: No module named 'apache_beam' on both cloud sdk and cloud shell, wheras apache_beam is installed
Great video, i want to take input from JDBC connection a table and load to bigquery… could you please share any document related to this, to how take table as an input from JDBC and load to bigquery
Please drop a mail to cloudaianalytics@gmail.com If you are interested in self paced. take a look at this self paced course in Udemy www.udemy.com/course/gcp-professional-dataengineer-certification-a-complete-guide/
Dataflow isn’t the most widely used component in the Google Cloud Platform. Even if you Google this question, the sensible response is Compute Engine because it runs under pretty much all the other services, but also because a lot of companies do a lift and shift to cloud before integrating with the other services. You claim this twice at the beginning of the video, but it’s incorrect
Very nice mate! Very well explained! Cheers from Brazil brotha!
Thanks!!!
Very helpful. Thanks
Glad it was helpful!
too hurry not able to understand it as you are switching tabs and doing all the things and not mentioning where you are writing the code. The course should be designed so that even beginner should be able to understand it. please make a pin to pin point to point explanation video so that everyone can understand it. Thanks in advance ❤
Sorry about that....Ill keep this in mind. Thanks a lot
is there any course available sir to learn gcp ?if so pls help me provide the details
Course Link: www.udemy.com/course/gcp-professional-dataengineer-certification-a-complete-guide
Reach for Coupon Code - www.linkedin.com/in/vignesh-sekar-sujatha-02aa9b125/
I am getting below error while trying to run dataflow job:
import apache_beam as beam
ModuleNotFoundError: No module named 'apache_beam'
on both cloud sdk and cloud shell, wheras apache_beam is installed
pip install apache-beam[gcp]
pip install apache-beam[gcp] or try createing a virtual environment in cloud shell and run dataflow jobs from there after installing apache beam
how can i do if the data from gheet?
Not sure
Great video, i want to take input from JDBC connection a table and load to bigquery… could you please share any document related to this, to how take table as an input from JDBC and load to bigquery
beam.apache.org/releases/pydoc/2.24.0/apache_beam.io.jdbc.html
beam.apache.org/releases/pydoc/current/apache_beam.io.jdbc.html
@@cloudaianalytics6242 thanks, if i’m facing any issue can i ping u on linkdin or telegram?
@@ashishvats1515 😊 sure
@@cloudaianalytics6242i’m tried but facing some errors… could you please share a example code of this or make a video on it…
can you create this pipeline and do transformations within gcp dataflow itself?
It is in GCP dataflow
Thanks for the video. One question - in case the source is oracle on premise and sink is BigQuery then what changes are required to do ?
Need to do bit research on this. definitely we can use some JDBC, ODBC connectors
what is on premise ? is it traditional computers? or some type of cloud
How to give runtime parameters? can you give the code
Sure, Ill make a video on it. Meanwhile you can get it from my GitHub repo
github.com/vigneshSs-07?tab=repositories
How to enroll your training???
Please drop a mail to cloudaianalytics@gmail.com
If you are interested in self paced. take a look at this self paced course in Udemy
www.udemy.com/course/gcp-professional-dataengineer-certification-a-complete-guide/
thanks man!
Glad it was helpful!
Dataflow isn’t the most widely used component in the Google Cloud Platform. Even if you Google this question, the sensible response is Compute Engine because it runs under pretty much all the other services, but also because a lot of companies do a lift and shift to cloud before integrating with the other services. You claim this twice at the beginning of the video, but it’s incorrect
What about airflow ?
Can’t integrate airflow (cloud composer) with vm instances on gcp.
Apologies for the wrong information. Yes Compute engine is base for all, I agree. It really depends on the business use cases.
It is widely used to orchestrate big data pipelines..In GCP airflow is in built with Composer but you can run independently as well.
Couldn't understand. Complicated...
Sorry to hear that. Ill try to break it down in upcoming videos. Please keep an eye on it
very confusing ......as you keep jumping from 1 screen to another.....
Sorry to hear. Can you use playback speed option in youtube to reduce the speed of video. Hope it helps
make little bit slow
Sure
head_usa_names share the file
you can find it in github