Hi anjan, you have mentioned to reference architectural diagram at top of the slide but at the top you have given steps. Which architectural diagram you are referring to.
Thanks a lot for the video. It's really helpful. Just one question - I need to take data from Oracle on premise and dump it to BigQuery . Is there any article or document which can be referred for using Apache Beam in Python ? I tried to search but could not get much details . Any input would be appreciated
Thanks for the very useful information. I tried same example in my gcp project but getting Traceback (most recent call last): File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.9/runpy.py", line 87, in _run_code exec(code, run_globals) File "/home/learningtrading17/bulkdeal_aggr.py", line 4, in import apache_beam as beam ModuleNotFoundError: No module named 'apache_beam' -bash: --temp_location: command not found Could you please help me on this error..
@@anjangcpdataengineering5209 I ran pip install 'apache-beam[gcp]' on virtual environment Collecting google-auth=1.18.0 Using cached google_auth-1.34.0-py2.py3-none-any.whl (152 kB) Using cached google_auth-1.33.1-py2.py3-none-any.whl (152 kB) it is not moving ahead after reaching above steps..
Hello Anjan,
Please provide dump data in description for all your videos so that it is easy to follow your procedure. Thanks
Hi anjan, you have mentioned to reference architectural diagram at top of the slide but at the top you have given steps. Which architectural diagram you are referring to.
Thanks a lot for the video. It's really helpful. Just one question - I need to take data from Oracle on premise and dump it to BigQuery . Is there any article or document which can be referred for using Apache Beam in Python ? I tried to search but could not get much details . Any input would be appreciated
Please wait for next video , you will see one such use case . I will publish that video by this weekend .
Good contents on Dataflow...could you also pls share the bulk.csv file .. its not uploaded on repo
thanks for your session, May i know how to schedule this job. consider daily at 1 AM morning ?
Thank you
Hii anjan...could you please create a pipeline ...extracting data from differrent sources like onprem and cloud and load it into gcp
Hello Anjan, Thanks for this video. Can you please provide the csv files?
Hi Anjan, I feel if you try giving a simple example it will be easier for beginner.
Hi, i have already done that ,pls check Dataflow play list , thanks for your feedback.
How to schedule these sir
Hi sr, your teaching way is extradonary. can you please share the csv file also.
Hi can you share sample xl data file this video
Thanks for the very useful information. I tried same example in my gcp project but getting
Traceback (most recent call last):
File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/learningtrading17/bulkdeal_aggr.py", line 4, in
import apache_beam as beam
ModuleNotFoundError: No module named 'apache_beam'
-bash: --temp_location: command not found
Could you please help me on this error..
Are you trying this in cloud shell ? or some Jupiter note book?
@@anjangcpdataengineering5209 I am trying on Cloud Shell
@@kesavaram5401 install Apache beam for GCP on python virtual environment and try , hope it will work
@@anjangcpdataengineering5209 I ran pip install 'apache-beam[gcp]' on virtual environment
Collecting google-auth=1.18.0
Using cached google_auth-1.34.0-py2.py3-none-any.whl (152 kB)
Using cached google_auth-1.33.1-py2.py3-none-any.whl (152 kB)
it is not moving ahead after reaching above steps..
bro u want more sub plz add github path........................