Видео

In terms of automation how this data transfer process can be automated like pub/sub --> dataflow job --> Big Query, the moment data arrive in the GCP pub/sub... pipeline job should trigger automatically and store data into Big Query

Please provide this code github link bro

How Can we use Jenkins/Github Actions/GCP Cloud Build CICD to run ETL pipelines? Please make that type projects bro....

This Excellent....Simple, but more powerful

Yeah, as usual its Awesome....Can you make other GCS, pubsub triggers also in gcloud CLI ?

We need seperate playlist with More Complex Real-time Projects by combining Many GCP services with Architecture Charts.... please make Projects series....

Bro...in AWS iam easily configuring Roles, Secret Access keys config, but in GCP Bit confusing while assign Roles, so I got IAM error in my Fusion Pipeline, i created my own SA with owner Role and attached with Fusion Job, but it shown IAM error...i forgot to take screenshot....

Can we do it directly by gcloud deploy command without build & push docker image to Artifact Registry?

Can we put alias small link instead lengthy link?

Excellent video....Nothing bored, one Fast solution for postgreSQL at single place wth CLI👍👏🚀

How can i export the bq table as pipe separated values in txt file?

what if we need to export the query results!!.. and in these three different modes of data extractions (batch export, export query results, and Streaming reads ) which is one very cheap and whats the difference between batch export and export query results can you please help me with these doubts!

Under the storage account box, I keep seeing a pop up that says there's an issue validating the resource due to which I am not able to proceed with creating the workspace. What should I do?

Just wanted to ask a question, if I upload a folder with same name which is already there in the bucket, will it overwrite the folder in the bucket or throw an error?

Hi, Do we have soft delete for the bucket as a whole

Anyhow i learnt many Topics from your Videos easily, Just commenting easy, but Ur Efforts behind this Videos Great appreciable🎉👏🤝🙏....I searched 15+ channels, i found 3 best for GCP-DE [ Techtrapture, Cloud AI Analytics, Anjan-GCP Data Engineering channels]

Helpful video

Hi, I need to check the size of the storage bucket. What command should I use for that?

This is simply superb

Like in DevSecOps (sonarqube, trivy, docker scout....etc), do we have security scanning Tools in ETL pipelines also for filtering bugs, vulnerabilities....etc?

Your videos Awesome....we wish more complex Data ETL pipeline Projects from you please

I got errors, what's the pre-set up to run python codes in VSCode for BigQuery....Any plugins, commands need to install... please make clear video on it bro....

Its nices session....how can we display this BigTable data into PySpark Dataframe?

Sometimes you confusing by mixup many irrelevant things, CLI most powerful & much easier, why again u mixup console ack, thtswhy 50% i confused bro

Hi Bro...i tried similar fusion project....i got IAM permission error, even i given Editor. Owner Roles also....

Its nice bro....but i haven't find replicasets, namespaces, GKE cluster full details in GUI dashboard like ArgoCD, datadog....etc concepts videos in this series

Thanks ! it is excellent !!

i did this spanner for just 20 minutes, it charged me 585/-, its too costly

Its Limited Period Recycle Bin type i guess and it giving versioning restore facility as in github commits

Editor Role only enough or Storage Admin, Bquery Admin Roles are needed?

Low voice.... please improve it

Hi friend, I am implementing from postgreSql to mssql, I am able to insert data but when I do transformation in the middle of the process, I got this error: Cannot call getSchema when there is no schema any idea what would happen? I can share with you the code: def run(): LogicalType.register_logical_type(MillisInstant) with beam.Pipeline() as p: output = ( p | 'Read from PosgreSql' >> ReadFromJdbc( table_name='table', driver_class_name='org.postgresql.Driver', jdbc_url='jdbc:postgresql://1.1.1.1:5432/db', username='sa', password='12345', query='SELECT * FROM table LIMIT 1' ) | 'Modify data' >> beam.ParDo(ModifyData()) | "Insert into SQL" >> WriteToJdbc( table_name='table', driver_class_name='com.microsoft.sqlserver.jdbc.SQLServerDriver', jdbc_url='jdbc:sqlserver://11.1.1.1:1433;databaseName=db;encrypt=false', username='sa', password='12345', ) )

time waste video

how can i do if the data from gheet?

How that Fruit symbols came in python code....

Please explain from scratch....u skipped major tasks by telling Already created, Is this playlist only for Advanced people or Even Non-IT Freshers like me?

It's just introduction....3 weeks gone, still No videos, i hope u forgot/ignore Terraform for GCP

Hey! Thanks for the video But the Github link is not working. Getting 404 error

Very helpful. Thanks

Please try to improve Video Upload Quality

hello.... in youtube there is no proper lectures on GCP Dataflow.... is there any proper document or any resources.... to know.... what all we can do in dataflow..... everyone explain just a basic wordcount program or explains only filter,map .......... not getting what all the tasks we can do in dataflow... and what are the real time scenarios or task we get to do in it

Thank you for the detailed walk-through!

Could you tell me how can I install Azure? Or we have to do this on website?

Thanks Dude 😊

Great teaching sir.. 👍 please cover all topics of apache beam 🙏

Nice explanation

Thanks a lot man ! <3

Thanks for the video. I have a question..... Is that possible to restrict "Update" a project (name) through the Lien Restriction? TIA

This is very helpful. Could you point me a video or create one on how to upgrade data fusion ? There are pipelines connected. How to do it safely. This video is very helpful.

Hi admin, Very nice explanation. do you have a free coupon/ discount voture for Snow Pro Core Certification registration?