Hi Pablo..I need help. I have multiple csv file in a gcp bucket and I have to archive this to another folder of same bucket. How I can do this by python in gcp. How I will define all file in blob name. Any help is appreciated.
Is it possible to create a google cloud function using the REST API, without having to manually click through each interface each time you want to create a CRON?
Using cloud functions and python I created a file and trying to write it to GCS. The function is ending successful but the file is not created in the bucket. Can you please help?
Hi my friend, do you know how to run an existing Cloud Scheduler Job, from Golang or NodeJS ( any client library ), and that the body can be dinamic? so I can send different payload with different params to the Job and the job send the body to the function.
I haven't done anything special besides whah I have shown. Let me try it out again and see if I can reproduce. Meanwhile you can also create a support chat and ask them.
@@CloudAdvocate oh ok. Can you check if your App Engine region? Also can you tell me which account the cloud function is running under and what permissions it has?
This is really helpful video but in my scenario the scheduling is done from a frontend application. Basically this is an old application which was using Quartz scheduler and now we are migrating to Cloud, so was thinking of using Cloud scheduler. But the data/ scheduling information is maintained from front end for Quartz, now how do i do that in case of Cloud scheduler ?
Hi Rajat, I am not sure about Quartz, but you might have to migrate the scheduling part to cloud scheduler and re-write each one of them in CF or somewhere in cloud to call as an API. Or you can first write scheduling functions to CF as a first stage and then call via API using Quartz. Again, I am not sure ...pure speculation :D
I has some code which uses the google cloud, storage module it gave me error in cloud functions the module was not there. Can you help me with the process the get this in cloud functions to run my code successfully
I am getting the following error while trying to access the google.cloud. ImportError: cannot import name 'storage' from 'google.cloud' (unknown location) Any suggestion on how to load it first?
@@CloudAdvocate yes. But i figured out the issue .The Google.cloud module need to go in requirement.txt .One separate question.Is there a way to acess /tmp path in cloud function
Hi Sir, this is a great video, thanks for the info but i would like to know how could i do the same script but the destination bucket is in another project. Thanks you a lot!
How Can I connect with you? I've some sort of queries and doubts. Because I just want to switch my profile. I'm having around 5-year of experience as a developer. So which one I've to choose b/w these step by step.
Hi Atul, You can check my connectivity details on about section of RUclips channel.
4 года назад
I have a script in node js, the script get some informations from google api, and then change my channel description for example, every minute. How can I use that on google cloud? I'm rly noob :c
The flow would be similar as what's described in the video. You would create cloud function (node js) and call the gcp api. Schedule it run every min in the scheduler.
4 года назад
@@CloudAdvocate but how can I import library that I need to run my script if doesn't have a console on cloud functions to install the dependences?
Hi, Thanks for the video, it's very helpful. I'm getting below error - whilst trying to create the cloud_function - Please help me to debug it Deployment failure: Function failed on loading user code. This is likely due to a bug in the user code. Error message: Code in file main.py can't be loaded. Detailed stack trace: Traceback (most recent call last): File "/env/local/lib/python3.7/site-packages/google/cloud/functions/worker_v2.py", line 359, in check_or_load_user_function _function_handler.load_user_function() File "/env/local/lib/python3.7/site-packages/google/cloud/functions/worker_v2.py", line 236, in load_user_function spec.loader.exec_module(main_module) File "", line 728, in exec_module File "", line 219, in _call_with_frames_removed File "/user_code/main.py", line 2, in from google.cloud import storage ImportError: cannot import name 'storage' from 'google.cloud' (unknown location) Many Thanks !
I love this company but don't have enough money to invest into it at this point in time my credit cards have going on burned-out soul I have to get back to them sooner or later having problems on the internet as as assets
Hi Pablo..I need help. I have multiple csv file in a gcp bucket and I have to archive this to another folder of same bucket. How I can do this by python in gcp. How I will define all file in blob name. Any help is appreciated.
Is it possible to create a google cloud function using the REST API, without having to manually click through each interface each time you want to create a CRON?
Using cloud functions and python I created a file and trying to write it to GCS. The function is ending successful but the file is not created in the bucket. Can you please help?
Hi my friend, do you know how to run an existing Cloud Scheduler Job, from Golang or NodeJS ( any client library ), and that the body can be dinamic? so I can send different payload with different params to the Job and the job send the body to the function.
How to install python libraries like pandas , google-bigquery etc for cloud function?
Can you please upload cloud function that triggers cloud storage and use cloud schedule for run
Please suggest any complete course for GCP Associate Prep
Does just having cloud function invoke role is enough? It still doesn't work for me. Which account does the function run as?
What error do you see in logs?
@@CloudAdvocate UNAUTHENTICATED
Do the App Engine and Cloud Function need to be in the same region for this to work?
I haven't done anything special besides whah I have shown. Let me try it out again and see if I can reproduce. Meanwhile you can also create a support chat and ask them.
@@CloudAdvocate oh ok. Can you check if your App Engine region? Also can you tell me which account the cloud function is running under and what permissions it has?
Hi, I tried to deploy the function with the code you have provided but I got error
thank you @Cloud Advocate, It was very util for me!!!
Thanks. You have greatly explained it.
Hi brother....ur videos are short n crisp.....still i am having so much of doubts....is it possible i can talk to you .??
I have a doubt. How to implement 2 functions together ? What will be the function name ?
Superb video ...very informative.
Hi, very informative.
how does automating/scheduling the switching ON n OFF process of an instance work?
You have to write the logic in compute and trigger that from scheduler.
excellent tutorial! many thanks!
Thank you GK, it's Awesome.
Do you have any similar demonstration to trigger the Batch Jobs in GCP Data Flow.
Hello @LeelaGCP have you found a solution to your question. I too want to know how to do it
is there a way to perform incremental load (GCP bucket to BQ) using Dataprep and data flow, please help
cloud.google.com/solutions/streaming-data-from-cloud-storage-into-bigquery-using-cloud-functions this should work for you.
thank you @Cloud Advocate, one question , what is the trigger for function ? min 3:40 .
HTTP end point.
@@CloudAdvocate Thanks its working perfect
This is really helpful video but in my scenario the scheduling is done from a frontend application. Basically this is an old application which was using Quartz scheduler and now we are migrating to Cloud, so was thinking of using Cloud scheduler. But the data/ scheduling information is maintained from front end for Quartz, now how do i do that in case of Cloud scheduler ?
Hi Rajat, I am not sure about Quartz, but you might have to migrate the scheduling part to cloud scheduler and re-write each one of them in CF or somewhere in cloud to call as an API. Or you can first write scheduling functions to CF as a first stage and then call via API using Quartz. Again, I am not sure ...pure speculation :D
thank you so much for saving my day
I has some code which uses the google cloud, storage module it gave me error in cloud functions the module was not there.
Can you help me with the process the get this in cloud functions to run my code successfully
Make sure you put the module in requirements.txt
@@CloudAdvocate just the module name will do right?
cloud.google.com/functions/docs/writing/specifying-dependencies-python
Awesome video. After I did everything in the video it still gives me an error. It runs the code but it shows error??
Thank you! Really helpful
How can schedule based on success of other jobs?
Please tell the required certifications and languages to switch from software development to cloud engineering.
You don't need certifications to learn cloud. Try to start with basics of cloud computing and then get cloud certification of your choice.
I am getting the following error while trying to access the google.cloud.
ImportError: cannot import name 'storage' from 'google.cloud' (unknown location)
Any suggestion on how to load it first?
Are you getting this in cloud function?
@@CloudAdvocate yes. But i figured out the issue .The Google.cloud module need to go in requirement.txt .One separate question.Is there a way to acess /tmp path in cloud function
I don't think you can. I have never tried though.
Hi Sir, this is a great video, thanks for the info but i would like to know how could i do the same script but the destination bucket is in another project.
Thanks you a lot!
How Can I connect with you? I've some sort of queries and doubts. Because I just want to switch my profile. I'm having around 5-year of experience as a developer. So which one I've to choose b/w these step by step.
Hi Atul,
You can check my connectivity details on about section of RUclips channel.
I have a script in node js, the script get some informations from google api, and then change my channel description for example, every minute. How can I use that on google cloud? I'm rly noob :c
The flow would be similar as what's described in the video. You would create cloud function (node js) and call the gcp api. Schedule it run every min in the scheduler.
@@CloudAdvocate but how can I import library that I need to run my script if doesn't have a console on cloud functions to install the dependences?
In requirements cloud.google.com/functions/docs/quickstart-nodejs
@@CloudAdvocate bit other librarys, like Google api, etc, How can I install the repository?
cloud.google.com/functions/docs/writing/specifying-dependencies-nodejs its documented here to install npm modules.
Thanks a lot for the video.
I'm trying to schedule a colab execution daily, is that possible?
Good one.
How can we expose this http cloud function to public with the authentication?
With Service account credentials or best usng api gateway
Hey, Great Video. Could you post a video for the Jenkins CI-Cd pipeline with GCP?
Will do !! thank you.
I’ve been getting that error about permission and could not figure it out! THANK YOU
Great one ...it helped me a lot
Hello, how send POST with Headers in cloud scheduler?? pls help
Very good question Antonio, I found a good article stackoverflow.com/questions/53181297/verify-http-request-from-google-cloud-scheduler
Hi, very informative video. Is it possible to Enable and Disable App Engine using cloud scheduler ? Thanks in advance.
I would use cloud function to do that and schedule using scheduler.
Hello, thanks for this video, excellent job, but i have a question...what version python you used?
I guess I used python 3.6
Hi,
Thanks for the video, it's very helpful.
I'm getting below error - whilst trying to create the cloud_function - Please help me to debug it
Deployment failure:
Function failed on loading user code. This is likely due to a bug in the user code. Error message: Code in file main.py can't be loaded.
Detailed stack trace:
Traceback (most recent call last):
File "/env/local/lib/python3.7/site-packages/google/cloud/functions/worker_v2.py", line 359, in check_or_load_user_function
_function_handler.load_user_function()
File "/env/local/lib/python3.7/site-packages/google/cloud/functions/worker_v2.py", line 236, in load_user_function
spec.loader.exec_module(main_module)
File "", line 728, in exec_module
File "", line 219, in _call_with_frames_removed
File "/user_code/main.py", line 2, in
from google.cloud import storage
ImportError: cannot import name 'storage' from 'google.cloud' (unknown location)
Many Thanks !
Did you import the storage library in requirements.txt?
@@CloudAdvocate - No, Can you please fetch link here, steps to export . Thanks
Please follow the link cloud.google.com/functions/docs/writing/specifying-dependencies-python
@@CloudAdvocate Thanks
@@CloudAdvocate - Can I get the comments added in requirments.txt, like you supplied for main.py ? Somehow it's not working for me.
Genial gracias bro
I love this company but don't have enough money to invest into it at this point in time my credit cards have going on burned-out soul I have to get back to them sooner or later having problems on the internet as as assets
You get 300$ credits from Google.
slick
i love you