hi, is there any way to do this for saving multiple output files to blob storage? I am using foreach activity to hit multiple Api links and then store data of each web activity to a separate Json file in blob storage
Good video however one tiny but crucial part is missing, if you want to save only proper json without web activity metadata you need to fetch only response property in activity.output.
i tried the scenario but in my case the response is binary file(.zip file) while writing the BLOB loc it's getting corrupted. however i check the API using postman/python the response is .zip and data is looks good.
Instead of using share access token, can we use the key access or create a key vault. If I am not here and it expires it will be hard to figure this out
I'm trying to do the same thing but in my case, it's showing an error. I don't know why. I'm using my company synapse account so is it possible this is some kind of firewall error.
May I know what error you are getting? The step at which error pops up. Make sure you have set up SAS correctly for the storage account and using the correct URL.
This is the most accurate and to the point info to get the output of a Web into a blob. Found this after 3 days of messing around with this.
I searched for this solution in internet , finally found here . Great explaination :) thanks
Glad it helped! Thanks
Explained the task in an Excellent way! Great work.
Thanks 👍
@@CloudKnowledgeChannel Thanks for the Clear explanation - i have a question what if my response is in XML format ?
Good explanation.... This helped me in my task
Glad to hear that 👍
Can we dynamically create a file like appending date at the end
Is it possible to store the output with a dynamic file name in the blob container, e.g. the pipeline runid?
good shareing, thank you.
Thank you 😊
hi, is there any way to do this for saving multiple output files to blob storage? I am using foreach activity to hit multiple Api links and then store data of each web activity to a separate Json file in blob storage
Using web activity to put the file into adls like you have done, is there any file size limitation?
Good video however one tiny but crucial part is missing, if you want to save only proper json without web activity metadata you need to fetch only response property in activity.output.
Thank you, great job!
Thank you
how to append data in the file in blob when web activity is in for each loop
i tried the scenario but in my case the response is binary file(.zip file) while writing the BLOB loc it's getting corrupted.
however i check the API using postman/python the response is .zip and data is looks good.
Please share sample endpoint details to test.
If you have already tried, kindly unzip file after loading it to container
Instead of using share access token, can we use the key access or create a key vault. If I am not here and it expires it will be hard to figure this out
same question. Did you get any solution?
Can you please do one with synapse. I am trying ur prbut I am not getting the same result
Sure let me try and post a video.
Share the link please
How to set filename like everytime it should create or save a file with different file name😊
Please explain exact usecase
12:24 hey i didnt get it whats the use of header and why are we specifiying the name as x-ms-blob-type and Value as BlockBlob ? can you please explain
Refer: learn.microsoft.com/en-us/rest/api/storageservices/put-blob?tabs=azure-ad#request-headers-all-blob-types
@@CloudKnowledgeChannel hey , i am asking what is the reason we are putting that header
Read the page for your knowledge
@@CloudKnowledgeChannel i did read it but didnt find anything useful :( , could you just help me out with it ?
I'm trying to do the same thing but in my case, it's showing an error. I don't know why. I'm using my company synapse account so is it possible this is some kind of firewall error.
May I know what error you are getting?
The step at which error pops up.
Make sure you have set up SAS correctly for the storage account and using the correct URL.
@@CloudKnowledgeChannel I am getting error when I am trying to debug to get data.
what is SAS correctly for the storage account?
@@souranwaris142 revisit the video to see what is Sas url and state what Error message you recieve
While saving to json in second web activity, i am getting error as not authorised ,can you help
Check Adls account container permissions
Same error could you fix it? I have an authorised error when i debug