Good video however one tiny but crucial part is missing, if you want to save only proper json without web activity metadata you need to fetch only response property in activity.output.
Instead of using share access token, can we use the key access or create a key vault. If I am not here and it expires it will be hard to figure this out
i tried the scenario but in my case the response is binary file(.zip file) while writing the BLOB loc it's getting corrupted. however i check the API using postman/python the response is .zip and data is looks good.
I'm trying to do the same thing but in my case, it's showing an error. I don't know why. I'm using my company synapse account so is it possible this is some kind of firewall error.
May I know what error you are getting? The step at which error pops up. Make sure you have set up SAS correctly for the storage account and using the correct URL.
I searched for this solution in internet , finally found here . Great explaination :) thanks
Glad it helped! Thanks
Explained the task in an Excellent way! Great work.
Thanks 👍
@@CloudKnowledgeChannel Thanks for the Clear explanation - i have a question what if my response is in XML format ?
Good explanation.... This helped me in my task
Glad to hear that 👍
good shareing, thank you.
Thank you 😊
Is it possible to store the output with a dynamic file name in the blob container, e.g. the pipeline runid?
Using web activity to put the file into adls like you have done, is there any file size limitation?
Can we dynamically create a file like appending date at the end
Thank you, great job!
Thank you
Good video however one tiny but crucial part is missing, if you want to save only proper json without web activity metadata you need to fetch only response property in activity.output.
Instead of using share access token, can we use the key access or create a key vault. If I am not here and it expires it will be hard to figure this out
same question. Did you get any solution?
how to append data in the file in blob when web activity is in for each loop
i tried the scenario but in my case the response is binary file(.zip file) while writing the BLOB loc it's getting corrupted.
however i check the API using postman/python the response is .zip and data is looks good.
Please share sample endpoint details to test.
If you have already tried, kindly unzip file after loading it to container
Can you please do one with synapse. I am trying ur prbut I am not getting the same result
Sure let me try and post a video.
Share the link please
12:24 hey i didnt get it whats the use of header and why are we specifiying the name as x-ms-blob-type and Value as BlockBlob ? can you please explain
Refer: learn.microsoft.com/en-us/rest/api/storageservices/put-blob?tabs=azure-ad#request-headers-all-blob-types
@@CloudKnowledgeChannel hey , i am asking what is the reason we are putting that header
Read the page for your knowledge
@@CloudKnowledgeChannel i did read it but didnt find anything useful :( , could you just help me out with it ?
While saving to json in second web activity, i am getting error as not authorised ,can you help
Check Adls account container permissions
Same error could you fix it? I have an authorised error when i debug
I'm trying to do the same thing but in my case, it's showing an error. I don't know why. I'm using my company synapse account so is it possible this is some kind of firewall error.
May I know what error you are getting?
The step at which error pops up.
Make sure you have set up SAS correctly for the storage account and using the correct URL.
@@CloudKnowledgeChannel I am getting error when I am trying to debug to get data.
what is SAS correctly for the storage account?
@@souranwaris142 revisit the video to see what is Sas url and state what Error message you recieve
How to set filename like everytime it should create or save a file with different file name😊
Please explain exact usecase