I have just completed 85 videos. What a effort Maheer! You explained almost every details in ADF with practical demos. I learned a lot, a lot, a a lot... I am planning to continue with PowerBi and also ADF real time scenario playlists. I really appreciate for your effort on these playlists. Thank you Maheer, Gracias, Arigatōgozaimashita, Xièxiè nǐ, Tesekkurler, Shukran, JazakAllah, Shukriya......
Bro meeru flawless unnaru andukey emo Microsoft mee daka vachindi … talent got recognised …. Preparing for interviews through your videos much help full
I am holding multiple job offers just because of you and your videos. Thank you so much! Your videos are very easy to understand. Keep making such videos 🎉
How to read an error message from DataFlow if failed? I tried to use expression like this "@{activity('Run DataFlow').output.errors[0].Message}" to read error message from my DataFlow activity. But there is no such expression to read the exact error message from DataFlow.
Thanks for the video ,you have added your email id in action to send failure notification email but in real world production scenario how does it get handled?
I'm doing just as mentioned in the video but I'm unable to capture the error message in the email alert that I'm receiving. Is there something that I'm doing wrong, could you let me know what could be the issue
its working when we are doing using directly web activity but when we are inserting web activity in pipeline and using same statement of error message through parameter it's not working. Every other parameter except error message are coming in email. How to do that?
Hi, your videos are really interesting. I have a scenario where I need to send pipeline, activity and time taken for execution for each pipeline in a mail body. Can you help how can I achieve it. I have set up the log analytics for adf and able to run the KQL to get the results. This results need to passed over the email body to business user. Please help
Great explanation . Can we replicate this on our Azure DevOps pipeline while creating infra changes for eg . my YAML pipeline creates an storage account and if it fails or succeeds i want the pipeline to send mail . can we use logic app here ?
Very helpful videos u are making for azure but some advanced topics are missing. Eagerly waiting for those advanced topic videos. One of them mentioned in the chat
@WafaStudies in the email section from Logic App , I have given an email in the "To" section , but I am getting "message": "Email format of a sender or at least one recipient is incorrect." I tried giving semicolon at the end of the email but still getting the error , Could you suggest me how to proceed with this?
Hi @WafaStudies.. thanks for detailed videos on ADF. Can you please help to handle one scenario in ADF ? I need to get response from REST API which will response data in jsonline format (not json array) . How in ADF can read jsonline API response ? in REST API, jsonline seems not to be supported.
This was failing on a notebook activity because the error included a “ which caused everything to break. I did a replace in the expression builder which solved it.
In my pipeline i am using more than one activity. I need to send email for 2 scneario 1. When the file is not present 2. When the value of the file is wrong So my question is for verifying these two do i need to have 2 logic app ?
Can anyone pls help to get exact error message of failed activity. Code that i used is like - @('activity').output.errors[0].message But getting error msg as failed to parse any special character. Thanks!
I am getting this error Error code 2108 Troubleshooting guide Failure type User configuration issue Details {"error":{"code":"InvalidRequestContent","message":"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: e. Path 'pipelinename', line 3, position 1.'."}} Thanks
@@samcool1504 { "Pipeline":"@{pipeline().Pipeline}", "Subject":"An error has occured in the Gov Cloud @{pipeline().Pipeline}-pipeline!", "ErrorMessage":"@{activity('Copy data1').Error.message}", "DataFactoryName":"@{pipeline().DataFactory}", "Runid":"@{pipeline().RunId}" } Go back to your logic app and in the click on the email activity and , click on RUN and chose the option "RUN With Payload", in the body type the following code { "Subject": "This is a TEST email" } Now run and save the logic app, comeback to your pipeline and run it.
I have just completed 85 videos. What a effort Maheer! You explained almost every details in ADF with practical demos. I learned a lot, a lot, a a lot... I am planning to continue with PowerBi and also ADF real time scenario playlists. I really appreciate for your effort on these playlists. Thank you Maheer, Gracias, Arigatōgozaimashita, Xièxiè nǐ, Tesekkurler, Shukran, JazakAllah, Shukriya......
Thank you for kind words ☺️
Bro meeru flawless unnaru andukey emo Microsoft mee daka vachindi … talent got recognised …. Preparing for interviews through your videos much help full
Thank you bro 🙂
I am holding multiple job offers just because of you and your videos. Thank you so much! Your videos are very easy to understand. Keep making such videos 🎉
Congratulations 🎉👏🎉
Hi bro.
ADF, ADLS, SQL Server. Are these skills enough to get a job (2 years. exp.) ?
Kindly guide me.
@@swagatmohanty5818 yes
Thank you for putting lot of hard work for us..best tech related channel on RUclips...... can't thank you enough
Thank you for your kind words 🙂
Spot on!!
Can you please do a video on reading a file from SharePoint online Document library to Azure ADLS/ BLOB using ADF.
Could you also please post how to identify the cost for these services ? Great Video. Thanks!
As usual, keeping quality maintained.
Thank you 😊
Much needed .. Thanks for covering😀
Thank you 🙂
O365 deprication with teams, now we have to implement the workflow by power automate. Could you please explain me how to do this?
Thank you for the detailed explanation. It is really helpful!
How to read an error message from DataFlow if failed? I tried to use expression like this "@{activity('Run DataFlow').output.errors[0].Message}" to read error message from my DataFlow activity. But there is no such expression to read the exact error message from DataFlow.
Even i need an expression to evaluate the error msg. Pls let me know if u got the answer
Thanks for the video ,you have added your email id in action to send failure notification email but in real world production scenario how does it get handled?
How can we get the name of the activity to send inside the mail body
I really appreciate your efforts.
Thank you 😊
hi maheer bro i am fan of your content..
tq so much
Thank you ☺️
I'm doing just as mentioned in the video but I'm unable to capture the error message in the email alert that I'm receiving. Is there something that I'm doing wrong, could you let me know what could be the issue
its working when we are doing using directly web activity but when we are inserting web activity in pipeline and using same statement of error message through parameter it's not working.
Every other parameter except error message are coming in email. How to do that?
Could be done in a better way...using datafactory restapi's
Or else if we don't need custom message we can configure alerts directly in the ADF
Thanks,great efforts ❤
@Maheer, My question is how to send a notification when all pipelines under a data factory. Much appreciated your help.
Hi , do we have any other ways to send emails from ADF ( other than logic app)? Like graph api or any other? Thanks
Hi, your videos are really interesting.
I have a scenario where I need to send pipeline, activity and time taken for execution for each pipeline in a mail body.
Can you help how can I achieve it.
I have set up the log analytics for adf and able to run the KQL to get the results.
This results need to passed over the email body to business user. Please help
Great explanation . Can we replicate this on our Azure DevOps pipeline while creating infra changes for eg . my YAML pipeline creates an storage account and if it fails or succeeds i want the pipeline to send mail . can we use logic app here ?
Very helpful videos u are making for azure but some advanced topics are missing. Eagerly waiting for those advanced topic videos. One of them mentioned in the chat
How to check whether this logic is already implemented or not?
@WafaStudies in the email section from Logic App , I have given an email in the "To" section , but I am getting "message": "Email format of a sender or at least one recipient is incorrect." I tried giving semicolon at the end of the email but still getting the error , Could you suggest me how to proceed with this?
How much will it cost to use using Azure logic apps to send the failure ADF pipelines email notifications?
Hi @WafaStudies.. thanks for detailed videos on ADF. Can you please help to handle one scenario in ADF ? I need to get response from REST API which will response data in jsonline format (not json array) . How in ADF can read jsonline API response ? in REST API, jsonline seems not to be supported.
can we reuse this web activity? or we can create for all pipelines manually?
This is a very helpful video. Can we also use one web activity for multiple pipelines? If yes, how can it be done?
Great work again mate.
can u please add a video on 'email alert when a data is inserted into a synapse view/dmv using adfv2/logicapp'
can we log error messages to csv file ?? can you please make video on that , if we want to capture errors from multiple activities
wow..what an effort 👍👍
Useful for interview thanks it was very helpful
Thank you Maheer bro :)
This was failing on a notebook activity because the error included a “ which caused everything to break. I did a replace in the expression builder which solved it.
very good video, helpful
Thank you 😊
Hi Can we attached file in send email?
sir agar mera account free hai or me agar resource group banaata hu
or agar me usko 3 din baad delete maaru toh koi problem thodi hai??
In my pipeline i am using more than one activity. I need to send email for 2 scneario
1. When the file is not present
2. When the value of the file is wrong
So my question is for verifying these two do i need to have 2 logic app ?
can we attache file in email here.
Is Logic App Pricing expensive?
Life Saver!!!!!!!Hats Offfffffff
thanks for this video! it´s amazing and helpful
Hello Sir, i am new to data factory. How much of coding is needed for this profile
Very less
in one pipeliene how to use multiple copy data sets
Can anyone pls help to get exact error message of failed activity.
Code that i used is like -
@('activity').output.errors[0].message
But getting error msg as failed to parse any special character.
Thanks!
Great Content ..!
Thank you 🙂
Thanks a lot foe the informative video. We can also the below logic to replace the "][ -
regexReplace(StringList, '["\\[\\]]', '')
you are the Best
I am getting this error Error code
2108
Troubleshooting guide
Failure type
User configuration issue
Details
{"error":{"code":"InvalidRequestContent","message":"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: e. Path 'pipelinename', line 3, position 1.'."}}
Thanks
I'm getting the same error
@@samcool1504 I figured it out. Check your code, you must be having a ) instead of }
@@bvkandala can you help share the code snippet ? I seem to be having } in the dynamic content section.
@@samcool1504 what's your email id, and where did you check the code? In the web activity body?
@@samcool1504 {
"Pipeline":"@{pipeline().Pipeline}",
"Subject":"An error has occured in the Gov Cloud @{pipeline().Pipeline}-pipeline!",
"ErrorMessage":"@{activity('Copy data1').Error.message}",
"DataFactoryName":"@{pipeline().DataFactory}",
"Runid":"@{pipeline().RunId}"
}
Go back to your logic app and in the click on the email activity and , click on RUN and chose the option "RUN With Payload", in the body type the following code
{
"Subject": "This is a TEST email"
}
Now run and save the logic app, comeback to your pipeline and run it.
awsome bro
Thank you 😊
11:23 Enter Email on Log In
thanks a lot :)
Welcome ☺️
Perfect..
👍
Who care your intentions buddy, you showing to baby data engineers. Atleast you just show minimum level automation instead of manual mode