23. Send Email alert when Pipeline fails in Azure Data Factory

Поделиться
HTML-код
  • Опубликовано: 18 сен 2024

Комментарии • 80

  • @ArabaEfsanesi
    @ArabaEfsanesi 3 года назад +14

    I have just completed 85 videos. What a effort Maheer! You explained almost every details in ADF with practical demos. I learned a lot, a lot, a a lot... I am planning to continue with PowerBi and also ADF real time scenario playlists. I really appreciate for your effort on these playlists. Thank you Maheer, Gracias, Arigatōgozaimashita, Xièxiè nǐ, Tesekkurler, Shukran, JazakAllah, Shukriya......

    • @WafaStudies
      @WafaStudies  3 года назад

      Thank you for kind words ☺️

  • @nitishsalunke
    @nitishsalunke 3 года назад +7

    I am holding multiple job offers just because of you and your videos. Thank you so much! Your videos are very easy to understand. Keep making such videos 🎉

    • @WafaStudies
      @WafaStudies  3 года назад +1

      Congratulations 🎉👏🎉

    • @swagatmohanty5818
      @swagatmohanty5818 3 года назад +4

      Hi bro.
      ADF, ADLS, SQL Server. Are these skills enough to get a job (2 years. exp.) ?
      Kindly guide me.

    • @RaviPrasadRAVIPDGUPTA
      @RaviPrasadRAVIPDGUPTA 4 месяца назад

      @@swagatmohanty5818 yes

  • @srisuman3996
    @srisuman3996 3 года назад +2

    Bro meeru flawless unnaru andukey emo Microsoft mee daka vachindi … talent got recognised …. Preparing for interviews through your videos much help full

  • @abhijeetpandey8052
    @abhijeetpandey8052 3 года назад +4

    Thank you for putting lot of hard work for us..best tech related channel on RUclips...... can't thank you enough

    • @WafaStudies
      @WafaStudies  3 года назад +1

      Thank you for your kind words 🙂

  • @cajaykiran
    @cajaykiran 3 года назад +2

    Spot on!!
    Can you please do a video on reading a file from SharePoint online Document library to Azure ADLS/ BLOB using ADF.

  • @shockey3084
    @shockey3084 3 года назад +2

    As usual, keeping quality maintained.

  • @AnnuKumari-mo6gz
    @AnnuKumari-mo6gz 3 года назад +2

    Much needed .. Thanks for covering😀

  • @itsartyficial1985
    @itsartyficial1985 2 месяца назад

    Useful for interview thanks it was very helpful

  • @prosinging7853
    @prosinging7853 3 года назад

    Very helpful videos u are making for azure but some advanced topics are missing. Eagerly waiting for those advanced topic videos. One of them mentioned in the chat

  • @deepakbehera498
    @deepakbehera498 6 месяцев назад

    Could you also please post how to identify the cost for these services ? Great Video. Thanks!

  • @ranjitreddy7918
    @ranjitreddy7918 2 года назад +1

    I really appreciate your efforts.

  • @johnpaulprathipati153
    @johnpaulprathipati153 2 года назад +1

    hi maheer bro i am fan of your content..
    tq so much

  • @viveknimmagadda2397
    @viveknimmagadda2397 Год назад

    Thank you for the detailed explanation. It is really helpful!

  • @iaminazure
    @iaminazure 3 года назад +2

    Could be done in a better way...using datafactory restapi's
    Or else if we don't need custom message we can configure alerts directly in the ADF

  • @user-md8ji1uo6q
    @user-md8ji1uo6q Год назад +1

    very good video, helpful

  • @bharathmamidisetti3896
    @bharathmamidisetti3896 25 дней назад

    Thanks,great efforts ❤

  • @chaudhryalisalam3668
    @chaudhryalisalam3668 Год назад

    Great work again mate.

  • @omkarkulkarni3346
    @omkarkulkarni3346 5 месяцев назад

    Thanks for the video ,you have added your email id in action to send failure notification email but in real world production scenario how does it get handled?

  • @joshiabhinav
    @joshiabhinav Год назад

    you are the Best

  • @rakeshpanigrahi577
    @rakeshpanigrahi577 3 месяца назад

    Thanks a lot foe the informative video. We can also the below logic to replace the "][ -
    regexReplace(StringList, '["\\[\\]]', '')

  • @kathirsubramaniam4597
    @kathirsubramaniam4597 3 года назад +2

    How to read an error message from DataFlow if failed? I tried to use expression like this "@{activity('Run DataFlow').output.errors[0].Message}" to read error message from my DataFlow activity. But there is no such expression to read the exact error message from DataFlow.

    • @vickygupta4263
      @vickygupta4263 Год назад

      Even i need an expression to evaluate the error msg. Pls let me know if u got the answer

  • @callmeruks
    @callmeruks Год назад

    Life Saver!!!!!!!Hats Offfffffff

  • @YasminS-e1l
    @YasminS-e1l 2 месяца назад

    O365 deprication with teams, now we have to implement the workflow by power automate. Could you please explain me how to do this?

  • @reshavraj4090
    @reshavraj4090 3 года назад +1

    Great Content ..!

  • @rk-ej9ep
    @rk-ej9ep Год назад

    wow..what an effort 👍👍

  • @MuppiriRajaVenkataPhanindraKum
    @MuppiriRajaVenkataPhanindraKum 4 месяца назад

    I'm doing just as mentioned in the video but I'm unable to capture the error message in the email alert that I'm receiving. Is there something that I'm doing wrong, could you let me know what could be the issue

  • @sarmisthasarkar3009
    @sarmisthasarkar3009 5 месяцев назад

    Hi @WafaStudies.. thanks for detailed videos on ADF. Can you please help to handle one scenario in ADF ? I need to get response from REST API which will response data in jsonline format (not json array) . How in ADF can read jsonline API response ? in REST API, jsonline seems not to be supported.

  • @jagadeeshpinninti3323
    @jagadeeshpinninti3323 2 года назад

    How much will it cost to use using Azure logic apps to send the failure ADF pipelines email notifications?

  • @samcool1504
    @samcool1504 2 года назад

    This is a very helpful video. Can we also use one web activity for multiple pipelines? If yes, how can it be done?

  • @abhineshlal2602
    @abhineshlal2602 5 месяцев назад

    its working when we are doing using directly web activity but when we are inserting web activity in pipeline and using same statement of error message through parameter it's not working.
    Every other parameter except error message are coming in email. How to do that?

  • @devtest8259
    @devtest8259 8 месяцев назад

    This was failing on a notebook activity because the error included a “ which caused everything to break. I did a replace in the expression builder which solved it.

  • @Niru-tj4fo
    @Niru-tj4fo Год назад

    Great explanation . Can we replicate this on our Azure DevOps pipeline while creating infra changes for eg . my YAML pipeline creates an storage account and if it fails or succeeds i want the pipeline to send mail . can we use logic app here ?

  • @hari7221
    @hari7221 2 года назад

    Hi , do we have any other ways to send emails from ADF ( other than logic app)? Like graph api or any other? Thanks

  • @shivabasayyahiremath6802
    @shivabasayyahiremath6802 2 года назад +1

    awsome bro

  • @surajviswakarma254
    @surajviswakarma254 Год назад

    Hi, your videos are really interesting.
    I have a scenario where I need to send pipeline, activity and time taken for execution for each pipeline in a mail body.
    Can you help how can I achieve it.
    I have set up the log analytics for adf and able to run the KQL to get the results.
    This results need to passed over the email body to business user. Please help

  • @robinthomas7782
    @robinthomas7782 3 года назад

    How can we get the name of the activity to send inside the mail body

  • @xelaCO14
    @xelaCO14 2 года назад

    thanks for this video! it´s amazing and helpful

  • @ramyanive1349
    @ramyanive1349 Год назад

    In my pipeline i am using more than one activity. I need to send email for 2 scneario
    1. When the file is not present
    2. When the value of the file is wrong
    So my question is for verifying these two do i need to have 2 logic app ?

  • @VenkatSanthoshh
    @VenkatSanthoshh 2 года назад

    @WafaStudies in the email section from Logic App , I have given an email in the "To" section , but I am getting "message": "Email format of a sender or at least one recipient is incorrect." I tried giving semicolon at the end of the email but still getting the error , Could you suggest me how to proceed with this?

  • @sankarvetti4404
    @sankarvetti4404 2 года назад +1

    thanks a lot :)

  • @bashabash3697
    @bashabash3697 Год назад

    How to check whether this logic is already implemented or not?

  • @bvkandala
    @bvkandala 2 года назад +1

    I am getting this error Error code
    2108
    Troubleshooting guide
    Failure type
    User configuration issue
    Details
    {"error":{"code":"InvalidRequestContent","message":"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: e. Path 'pipelinename', line 3, position 1.'."}}
    Thanks

    • @samcool1504
      @samcool1504 2 года назад +1

      I'm getting the same error

    • @bvkandala
      @bvkandala 2 года назад +1

      @@samcool1504 I figured it out. Check your code, you must be having a ) instead of }

    • @samcool1504
      @samcool1504 2 года назад +1

      @@bvkandala can you help share the code snippet ? I seem to be having } in the dynamic content section.

    • @bvkandala
      @bvkandala 2 года назад +1

      @@samcool1504 what's your email id, and where did you check the code? In the web activity body?

    • @bvkandala
      @bvkandala 2 года назад

      @@samcool1504 {
      "Pipeline":"@{pipeline().Pipeline}",
      "Subject":"An error has occured in the Gov Cloud @{pipeline().Pipeline}-pipeline!",
      "ErrorMessage":"@{activity('Copy data1').Error.message}",
      "DataFactoryName":"@{pipeline().DataFactory}",
      "Runid":"@{pipeline().RunId}"
      }
      Go back to your logic app and in the click on the email activity and , click on RUN and chose the option "RUN With Payload", in the body type the following code
      {
      "Subject": "This is a TEST email"
      }
      Now run and save the logic app, comeback to your pipeline and run it.

  • @annekrishnavinod5482
    @annekrishnavinod5482 3 года назад

    can we reuse this web activity? or we can create for all pipelines manually?

  • @prosinging7853
    @prosinging7853 3 года назад

    can u please add a video on 'email alert when a data is inserted into a synapse view/dmv using adfv2/logicapp'

  • @amanahmed6057
    @amanahmed6057 2 года назад

    sir agar mera account free hai or me agar resource group banaata hu
    or agar me usko 3 din baad delete maaru toh koi problem thodi hai??

  • @malathin5879
    @malathin5879 2 года назад +1

    Hello Sir, i am new to data factory. How much of coding is needed for this profile

  • @priyankamanjunath8565
    @priyankamanjunath8565 2 года назад

    can we log error messages to csv file ?? can you please make video on that , if we want to capture errors from multiple activities

  • @srinivasreddymalem6494
    @srinivasreddymalem6494 Год назад

    @Maheer, My question is how to send a notification when all pipelines under a data factory. Much appreciated your help.

  • @vickygupta4263
    @vickygupta4263 Год назад

    Can anyone pls help to get exact error message of failed activity.
    Code that i used is like -
    @('activity').output.errors[0].message
    But getting error msg as failed to parse any special character.
    Thanks!

  • @sanjayschopra5316
    @sanjayschopra5316 2 года назад

    in one pipeliene how to use multiple copy data sets

  • @phanichaitanya8829
    @phanichaitanya8829 2 года назад

    Perfect..

  • @Alpa0912
    @Alpa0912 3 года назад

    Hi Can we attached file in send email?

  • @alonsom.donayre1992
    @alonsom.donayre1992 Год назад

    Is Logic App Pricing expensive?

  • @gopalsanodiya8021
    @gopalsanodiya8021 2 года назад

    can we attache file in email here.

  • @anthony281190
    @anthony281190 Год назад

    11:23 Enter Email on Log In

  • @sconnell194
    @sconnell194 3 года назад

    👍

  • @SivakumarGalaxy-r5g
    @SivakumarGalaxy-r5g 4 месяца назад

    Who care your intentions buddy, you showing to baby data engineers. Atleast you just show minimum level automation instead of manual mode