33. ForEach Activity in Azure Data Factory

Поделиться
HTML-код
  • Опубликовано: 26 ноя 2024

Комментарии • 82

  • @Midnightnoodles
    @Midnightnoodles 11 месяцев назад +4

    Keep it up, excellent content

  • @patrickbateman7665
    @patrickbateman7665 2 года назад +20

    Hi Maheer, a small correction at 6:10 timeStamp
    You have passed the list of 3 strings into an array i.e [ output1, output2, output3 ] as a deafult value
    Since they are list of Strings, They should be passed in Inverted Commas as [ "output1", "output2", "output3" ]
    Else while validating it will throw warning as "Parameter value should be a valid array
    "
    Hope this helps for the rest of Learners fom your channel :)

    • @WafaStudies
      @WafaStudies  2 года назад +1

      Yes thanks for correcting it.

  • @abhishekhr4724
    @abhishekhr4724 3 года назад +7

    Thanks for the video.
    one suggestion, Please take one example and run it. this will help us understand what output we are getting.

  • @shakthimaan007
    @shakthimaan007 2 года назад +4

    Why not my engineering lectures were like you..!!
    After 5 hours of going through several videos, I finally managed to make sense of "For each" component using your video.
    I am able to append today's date to a file which copying from one blob to another.
    Zillion thanks.
    Small suggestion is that after showing all these, you might have just ran the pipeline to show what happens and through the process you might have debugged the Array quotes issue

    • @WafaStudies
      @WafaStudies  2 года назад

      Thank you for kind words 🙂. Ya at that time of making these videos I didn't had proper Azure subscription to send some money to execute. Even i was under worry like how much money it take and all. But all videos after intiall few days has everything ran. Sorry for the trouble in intial videos

  • @ssudipta4
    @ssudipta4 4 года назад +15

    Hi Maheer,
    Thank you for creating such a good video but one thing I would like to inform, when you are creating parameter like OutputFolders then value should be within the double quote like ["output1","output2","output3"] otherwise it throws a invalid parameter value.

    • @dataguys2192
      @dataguys2192 2 года назад

      I had the same issue. Had to look it up and solved the problem.

    • @MahendraM-k6z
      @MahendraM-k6z 9 месяцев назад

      maheer did not run the pipeline he just explain the blueprint
      waste fellow
      without run the pipeline how we get know whether its working or not

  • @pradeepp5287
    @pradeepp5287 3 года назад +1

    Thanks a ton Maheer. This is one of the most informative playlist I have viewed in RUclips.

  • @prasadsai3776
    @prasadsai3776 4 года назад +3

    I like the way you explain .. Very informative and helpful. Thanks a Bunch!!

  • @venugopal-rc9zg
    @venugopal-rc9zg 11 дней назад

    Thank you for the information, but I have a tiny proposal. Your explanation of the activity is excellent, but my worry is that you demonstrate the pipeline execution as well as the output, which will be useful to beginners.

  • @shaikbasha7086
    @shaikbasha7086 2 года назад +1

    Hi Maheer, the way u explaining the concepts understandable.awesome sessions and vr 💯% satisfied, thank you so much

  • @RaghbatTV
    @RaghbatTV Год назад

    can we use this on 'Copy Data Sink' part that @{item().OutputFolder}.....this output from parameter in pipeline? instead only @item().

  • @ramanareddygarisha7564
    @ramanareddygarisha7564 11 месяцев назад

    In the pipeline parameter, you have given value as [Output1, Output2, Output3], But it should be in double quotes ["Output1", "Output2", "Output3"] I believe. Correct me if I'm wrong

  • @vijaybodkhe8379
    @vijaybodkhe8379 3 года назад +1

    Short and Clear videos Thanks Maheer

  • @srinivasaraom5558
    @srinivasaraom5558 17 дней назад

    do u have any theoritical material what u are teaching

  • @RupaL-o4e
    @RupaL-o4e 2 месяца назад

    What if I want to more then 10 output do i need to give ["output1","output2",....."output10"]?

  • @letscodewithvivek5191
    @letscodewithvivek5191 3 года назад

    Hello, instead of hardcoding array, is it possible to pass folder values dynamically?

  • @dheerajsachdeva5735
    @dheerajsachdeva5735 10 месяцев назад

    How to handle this: Example: file1.xlsx > (sheet 1).json, (sheet2).json
    I don’t know how many files are the input folder and I don’t know how many sheets are in each file but the output should be whatever is the sheet name (within the xlsx) with json extn ?

  • @darkmatter5967
    @darkmatter5967 4 года назад

    Your class are reaaly usefull! Just keep making!
    Thank you a lot!

  • @dataguys2192
    @dataguys2192 2 года назад

    Is it possible to put all of the files in the same output folder? I tried adding another Parameter in the pipeline outputFolder as a string value, then created another parameter outputFile array type. Instead of creating 3 different files in a single folder, it created 3 separate output folders for each file.

  • @sateeesh1000
    @sateeesh1000 4 года назад +1

    I am going through these videos last one week. you are explanation & examples are really very helpful to every one. Thank you @wafastudies

    • @WafaStudies
      @WafaStudies  4 года назад +1

      Thank you for your kind words 🙂

  • @arishaafini269
    @arishaafini269 Год назад

    Hello, how to transform multiple file in single dataflow under the ForEach?

  • @Soumya7373
    @Soumya7373 22 дня назад

    where is the array example vanished ? [1,2,3,4,5,6,7] is it exist then can you share the lnumber in the list.

  • @avinashpratapsingh3875
    @avinashpratapsingh3875 2 года назад

    Hi Maheer, about this topic Foreach can u provide a actual time demo because demo u provide is not properly explanatory.

  • @CoolGuy
    @CoolGuy 2 года назад +1

    Which all playlists by you should be watched for Azure Data Engineer role ? Thanks in advance bro.

    • @WafaStudies
      @WafaStudies  2 года назад +2

      Adf, synapse, Databricks

    • @CoolGuy
      @CoolGuy 2 года назад

      @@WafaStudies Thanks brother

  • @mr.prasadyadav
    @mr.prasadyadav 3 года назад

    Inside continer I'm not getting the container names like output1,output 2 ,output3
    Could please execute once your pipeline line activity .we can understand clearly

  • @divyar7991
    @divyar7991 2 года назад +1

    hi when I did this I got an error message while publish -parameter value should be a valid array,can you help me to sort out?

    • @WafaStudies
      @WafaStudies  2 года назад

      Array is not correct format i guess. Pls use comment ur format

    • @divyar7991
      @divyar7991 2 года назад

      @@WafaStudies thank you for the reply .your videos are great . I got it correct when I go through someone’s comment .

    • @divyar7991
      @divyar7991 2 года назад

      [“output1”,”output2”]

  • @vamshikrishna9630
    @vamshikrishna9630 4 года назад

    parameter should be arry? can be copy this alredy existed folders?

  • @imranimmu1727
    @imranimmu1727 4 года назад +3

    Hi Maheer firstly big thanks to your great efforts, hope your channel should grow exponentially. Can we try nested for each activity in ADF?

    • @WafaStudies
      @WafaStudies  4 года назад

      Thankyou Imran for kind words. No we can't use nested foreach in adf. Currently it's not supported

  • @satellitepop
    @satellitepop 3 года назад +1

    Many many many thks friend. Great video.

  • @dhanushyadav8879
    @dhanushyadav8879 3 года назад

    i dont see the output in my container my debugging happened well whats the problem

  • @Deva21v
    @Deva21v 3 года назад

    How do we handle SSIS object type in SSIS

  • @samba777ravuri
    @samba777ravuri 4 года назад +1

    Good Explanation...Keep going on

  • @anujgupta-lc1md
    @anujgupta-lc1md 4 года назад

    more video plz upload some on incremental files coming in blob how to store in azure sql viceversa.

  • @varunkulkarni7908
    @varunkulkarni7908 4 года назад

    Super Video, Great work

  • @azureadusu1786
    @azureadusu1786 4 года назад +1

    Great Work!!

  • @shaikraheem0329
    @shaikraheem0329 3 года назад

    Parameter value should be a valid array
    when i validate the pipeline showing above parameter error

    • @maheshgaddam5729
      @maheshgaddam5729 3 года назад +1

      It should be ["output1","output2","output3"]

    • @brahmaswetha2325
      @brahmaswetha2325 3 года назад

      @@maheshgaddam5729 thanks :) you are right. After changing this, I got the output

  • @MahendraM-k6z
    @MahendraM-k6z 9 месяцев назад +1

    in every video you are just show the flow but you didn't execute pipeline

  • @biswajitsarkar5538
    @biswajitsarkar5538 3 года назад +1

    Good work...carry on

  • @abhilashpande78
    @abhilashpande78 4 года назад

    I am getting an error Saying "Parameter should be vaild array" please help me with this

    • @patrickbateman7665
      @patrickbateman7665 2 года назад

      It should be ["output1", "output2", "output3"] since the Folder names are list of Strings

  • @RahulJaiswal-nw1kf
    @RahulJaiswal-nw1kf 3 года назад +1

    thank you sir great work

  • @dineshmadhup8667
    @dineshmadhup8667 4 года назад

    Good Work. I wan to copy each record of the table separately. Does this concept work. Would you mind sharing your E-mail for further communication about it?

  • @learnnrelearn7553
    @learnnrelearn7553 4 года назад +1

    very informative

  • @prudhviraj3315
    @prudhviraj3315 4 года назад

    Tried it but didn't work, after adding value to folder name (@item())its showing invalid

    • @WafaStudies
      @WafaStudies  4 года назад

      To access items in array of for each you need to use @item()

    • @prudhviraj3315
      @prudhviraj3315 4 года назад

      @@WafaStudies I did that and Please check your video it is showing invalid for you too (when u gave the value to folder name it showed invalid )
      Thankyou for your videos they r helping me for my carrier

    • @sateeesh1000
      @sateeesh1000 4 года назад +3

      @@prudhviraj3315 Array parameter you should define like ["output1","output2","output3"] then only it will work. I tried it is working fine. Thank you.

    • @dhanushyadav8879
      @dhanushyadav8879 3 года назад +1

      @@sateeesh1000 i dont see the output in my container my debugging happened well whats the problem

    • @chandrasekharthiyagarajan9634
      @chandrasekharthiyagarajan9634 2 года назад +1

      @@sateeesh1000 Thanks Sateesh. You saved my time.

  • @rajabhakshi3333
    @rajabhakshi3333 2 года назад +1

    Good demo

  • @gaganacreations7464
    @gaganacreations7464 2 года назад

    Please show me a vedio how to delete less than 50kb files in a blob storage

    • @WafaStudies
      @WafaStudies  2 года назад

      kindly check below
      ruclips.net/video/gxqiRu9w8EQ/видео.html

  • @MahendraM-k6z
    @MahendraM-k6z 9 месяцев назад

    WHY YOU ARE NOT RUN THE PIPELINE
    IF YOU RUN THE PIPELINE THEN ONLY WE WILL LET YOU KNOW WHETHER ITS WORKING COREECT OR NOT.

  • @sonamkori8169
    @sonamkori8169 2 года назад +1

    Thank you Sir

  • @Uda_dunga
    @Uda_dunga Год назад

    Very confusing 😢

  • @beigepiripitin4923
    @beigepiripitin4923 5 месяцев назад

    No sé entiende NADAAA

  • @PrakyathJoshPrakki
    @PrakyathJoshPrakki 3 года назад +3

    Thanks for the video.
    one suggestion, Please take one example and run it. this will help us understand what output we are getting.