Understand Where Azure Data Services Really Fit in Your Data Flow!

Поделиться
HTML-код
  • Опубликовано: 13 июл 2024
  • In this video I walk through some of the major data services in Azure and where they fit in the larger data solution for an organization.
    00:00 Introduction
    00:47 Types of source data
    02:35 Answers from data and data warehouse
    03:45 Data transformation solutions
    04:51 HDInsight
    06:30 Databricks
    07:45 ETL
    08:25 Data lake and ELT
    10:45 Data factory and control flow
    14:43 Azure Analysis Services
    16:25 Azure Synapse Analytics
    18:35 Azure Purview and insight into data
    20:16 Summary and close
  • НаукаНаука

Комментарии • 52

  • @carlosalonsocapilla4796
    @carlosalonsocapilla4796 3 года назад +19

    You should do more "data tutorials" in Azure because you explain very well all the available tools and what is their use.

  • @hanhgio
    @hanhgio 2 года назад +1

    You seem to read my mind. Every time I look for something there is a video of you explaining. Thanks

    • @lbros6941
      @lbros6941 4 месяца назад

      Same here. John always has a video for all that info ill be looking for. Appreciate the time he spends in preparing these for us. Right now im preparing for Data Architect interview next week , and this video is very helpful. Thank you John.

  • @MrRyanegal
    @MrRyanegal 23 дня назад

    This is really awesome. Great work!!

  • @mohammedmohammedsaeed9547
    @mohammedmohammedsaeed9547 Год назад +1

    Another great video to make our life as a learners better. Thank you John.

  • @satori8626
    @satori8626 Год назад

    I have watched entire videos dedicated to discussions on ETL VS ELT, but haven't been able to grasp the difference. This is the first time it really clicks for me, even though it was not even the main purpose of the video. Thank you!

  • @ashokvenkat8420
    @ashokvenkat8420 Год назад

    Microsoft owe you for this explaination!!! Thank you so much!! for this John..

  • @Cloud-rb9oo
    @Cloud-rb9oo 5 месяцев назад

    I am preparing about different data services for 305, and the moment I keep the book down, I forget the overlaps between say like Stream Analytics and Synapse Analytics. DataLake vs others. When I search on RUclips, I am always overjoyed and more of a relief when I find you have made a video on that topic. Now I plan to grab a cuppa and come back and hit the play button. Thank You. PS: I dont have to see it to know this will clarify the fuzziness my head. Thank you so much, John!

    • @Cloud-rb9oo
      @Cloud-rb9oo 5 месяцев назад

      Added later for those new to this channel - got the dots connected and learnt something new - Purview. Once you get the dots connected, you will never forget.

  • @ritchierobinson5248
    @ritchierobinson5248 2 года назад

    What a brilliant video to simplify information that is actually quite complex! Thank you for this.

  • @helennamannila4464
    @helennamannila4464 2 года назад

    This was a really useful video - even though I'd watched it before, my CTO highlighted it for a few recent use cases, and it really does make everything come together into a cohesive whole. Thank you - really appreciated!

  • @mauriciozaragoza3709
    @mauriciozaragoza3709 Год назад

    Thanks for the video John. I will renew my Azure Architect cert soon and needed a quick way to remember all of these. Great work making hard things easy. God bless you.

  • @yegunkim9364
    @yegunkim9364 8 месяцев назад

    Thanks for great overview, Nice video!

    • @NTFAQGuy
      @NTFAQGuy  8 месяцев назад

      Glad you liked it!

  • @23inflicted
    @23inflicted 3 года назад +1

    As an azure data engineer, you nailed the overview. Thanks!

    • @NTFAQGuy
      @NTFAQGuy  3 года назад

      Great to hear, thank you!

  • @brianmedlin3647
    @brianmedlin3647 3 года назад

    I am deeply grateful for the distilled knowledge and articulate presentation in this and all your videos. Thank you John!

    • @NTFAQGuy
      @NTFAQGuy  3 года назад

      You are welcome. Thanks for watching

  • @henriquealexandreh
    @henriquealexandreh Год назад

    Nice video! Thanks John.

  • @userhelen1
    @userhelen1 2 года назад

    Thank you so much for such great explanation. I can remember this now for my exam az-305. I listen to so many other videos and very hard to remember all this info if you didn't work on those specific technologies. I listen to your video once, and now I will not forget it :)

  • @Moh3enJamali
    @Moh3enJamali 2 месяца назад

    Nice and clear. Thanks.

  • @nikibray7109
    @nikibray7109 2 года назад

    Thank you - this is so helpful, I've been trying to get my head around data bricks, data factory and synapse for weeks - its all now so clear!

  • @yanhancozypet
    @yanhancozypet 10 месяцев назад

    Another great content !

    • @NTFAQGuy
      @NTFAQGuy  10 месяцев назад

      Much appreciated!

  • @ubaidimran7102
    @ubaidimran7102 Год назад

    beautiful presentation!

  • @coder8515
    @coder8515 3 года назад

    John, thanks for awesome overview. Very helpful!

    • @NTFAQGuy
      @NTFAQGuy  3 года назад

      Glad it was helpful!

  • @emekaegbuonu1871
    @emekaegbuonu1871 2 года назад

    This is simply fantastic…it brought it down to me.

    • @emekaegbuonu1871
      @emekaegbuonu1871 2 года назад

      Hi John
      So am currently looking at governance framework for Azure. What are the components to consider when applying governance to Azure..?

  • @patrickboucher892
    @patrickboucher892 3 года назад

    merci John. Brilliant !

  • @melmixpita543
    @melmixpita543 2 года назад

    Amazing video. Just what I needed :)

  • @bingomutant1
    @bingomutant1 3 года назад

    great to have an overiew like this thankyou John

  • @invictuslegend4405
    @invictuslegend4405 3 года назад

    Great summary John! Would love to hear your take on cosmos DB. You make complex things easy to understand! Thank you.

    • @NTFAQGuy
      @NTFAQGuy  3 года назад

      I talk about cosmosdb in the database master class. Thanks.

  • @rashidakhtar4789
    @rashidakhtar4789 3 года назад

    Hi John, as per all your videos, fantastic job in simplifying and breaking it down. Would love a deep dive for Azure Data Services

    • @NTFAQGuy
      @NTFAQGuy  3 года назад

      i have a master class module on database already.

  • @tipsandhacksbygaurav
    @tipsandhacksbygaurav Год назад

    Really helpful

  • @dylanhughes5630
    @dylanhughes5630 3 года назад +1

    One of my customers has now started looking at Azure Data Catalog as well so would be nice if that got a mention 😀

  • @aswathanarayana
    @aswathanarayana 3 года назад +1

    Hi John,
    First of all Thank you for the video. I still remember Pluralsight path for DP-201 exam where 90% of the courses were authored by you and they really helped me to clear the exam.
    I can see that there are less number of tutorials particularly on the streaming pipelines. Please do youtube playlist on the streaming pipelines touching services like Azure Eventhubs, Stream Analytics etc. It would be of great help. Again Thanks for bringing in some content during holidays.

    • @NTFAQGuy
      @NTFAQGuy  3 года назад +1

      Glad the content was useful.

  • @kristurk1
    @kristurk1 3 года назад

    Great Video John as always... I didn't realise how realistic MS Whiteboard app was :P 17:05 your whiteboard marker kind of runs out of ink, made my chuckle

  • @prasnig
    @prasnig 3 года назад

    Great Explanation !! would have loved to understand where AZ AI/ML services and AZ SnowFlake services fit in

    • @NTFAQGuy
      @NTFAQGuy  3 года назад

      Glad it was helpful

  • @danielrobertson3302
    @danielrobertson3302 3 года назад +1

    The thing that I still struggle with is when to choose one service over the other since there is a lot of overlap within the data services with offering ETL capabilities within their service (still leveraging ADF under the hood), using Spark, ad-hoc SQL analytics and so on. I suppose that's the the point, to find the shoe that fits, but it makes it confusing for a non-data guy like me!

    • @NTFAQGuy
      @NTFAQGuy  3 года назад +1

      data factory is very much a data integration platform now providing UI based data plane features (using sparc underneath) so likely start with data factory and use others if you need.