Map Reduce explained with example | System Design

Поделиться
HTML-код
  • Опубликовано: 14 окт 2024
  • In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of. This will help you identify and apply Map Reduce related questions during your System Design Interviews
    Map Reduce Paper: static.googleu...
    / bytemonk
    • System Design Intervie...
    • System Design Questions
    • LLM
    • Machine Learning Basics
    • Microservices
    • Emerging Tech
    AWS Certification:
    AWS Certified Cloud Practioner: • How to Pass AWS Certif...
    AWS Certified Solution Architect Associate: • How to Pass AWS Certif...
    AWS Certified Solution Architect Professional: • How to Pass AWS Certif...
    #mapreduce #SystemDesign

Комментарии • 74

  • @shriyaananthanarayanan
    @shriyaananthanarayanan Год назад +38

    thank you so much, today i went to my first day of internship as a 15 year old girl and didn't get the complicated words they explained me but u thought me in a way I will never forget in my whole life.
    thank you so much!!!!

    • @chanwoopark5397
      @chanwoopark5397 8 месяцев назад +23

      where in the world are 15-year olds doing internships that involve map-reduce?? that's wild

    • @jasonwang-wg8wu
      @jasonwang-wg8wu 8 месяцев назад

      15 is the new 18 (pause)@@chanwoopark5397

    • @backslash8874
      @backslash8874 6 месяцев назад +11

      15 year olds, doing internships, and dealing with MapReduce and distributed systems. My 25 years old senior software engineer @$* not being able to comprehend the situation. Which world you live in mah lil sister?

    • @shriyaananthanarayanan
      @shriyaananthanarayanan 6 месяцев назад

      @@chanwoopark5397 I did the internship in my brothers company so... It wasn't that hard for me to get in...

    • @shriyaananthanarayanan
      @shriyaananthanarayanan 6 месяцев назад

      @@backslash8874 brotha, it's just like 3 months internship wasn't that hard, my brother is the owner of the company so he just accepted to let me in. I was told to do a couple of work and understand d the concept first, I tried my best to go to internship coz I wanna become a senior like you. And see, that's the difference, I will introduce myself as a intern not a senior like you. 🤗🤗
      I really admire you guys,🤗🤗 I waiting to finish my education and I wanna work! Infact I'm kinda girl who watches "the office"😂😂

  • @fishfanaticgokul4758
    @fishfanaticgokul4758 10 месяцев назад +6

    Most excited video of 2023 for an diagrammatic representation and clear cut explanation ❤❤❤ really great. College staff wants people like you to teach.

  • @nanaarhin5567
    @nanaarhin5567 Год назад +6

    The most complex name explained with the most simplest scenario. I understand this better now

  • @MihirNaidu-n5v
    @MihirNaidu-n5v 5 месяцев назад +7

    The professors we want in Indian engineering colleges ❤

  • @classifiedytfanclub
    @classifiedytfanclub 2 месяца назад +2

    Good job bro in 9 minutes i can score 20 marks easily 😂👍👍

  • @nikhilpathak1948
    @nikhilpathak1948 7 месяцев назад +1

    I watched many videos but your's 🔥🔥.
    I understood, thankyou!! 👏😊

  • @MarkGuz-d2r
    @MarkGuz-d2r Год назад +2

    Thank you for this! I have a data engineering interview tomorrow and the example really helped me understand the concept well enough to be able to explain it myself if I am asked.

    • @ByteMonk
      @ByteMonk  Год назад +1

      my latest video on data platform might also help you prepare for the interview, all the best!

  • @ethanxie2737
    @ethanxie2737 Год назад +4

    finally i know what is MapReduce, thanks !

  • @Sanjaysview
    @Sanjaysview 11 месяцев назад +3

    What a quality sir, hand off

  • @abasahebbhingardeve5464
    @abasahebbhingardeve5464 Год назад +7

    Very clear and understanding explanation.

  • @rookie2048
    @rookie2048 3 месяца назад +1

    I love you man
    Such a clean explanation

  • @prashantsalgaocar
    @prashantsalgaocar 2 месяца назад +1

    great explanation of map reduce.

  • @NassimDAIKH
    @NassimDAIKH 4 месяца назад

    Excellent video I was looking for a simple explanation like this

  • @ilhemwalker9145
    @ilhemwalker9145 Год назад +1

    thank you so much it's clear and well explained you answered all my whys and whats

  • @avasingh764
    @avasingh764 Год назад +1

    His Voice ❤❤️🔥🔥

  • @azuretutorialclouddesignan8173
    @azuretutorialclouddesignan8173 3 месяца назад +1

    love you bro, u made it easy.

  • @dhaneshpt8641
    @dhaneshpt8641 8 месяцев назад +1

    Super presentation.. Thank you sir.

  • @manmeetworld
    @manmeetworld 3 месяца назад +1

    Best one I've seen yet

  • @kunalsoni7681
    @kunalsoni7681 Год назад +1

    this video made a complex topic in a very simpler way ♥️☺️💯

  • @TheBoDuddly
    @TheBoDuddly 11 месяцев назад +1

    Excellent explanation!! Thank you.

  • @HLearningFun
    @HLearningFun 11 месяцев назад +1

    very nice and informative and detailed. thanks.

  • @nizarhabib4352
    @nizarhabib4352 4 месяца назад +2

    Very nice explanation

  • @thedragonforce2210
    @thedragonforce2210 Год назад +1

    i lost my jaw when i saw this video , bravo , nicely done men 👍

  • @data-eng-work
    @data-eng-work Год назад +1

    thank you so much for this sample , beautiful and benefiting explanation

  • @landocodes
    @landocodes 7 месяцев назад +1

    Amazing explanation!

  • @emmanuelyaro8322
    @emmanuelyaro8322 4 месяца назад +1

    thank you so much, very clear

  • @Veigaburame
    @Veigaburame Год назад +1

    the example is pretty straight forward

  • @mikedelta658
    @mikedelta658 Год назад +5

    What a wonderful explanation!

  • @p33yush
    @p33yush Год назад +3

    Thank you for awesome explanation!

  • @johnnyc5467
    @johnnyc5467 Год назад +3

    This is a great video. Thank you!

  • @jasonwang-wg8wu
    @jasonwang-wg8wu 8 месяцев назад +1

    @ByteMonk dank video, very clear and concise but I've got a question: at 8:20 you say we're tasked with finding all the videos with a certain number of likes. Do we really need to go through ALL of the metadata if we're just looking for the condition "number of likes >= [some amount]"??

    • @prathyushk5228
      @prathyushk5228 13 дней назад

      map reduce function where key deals with the like parameter from the metadata. Faster to search the cluster

  • @teddybear0116
    @teddybear0116 11 месяцев назад +1

    Great video! Now do spark!

  • @zabinoori49
    @zabinoori49 Год назад +1

    nice explanition with all the details thanks bro 💕💕

  • @yashthakur5712
    @yashthakur5712 10 месяцев назад

    Excellent explanation

  • @shaikhuzma786
    @shaikhuzma786 4 месяца назад +1

    Tqsm ☺️

  • @codernew3191
    @codernew3191 Год назад +1

    This is what I wanted

  • @cynthiabock9104
    @cynthiabock9104 11 месяцев назад

    Thank you for this super helpful video!
    What I have not understood yet is, how can I turn the process back? For example, if I am looking at the output file, how do I know in how many of those input files has the word 'apple' been? From what I understood, it could have been twice in the first (or second) file or once in each.

  • @neostark4564
    @neostark4564 Год назад +61

    His voice 🗿

    • @ByteMonk
      @ByteMonk  Год назад +13

      I am assuming that's a compliment :)

    • @JayaramB-kw6rs
      @JayaramB-kw6rs Год назад +2

      ​@@ByteMonkyes it is😅

    • @kartikraj1779
      @kartikraj1779 9 месяцев назад +1

      @@ByteMonknah man, although you tried so we appreciate it

    • @mohsenkheirabadi8211
      @mohsenkheirabadi8211 7 месяцев назад

      I can't focus 😂

  • @InvincibleMan99
    @InvincibleMan99 5 месяцев назад

    Amazing explanation sir.
    Would like to know how FB store likes and comments.
    Suppose user from India likes a video, and another user from the USA likes the same video, are they stored in same place or in a sharded db (country wise), would like to know your perspective

  • @SagesseValdesDongmoVoufo
    @SagesseValdesDongmoVoufo 3 месяца назад +1

    thank you so much, but maybe explain the example directly after the motivation next time.

  • @dimon_z
    @dimon_z Год назад +2

    Bro you are awesome 👍

  • @samathaea8264
    @samathaea8264 Год назад +2

    Very helpful. thank you:)

  • @hermanheinz33
    @hermanheinz33 Год назад +1

    very good video

  • @vaibhavahuja4001
    @vaibhavahuja4001 Год назад +1

    great vid. thanks

  • @abhinavkrishna449
    @abhinavkrishna449 7 месяцев назад +1

    Love you broo

  • @samerrawashdeh1351
    @samerrawashdeh1351 Год назад +1

    Thanks!

  • @sawdawyah
    @sawdawyah 10 месяцев назад

    Thanx 😊

  • @lucaterraneo7274
    @lucaterraneo7274 Год назад +1

    nice!

  • @bindukhadka
    @bindukhadka 3 месяца назад

  • @sweethasridharan4782
    @sweethasridharan4782 4 месяца назад +1

    Damn you're voice🤌🏼

  • @flameyt3721
    @flameyt3721 6 месяцев назад +1

    Failure nodes in classic mapreduce

  • @siyaram2855
    @siyaram2855 Год назад +1

    🔥

  • @complexity5545
    @complexity5545 6 месяцев назад +2

    Is hadoop dead? Who is still using that.

    • @ByteMonk
      @ByteMonk  6 месяцев назад +1

      Hadoop, in its original form, has reached a mature stage. It's less of a buzzword and more of a foundational technology upon which other systems are built. Many companies heavily invested in
      Hadoop infrastructure during its peak years and still rely on it. For example Yahoo! likely still has large-scale Hadoop systems for storage and batch processing. Facebook has also Built a huge Hadoop infrastructure for data warehousing and analytics. While they've moved a lot of processing to newer systems, legacy Hadoop clusters probably remain.
      These companies probably don't use Hadoop in exactly the same way they did during its peak. They likely have layered newer technologies like Spark or cloud-based analytics on top of their Hadoop foundations.

  • @adrianadev
    @adrianadev 16 дней назад

    5:00

  • @timur2887
    @timur2887 28 дней назад

    Looks like author is sleeping all the video)

    • @ByteMonk
      @ByteMonk  27 дней назад

      Looking back at this video, I feel the same :D