Kafka in 100 Seconds

Поделиться
HTML-код
  • Опубликовано: 2 фев 2025

Комментарии •

  • @krateskim4169
    @krateskim4169 2 года назад +1407

    The thumbnail is unexplainably aesthetic, please dont stop this series , always learning something new from these

    • @SpektralJo
      @SpektralJo 2 года назад +16

      has the aethetic of the japanese prefecture flags

    • @2ku4
      @2ku4 2 года назад +10

      @@SpektralJoOsaka++

    • @SpektralJo
      @SpektralJo 2 года назад +1

      @@2ku4 yeah it looks very similar to osakas symbol

    • @bide7603
      @bide7603 2 года назад +10

      That’s the Kafka logo?

    • @pphehe7549
      @pphehe7549 2 года назад +5

      Aesthetic is not an adjective

  • @pelochaco
    @pelochaco 2 года назад +982

    Hey man, love your videos, but a small correction for what you mention at 1:45
    "Kafka guarantees that any consumer of a given topic will always read the event in the exact same order"
    That's true but at partition level. A topic is made of partitions, and a topic with 1 partition will guarantee that. But as soon as you need parallel consumption you need more partitions (one per concurrent consumer). When having multiple partitions, a single, non-concurrent consumer will get the events of any partition in the proper order but events from different partitions may be consumed with different interleaving
    This is why it's so important to put a proper key for your messages, as it's the default value used for sending your message to different partitions (different events with the same key will always end up in the same partition)
    Again, love your content, you explain super great. But I thought that that small point had to be addressed
    😄

    • @simonthuillier9779
      @simonthuillier9779 2 года назад +87

      Yes that's an important detail to understand: order is guaranteed across one partition and all messages sharing a key are stored on the same partition, hence order is guaranteed for all messages sharing a key.
      But order isn't guaranteed on a whole topic.

    • @Fireship
      @Fireship  2 года назад +300

      Thanks for the clarification, that's an important detail.

    • @prgnify
      @prgnify 2 года назад +16

      @@Fireship pin the comment my man

    • @lonkhoi6764
      @lonkhoi6764 2 года назад +22

      "small correction"

    • @elyTheEly
      @elyTheEly 2 года назад

      @@lonkhoi6764 humble man

  • @blexbottt5119
    @blexbottt5119 Год назад +157

    hey this is not the kafka I am searching for, but thank you fireship

    • @thanhdaptra
      @thanhdaptra 8 месяцев назад +17

      bro’s looking for stellaron hunters☠️

  • @thelukemccrea
    @thelukemccrea 2 года назад +72

    This series never fails to teach me about things I didn't know I needed to know about.

  • @danielgospodinow
    @danielgospodinow 2 года назад +17

    As someone who works for Confluent and has worked on Kafka for some time now, I absolutely love your video. 🔥

    • @whatsppme4787
      @whatsppme4787 2 года назад +1

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @lucianoinso
    @lucianoinso 8 месяцев назад +4

    I've watched this before doing the quickstart on apache kafka website, to have a general idea of what it was, and ended up with a really abstract idea of it. Then after doing the quickstart, and playing with it a little bit, I re watched this video and now it felt like the perfect summary, all became crystal clear!
    I'll encourage anyone who feels like it is too abstract or is bit confused to follow similar steps :)

  • @farhansangaji5029
    @farhansangaji5029 2 года назад +124

    Everyone is gangsta until you have to handle reset flow

    • @HelloWorld-fg2nm
      @HelloWorld-fg2nm 2 года назад +3

      Reset flow? What is that

    • @farhansangaji5029
      @farhansangaji5029 2 года назад +14

      @@HelloWorld-fg2nm when there is a failed process in Kafka, ideally you have to rollback every process that has been succeded before. Just like rolling back query in ORM. That is why you need separate flow for reset

    • @farhansangaji5029
      @farhansangaji5029 2 года назад +2

      Im sorry if you are confused by what im saying. Im still learning english

    • @sifuyavuz
      @sifuyavuz Год назад +1

      ​@@farhansangaji5029you can have a windowing topic for these cases and do reconciliation

    • @MetaLexxer
      @MetaLexxer 10 месяцев назад +1

      so true!

  • @agentarachnid2009
    @agentarachnid2009 2 года назад +141

    I'd love a 100 seconds on a CI tool like Jenkins, your videos are always so informative :)

  • @crackwitz
    @crackwitz 2 года назад +7

    I didn't think I'd be interested in Kafka but I'm glad I watched. You're like a tech magazine, broadening my horizon.

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @flamerbattler
    @flamerbattler Год назад +43

    Good time to be a coder and a Honkai star rail fan.

    • @Axthqra
      @Axthqra Год назад +2

      Lmao fr

    • @delta_yd
      @delta_yd 8 месяцев назад +2

      let's goooo

  • @ayanc13
    @ayanc13 2 года назад +4

    Wow. I started working on Kafka and had no clue what it was. After months got a basic idea but this video makes it so helpful

  • @Bad_B0nes
    @Bad_B0nes 2 года назад +52

    I always learn something new from these vids they're truly great

    • @Djulio
      @Djulio 2 года назад +4

      Then let's hope he does a video on "they're vs their"

    • @elyTheEly
      @elyTheEly 2 года назад

      @@Djulio vs vs. vs.

    • @dabdoube92
      @dabdoube92 2 года назад

      @@Djulio why you so smart

  • @maxz999
    @maxz999 2 года назад +3

    excellent timing! Had kafka come up in a meeting at work last week and didn’t know anything about it.

  • @patterntrader690
    @patterntrader690 2 года назад +7

    You read my mind, I’ve been hoping you’d cover Kafka for months now!

  • @dl_dt1467
    @dl_dt1467 2 года назад +3

    I just started at a new position and needed to understand Kafka. Wow, Fireship keeps reading my mind

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @Neucher
    @Neucher Год назад +31

    There's a different Kafka that's even better 👀

    • @inei4662
      @inei4662 Год назад +5

      *sigh* HSR fans are everywhere

  • @Xenomnipotent
    @Xenomnipotent Год назад +30

    HERE'S TO EVERYONE WINNING THEIR 50/50 RAHHHHHHHHH 🗣‼🔥💯

  • @MDMetalManiac
    @MDMetalManiac 3 дня назад

    As always, I leave your videos with more questions than answers. Thanks !

  • @davisgrier5162
    @davisgrier5162 2 года назад +6

    These videos are fantastic. My background is embedded software and hardware design, but I enjoy learning new technologies. Lately I've wanted to understand the basics of Kafka, RabbitMQ, and others, and these videos are perfect for giving me a quick understanding of how they are used.

  • @splendidpolo
    @splendidpolo 2 года назад +9

    What’s more is you can use consumer groups to split the workload if you have massive data to compute. And what is more is you can use different strategies to reassign partitions to new workers to increase ingestion throughput

  • @mindaugasliaugaudas9924
    @mindaugasliaugaudas9924 2 года назад +2

    The short video idea is straight genius.

  • @brekol9545
    @brekol9545 2 года назад +1

    0:10
    yesss, i was hoping that you will make this reference, and you did! yaay
    also great video as always

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️❤️

  • @Spo0nch
    @Spo0nch 2 года назад +87

    I'd love to see a quick into to Event Sourcing on this channel!

    • @constantinLu_
      @constantinLu_ 2 года назад +3

      That would be useful.

    • @AmazingLukeyDrawingsKawaii
      @AmazingLukeyDrawingsKawaii 2 года назад

      I'd love that.

    • @0xdjole
      @0xdjole 2 года назад +1

      Kafka is perhaps the best options for it. You just store the message forever and ur done. I recommend book Designing Event-Driven Systems by confluent CTO. It's awesome except it's a bit too bias for Kafka...tho nothing like Kafka so u can't blame the man.

    • @pequod4557
      @pequod4557 2 года назад

      Do your own research mate if you really want it.

    • @alexisnarvaez
      @alexisnarvaez 2 года назад

      I would like to see it with EventStoreDB

  • @dHue_52
    @dHue_52 2 года назад +1

    Great timing, we literally talked about Kafka in my Intro to Big Data Analytics class today!

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @pigalex
    @pigalex 2 года назад +37

    2:20 in java, since you’re implementing single-method interfaces you can just make it a lambda and can omit the argument types

    • @xpp1e
      @xpp1e 2 года назад +1

      This is why you use IntelliJ for Java!

  • @anita2053-r1f
    @anita2053-r1f 8 месяцев назад

    you're really wonderful. ive been struggling to understand since 2 yrs and you made it clear in just 10 min

  • @brandonmarick2799
    @brandonmarick2799 2 года назад +2

    Thanks for giving these overviews! I often share these as introductions for coworkers!

  • @niwadev
    @niwadev Год назад

    Thank you! I never understood the differences between the message broker systems and Kafka before. But the real time streaming example and the amount of throughput made it clear to me.

  • @VinodMoorkoth
    @VinodMoorkoth Год назад +3

    Imagine a Kafka topic is like a multi-lane highway, where each lane (partition) has cars (messages) driving in a single direction.
    *Order Guarantee:*
    Within each lane (partition), cars (messages) drive one after the other in a strict sequence.
    If you're observing just one lane, you'll always see cars in the exact order they entered that lane.
    *Multiple Lanes (Partitions):*
    If you're watching the whole highway (the entire topic with multiple partitions), cars from different lanes might cross you at slightly different times.
    So, while cars within each lane are in order, across lanes, they might appear mixed up.
    *Why Lanes (Partitions) Matter:*
    More lanes mean more cars can drive simultaneously, allowing for faster traffic flow.
    In Kafka terms, this means more consumers can read messages concurrently, leading to faster data processing.
    *Choosing the Right Lane with a Key:*
    When a car (message) enters the highway (topic), it needs to pick a lane (partition). This choice is based on the car's license plate number (message key).
    Cars with the same license plate number will always choose the same lane. In Kafka, messages with the same key always go to the same partition, ensuring they're read in order.
    In summary, while Kafka keeps the order of messages within each partition, when you have multiple partitions, the order of messages across them can be mixed. Choosing the right key for your messages ensures they land in the expected partition.

  • @chakala2149
    @chakala2149 2 года назад +178

    I have a theory about why Kafka the messaging system is named Kafka after Franz Kafka the writer.
    'Das Schloss'(The Castle) is a Novel written by Franz Kafka in which he describes a castle having occupants structured as the ultimate bureaucracy.
    Members of the Castle does not know each other and communicate via a paper based messaging system.
    You don't want to deal with such a bureaucracy, but you certainly would want to design large complex systems like so: Independent services not knowing about each other communicationg via an asynchronous messaging system. I think that is why Kafka is named Kafka, although just a personal theory...

    • @lawrencedoliveiro9104
      @lawrencedoliveiro9104 2 года назад +20

      That particular writer was known for writing stories about enigmatic, baffling events where the characters have no idea what’s going on. Like one about a trial where the person on trial is not even told what the charges are.

    • @ikedacripps
      @ikedacripps 2 года назад +10

      And that's what I like about Kafka , you can literally read your own meaning to it, here a team of developers have used his stories to create a great service.

    • @Dylan_thebrand_slayer_Mulveiny
      @Dylan_thebrand_slayer_Mulveiny 2 года назад +1

      Pretentious nerds.

    • @yoyoyo2610
      @yoyoyo2610 Год назад +4

      That's a way better explanation that "it's a system optimized for writing" especially considering Kafkas writing process beeing so chaotic and unorganized that he himself did not see the any meaning in his stories

  • @ZuckThat
    @ZuckThat Год назад

    Love this style and kind of bite-sized informative video!

  • @ogQAQ
    @ogQAQ Год назад +9

    man I was searching for honking star rails kafka but stumbled on this gem, thanks dude

  • @nicky_rads
    @nicky_rads 2 года назад +1

    Nice video! Kafka is very in demand rn, big movement towards NRT. Keep it up !

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️❤️

  • @sigmamoon7067
    @sigmamoon7067 2 года назад +4

    It also used with frameworks as Apache Flink or Apache Spark combined together for distributed event system such as streaming , application to alert ⚠ on some event and now with many machine learning Apps. Great explanation consise love u're 100s @fireship

    • @whatsppme4787
      @whatsppme4787 2 года назад +1

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @TechnoRiff
    @TechnoRiff 2 года назад

    These are the first vids to watch to lay down the overarching concepts of a technology. Nice!

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @Darth_Bateman
    @Darth_Bateman 2 года назад +2

    1:09 Rest in Peace party guy from that Radio Disney song from my childhood.

  • @TwoTeaTee
    @TwoTeaTee 2 года назад +1

    Much awaited, thanks!

  • @Panakotta000
    @Panakotta000 2 года назад +79

    You should make a "Qt in 100 seconds" :3
    its a very very popular native Desktop Development framework that can compile for nearly any platform and is written in C++
    Many of your production software like earlier iterations of Photo Shop or After Effects, currenr Davinci Resolve, OBS, Krita and many more are written with Qt
    and still holds strong as one of the best native GUI solutions (native, aka. no web related stuff)

    • @mkhuzaima
      @mkhuzaima 2 года назад +10

      Qt is also supported in python. There is also QML (QT markup lanugage I guess) which also supports running javascript.

    • @CHBMUABUTHAHIR
      @CHBMUABUTHAHIR 2 года назад +10

      ​@@mkhuzaima But if u are going to use JS for any desktop application, html is wayy better as it is open standard. Also, you can use webview and write ur gui in HTML CSS JS and use C++, Java, Python or any other favorite language for the main logic of the app.

    • @marcelsantee1809
      @marcelsantee1809 2 года назад +1

      As someone who worked with pyQt I agree

    • @leoingson
      @leoingson 2 года назад +4

      I doubt that any Adobe product (PS..) is made with QT - no Linux version.
      I used to be a QT fanboy, but not anymore. Licensing, enough said. And seemingly lagging behind on technology (C++20.. ) and tooling (QTcreator needed).

    • @yestermonth
      @yestermonth 2 года назад

      Adobe uses their own internal tool

  • @kushalgunoo157
    @kushalgunoo157 Год назад

    this channel is just amazing.. truly keep up the extremely good work.

  • @khoibites
    @khoibites Год назад +6

    Thought this was meme compilation about Kafka from Honkai Star Rail for a sec

  • @apijayxero
    @apijayxero 2 года назад +2

    Thank you fireship for making this videos they are super useful😎😎

  • @joshurlay
    @joshurlay 2 года назад

    The only channel keeping my attention span entertained longer than chat gpt

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @nicolasfelipe1
    @nicolasfelipe1 2 года назад +5

    i was the crazy developer about 3 years ago for wanting to introduce Kafka in a project which was having load problems, great now Kafka is famous.

  • @brent4996
    @brent4996 2 года назад +1

    this video was very Kafka-esque

  • @corporategreed
    @corporategreed 2 года назад

    The footage at 1:46 is probably the single best piece of stock footage out there

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @viraj_singh
    @viraj_singh 2 года назад +1

    I couldn’t find a good kafka introduction video on RUclips yesterday and today you posted it. It’s like you can read my mind 😂

  • @樣樣樣樣fn
    @樣樣樣樣fn Год назад +4

    Kafka rerun in 2.0❤❤🔥🔥🔥 i wanna get her lc

    • @Hack2289-t7i
      @Hack2289-t7i Год назад

      Trueeeee, definitely pulling for her now that I have the chance to do so (lost pity to yanKING)

  • @josejuan98
    @josejuan98 2 года назад +7

    Great video! I would love to see a video of "Scala in 100 seconds" :)

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Let's discuss about something bigger in this 2023✍️✍️👆♥️........ happy new year✍️✍️

    • @user-ws2et9el2z
      @user-ws2et9el2z 2 года назад

      Yeeesss

  • @023PrashantSharma
    @023PrashantSharma Год назад +1

    wants a long series of it, detailed description.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1 Год назад

      Prashant Sharma , if you are interested in learning Kafka in-depth , you can refer the kafka playlist in my channel , all topics are covered in detail with practical ...

  • @balfiman
    @balfiman 10 месяцев назад +1

    One morning, when Gregor Samsa woke from troubled dreams, he found himself transformed in his bed into a horrible vermin.

  • @ab-tech2340
    @ab-tech2340 2 года назад +7

    I like how confident he says " I will see you in the next one"

  • @iyshrshjt
    @iyshrshjt 2 года назад +1

    My dear Jeff, we wait prolog in 100 seconds, we want it NOW.

  • @DanielLavedoniodeLima_DLL
    @DanielLavedoniodeLima_DLL 2 года назад +2

    The Brazilian Central Bank uses Kafka in its PIX system, that makes money transactions between individuals or entities in real time between bank accounts in any Brazilian bank. If anything, that show how powerful Kafka can be (2 billion transactions per month, with almost R$1 billion - which is roughly US$200 million - moved between accounts in that period).

    • @JTWebMan
      @JTWebMan 2 года назад

      FYI most databases can handle 2 billion transactions a month so not sure that is a win. Good use case though for immutability.

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

    • @DanielLavedoniodeLima_DLL
      @DanielLavedoniodeLima_DLL 2 года назад

      @@JTWebMan for a financial application nothing is ever that simple, specially since it has become such a key service in day-to-day use by the general population. But I do understand your point

    • @Lafret17
      @Lafret17 5 месяцев назад

      twitter handles like 2 billion transactions per day bro, kafka is more powerful than you think, lol

  • @kdojeteri
    @kdojeteri 2 года назад

    I've been waiting for this.

  • @stephenwalton8087
    @stephenwalton8087 2 года назад

    Finally, my weekly dose of Fireship is here.

  • @stoychokyosev
    @stoychokyosev 2 года назад

    will be happy to see prolog in 100 seconds😄

  • @jayraldempino8907
    @jayraldempino8907 2 года назад +1

    In Hyperledger Fabric, which I use for our Thesis, it uses Kafka for consensus. Like, leader election and storing of data.

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Let's discuss about something bigger in this 2023✍️✍️👆♥️........ happy new year✍️✍️

  • @OsmanToplica9001
    @OsmanToplica9001 2 года назад +1

    Dear Fireship,
    ily.

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @tally3018
    @tally3018 2 года назад +1

    This by far the best robot-voice I have ever heard, it took me hours of watching before it dawned on me that this is the result of text->voice tech.

    • @fiorenzorutschmann3656
      @fiorenzorutschmann3656 2 года назад +2

      Not a robot voice but that would be cool.
      Here's his making of video ruclips.net/video/N6-Q2dgodLs/видео.html as proof (maybe)

    • @javierflores09
      @javierflores09 2 года назад

      It isn't a robot voice lol, he probably just edits out the audio so his voice doesn't fluctuate that much, giving it that effect

    • @tally3018
      @tally3018 2 года назад

      @@fiorenzorutschmann3656 Ooh, yeah I took a look, seems like he cuts his audio a lot (time-shaver).
      I just watched this one:
      ruclips.net/video/1xipg02Wu8s/видео.html
      And tbh it sounds like he has a bot doing it, because every single sentence ends in the same tone, combined with that micro-second silence between words made it seem like that to me lol.
      I guess he is just very coherent in the way he speaks

    • @mihailmojsoski4202
      @mihailmojsoski4202 2 года назад

      @@tally3018 put some decent quality headphones on and blast the volume to the max, you can hear the liquid in his mouth moving

    • @tally3018
      @tally3018 2 года назад

      @@mihailmojsoski4202 LMAO!

  • @a.r.c1056
    @a.r.c1056 2 года назад +1

    Nice! Please do Apache Spark next!

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Let's discuss about something bigger in this 2023✍️✍️👆♥️........ happy new year✍️✍️

  • @nikolaialeksiev2536
    @nikolaialeksiev2536 23 дня назад

    Thanks, very useful!

  • @роматарасов-о8л
    @роматарасов-о8л 2 года назад +1

    need more about microservices! 🚀🚀🚀🚀🚀🚀

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @calvinhong7401
    @calvinhong7401 2 года назад

    I needed this during my enterprise software semester 😢

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @CrackaSource
    @CrackaSource 2 года назад

    omg this is exactly what I needed lol my new job requires Kafka. Thanks!

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @iagonicolaidalsenter8294
    @iagonicolaidalsenter8294 2 года назад +3

    Please, do a video in beyond fireship about kafka :)
    Just to you know, nice job

  • @ludwingguate
    @ludwingguate 2 года назад

    Love this explanation!

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @lyricalcarpenter
    @lyricalcarpenter 2 года назад +2

    1:09 aaron carter came out of the blue

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @nicklesseos
    @nicklesseos 2 года назад +1

    Been waiting for this video for a while maybe do couple deep dives on kafka?

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @snansahmarov1524
    @snansahmarov1524 2 года назад +1

    Just was researching on RabbitMQ and Kafka. Your contents are amazing.

  • @dejalaenvisto
    @dejalaenvisto 2 года назад

    Excelente, me encanto la forma y toda la informacion, increible, muy bueno 🔥🔥🔥🔥🔥🔥
    Excelente, me encanto la forma y toda la informacion, increible, muy bueno 🔥🔥🔥🔥🔥🔥

  • @Jere1515
    @Jere1515 2 года назад

    Good video to introduce one about Scala :D

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @voidtoni4893
    @voidtoni4893 2 года назад

    Ive been wanting an introduction to Kafka forever now

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️

  • @590af
    @590af 2 года назад

    Yesss we also need one about nifi!

  • @The_Codemaster144k
    @The_Codemaster144k 2 года назад +1

    First! Also as my request, please do Love2D in 100 seconds next!

  • @krateskim4169
    @krateskim4169 2 года назад

    I cant wait to see what's next in this series

  • @danielmarkj
    @danielmarkj Год назад +1

    In an Iron Man movie, Kafka could have been useful in a scene where Tony Stark (Iron Man) needs to process and manage a large volume of real-time data or communications. Here's a hypothetical scenario where Kafka could play a role:
    Scene: Tony Stark is in his high-tech lab, and he's remotely controlling his Iron Man suit, which is deployed in a distant location to handle a crisis. He needs to receive and process real-time data from various sensors on the suit, such as vital signs, telemetry data, and external environmental data, while also receiving live video feeds.
    How Kafka could be useful:
    1. **Real-time Data Ingestion**: Kafka could be used to ingest data from these sensors and video feeds in real-time. Each type of data (vital signs, telemetry, video) could be treated as a separate Kafka topic.
    2. **Data Processing**: Tony needs to process this data for real-time decision-making. Kafka Streams, a component of Kafka, could be used to perform real-time data processing, such as analyzing vital signs for signs of distress, stabilizing the suit's functions, and identifying threats in the video feed.
    3. **Reliability**: In a high-stakes situation like this, Kafka's reliability ensures that no data is lost. If there are network interruptions or delays, Kafka can buffer and replay messages, ensuring that Tony has access to all the critical data.
    4. **Scalability**: If the crisis intensifies and more data needs to be processed, Kafka can scale horizontally by adding more Kafka brokers, allowing Tony to handle the increased data flow without performance issues.
    5. **Monitoring**: Kafka provides extensive monitoring capabilities, which could be depicted in the movie as Tony monitoring the health of the data pipeline in real-time, ensuring that he has a clear view of the suit's status.
    In this scenario, Kafka would enable Tony Stark to efficiently manage and respond to real-time data, enhancing his ability to control the Iron Man suit and handle the crisis effectively. It would add a layer of realism to the technological aspects of the movie.

  • @gautamkulkarni7049
    @gautamkulkarni7049 10 месяцев назад

    great overview man

  • @ZafaraliUZB
    @ZafaraliUZB 2 года назад +2

    Thanks for info! Can you please do a full video to teach js ?

    • @whatsppme4787
      @whatsppme4787 2 года назад +1

      Let's discuss about something bigger in this 2023✍️✍️👆♥️........ happy new year✍️✍️

  • @Lukas-vx8fr
    @Lukas-vx8fr 2 года назад

    You read my mind sir!

  • @lakshyabaghel1628
    @lakshyabaghel1628 2 года назад +1

    Just when i needed to learn kafka.

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Happy New Year 🎉🎊 👆👆 Thanks for Watching And Commenting, Text Me On 👆👆 WhatsApp We Have a Prize For you🎁

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Let's discuss about something bigger in this 2023✍️✍️👆♥️........ happy new year✍️✍️

  • @Im_Ninooo
    @Im_Ninooo 2 года назад +3

    NATS is another great tool that does sort of the same thing as Kafka. it's JetStream module is amazing!

    • @RedditFam
      @RedditFam 2 года назад +1

      currently doing some r&d on nats for my company and so far it looks way less complicated than kafka

    • @Im_Ninooo
      @Im_Ninooo 2 года назад

      @@RedditFam check out NSQ as well, it's slightly different but also written in Go and a great option.

  • @darkeryzz
    @darkeryzz Год назад +4

    I love honkai star rail 😨

  • @SmartWizzard
    @SmartWizzard 2 года назад +1

    Hey congratulation, you are in the top list - the results are in for 'State of Javascript' Survey

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @arinjoybasak8259
    @arinjoybasak8259 2 года назад

    Sounds like something I'd use on a beach vacation project.

    • @whatsppme4787
      @whatsppme4787 2 года назад

      👆Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️❤️❤️

  • @Bos_Meong
    @Bos_Meong Год назад

    Nice comprehensive video! I wonder when you will show us some impactful showcase. Like how should i build kafka better?

  • @IdealLab
    @IdealLab Год назад

    Now I wait for the Celery in 100 Seconds video to add it to my CV

  • @navdeepredefine
    @navdeepredefine 2 года назад +1

    Not sure about the developer but it's a good channel for a Product manager who can look at multiple techs from the top without going deep i to weeds

    • @whatsppme4787
      @whatsppme4787 2 года назад

      Glad you love the content ! I'll like to introduce you to something new............👆👆✍️✍️

  • @gyrhhik
    @gyrhhik Год назад +1

    thanks for the video

  • @neilclay5835
    @neilclay5835 2 года назад +1

    Very useful thanks

  • @BoloH.
    @BoloH. 2 года назад

    1:17 just use KRaft, it's production ready and is less of a hassle.

  • @marjelos
    @marjelos 2 года назад

    Sometimes I feel like these videos are created just to take me off the peak of my Dunning-Kruger curve.

  • @YAKSHA_02
    @YAKSHA_02 Год назад +380

    Totally not here while searching for kafka Honkai star rail..😂😂😂

  • @shashishekhar----
    @shashishekhar---- Год назад

    Thank you for this.

  • @robertmainville4881
    @robertmainville4881 Год назад

    It works in "real time" up to a certain point. Past a certain threshold, it slows down quite a lot. I would not use Kafka in a large scale environment where near real time (say under 5 seconds) is required consistently.

  • @adrianpop6521
    @adrianpop6521 Год назад

    Apache Kafka must be the coolest tech name ever

  • @emonymph6911
    @emonymph6911 2 года назад +1

    To use Kafka do we have to learn Java? If you only know Python or Go do you have to use like Azure event hubs instead?

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1 Год назад

      No Emo Nymph, to use Kafka ,Java is not compulsory , you can use Python or other programming languages also ..

  • @pavolkomlos3343
    @pavolkomlos3343 2 года назад +5

    Was expecting a philosophical analysis

  • @TundeEszlari
    @TundeEszlari 2 года назад

    Amazing video, keep it up. ;)

  • @mandrasaptakmandal636
    @mandrasaptakmandal636 2 года назад +25

    Request for GTK(specifically GTK4 and libadwaita). Its really hard to understand for absolute beginners. And also how to read its documentation and how the documentation are relevant for PyGTK, or Relm or GTK-rs. For example, its really confusing for devs who started by learning web technologies first and also its quite different from XAML based winapps. So it will be really be helpful if you guide us.

    • @fred.flintstone4099
      @fred.flintstone4099 2 года назад +1

      Well, it is hard to make a tutorial for GTK because you can code it in C, Python, Rust, etc, there are many language bindings. Also there are two ways to create GTK user interfaces, either programmatically by calling functions/classes, or decoratively in a XML file.

    • @ggorg0
      @ggorg0 2 года назад

      Agree, a Python GTK tutorial would be good

    • @KartonRealista2
      @KartonRealista2 2 года назад

      Iced is a far easier gui library to use with Rust. It may not be as full fledged, but the way it's designed is easier to understand, even without a tutorial vs gtk4rs with a tutorial.

    • @javierflores09
      @javierflores09 2 года назад

      these aren't tutorials though, they're just an overview. You are not really understanding anything from the video unless you already know the technology beforehand, just getting why it exists

    • @KartonRealista2
      @KartonRealista2 2 года назад

      @@javierflores09 I think he has made tutorials before, 100s is just one of the series on the channel

  • @timh6088
    @timh6088 2 года назад +5

    As Fireship awoke one morning from uneasy dreams he found himself transformed in his bed into a gigantic insect