Apache Kafka vs message queue explained

Поделиться
HTML-код
  • Опубликовано: 1 сен 2022
  • How Apache Kafka compares to a traditional message queue?
    In this video, we will go over key features provided by Apache Kafka and see how it compares with traditional message queue systems.
  • НаукаНаука

Комментарии • 59

  • @relbis-labs
    @relbis-labs  10 месяцев назад

    Want to see more videos like this? Let us know what topics you are interested in.
    Looking for tailored consultations and mentorship sessions? Reach out to us via email at info@relbis.com.

  • @bokistotel
    @bokistotel 3 дня назад

    This is quite possibly the best explanation on youtube. Clear and concise. Great work!

  • @Perthorn
    @Perthorn 10 месяцев назад +5

    perfect comparison, much better video than dozens I found here on YT, thanks a lot!

  • @francodagostino2143
    @francodagostino2143 11 месяцев назад +7

    I think that in the "Kafka consumer limit" it should be mentioned that the limit exists within a consumer group, and you can have multiple consumer groups.

    • @relbis-labs
      @relbis-labs  10 месяцев назад +1

      Good point! Thank you for the feedback!

  • @kalmanjudin1336
    @kalmanjudin1336 Год назад +1

    This is exactly what I needed! Subscribed for more.💥💥💥

  • @dhanraajpatil9990
    @dhanraajpatil9990 Год назад +80

    Amazing video, Please remove the music.

    • @relbis-labs
      @relbis-labs  Год назад +1

      Will work on it. Thank you for honest feedback!

    • @TonyBologna999
      @TonyBologna999 Год назад +1

      Wow, the music is ridiculous. What - am I supposed to get up and dance while learning about message queues?

    • @relbis-labs
      @relbis-labs  Год назад +10

      Why not? Movement helps learning!

    • @crazychase443
      @crazychase443 2 месяца назад +1

      I loved the music!

  • @msieurkris
    @msieurkris Год назад +2

    Quick and clear, good job !

  • @yogeshkurane123
    @yogeshkurane123 Год назад

    Thanks for sharing!

  • @yulia0g
    @yulia0g Год назад

    great video, thank you!!!

  • @kalaimaranmadhavan4182
    @kalaimaranmadhavan4182 Год назад +1

    The best video which I saw once and understand this concept. Want more videos like this

  • @saralightbourne
    @saralightbourne Год назад +3

    very nice visualisation, thank you a lot! and unlike other people, i personally like the music, quite soft and inconspicuous~

    • @relbis-labs
      @relbis-labs  Год назад +1

      Huge thank you for taking your time and sharing your thoughts! I am very happy that you liked the music!

  • @tyronefrielinghaus3467
    @tyronefrielinghaus3467 9 месяцев назад +9

    Please, please, ditch the intrusive music....makes it REALLY HARD to concentrate.

  • @user-zg1mw4id1t
    @user-zg1mw4id1t Год назад +1

    It's very useful for me, great job!😄

    • @relbis-labs
      @relbis-labs  Год назад

      Thank you for the feedback! Really appreciate it!

  • @pillibabu1890
    @pillibabu1890 Год назад

    PLz provide full course Apache Kafka with diagram
    it is awesome

  • @ucminhnguyen3356
    @ucminhnguyen3356 6 месяцев назад

    At second 4:30, why is that after message 2 fails to be received by consumer 2 and then the process is restarted, the message is sent to consumer 1 instead of consumer 2? I thought that each consumer only reads messages from only 1 partition?

    • @relbis-labs
      @relbis-labs  6 месяцев назад +1

      In this case, consumer # 2 stops due to an error and does not recover. After that consumer #1 takes over processing of messages.
      Sorry for the confusion.

  • @marcgentner1322
    @marcgentner1322 Месяц назад

    What is a consumer a server or a cache db?

    • @relbis-labs
      @relbis-labs  Месяц назад

      Consumers are applications that process events.
      See this page for details: kafka.apache.org/documentation/#:~:text=Producers%20are%20those%20client%20applications%20that%20publish%20(write)%20events%20to%20Kafka%2C%20and%20consumers%20are%20those%20that%20subscribe%20to%20(read%20and%20process)%20these%20events

  • @thesadanand6599
    @thesadanand6599 Год назад +1

    nice... Keep the code simple😊

  • @dhineshs6210
    @dhineshs6210 3 месяца назад

    Good explanation

  • @KishoreKumar-ur3br
    @KishoreKumar-ur3br 8 месяцев назад +1

    i think the information presented for queue broadcasting is incorrect. Messaging model is either point-to-point or pub-sub. When messaging model is pubsub, we require a message broker inbetween the producer and consumer. The message broker creates copy of the message and it is put into the subscribing MDB(Message Driven Bean). Is it not ?

    • @relbis-labs
      @relbis-labs  8 месяцев назад +1

      @KishoreKumar-ur3br,
      We appreciate your question! 🤝
      In this video, we are talking about a traditional message queue. Publish-subscribe messaging pattern uses a different approach.
      We understand that many modern message brokers support multiple messaging models/patterns. However, this video is not comparing Apache Kafka with a specific implementation of a message broker. The purpose of this video is to compare Apache Kafka with a traditional message queue.
      You can find the definition of a message queue using the following links:
      - aws.amazon.com/message-queue/#:~:text=A%20message%20queue%20is%20a,once%2C%20by%20a%20single%20consumer.
      - en.wikipedia.org/wiki/Message_queue
      Please feel free to follow up and comment, if something is not clear. 👍

    • @SO-jp6gh
      @SO-jp6gh 4 месяца назад

      Yes, Kafka vs. MQTT Pub/Sub would be a better comparison. Maybe you could create that video next?

  • @hahachannel7323
    @hahachannel7323 6 месяцев назад

    very useful

    • @relbis-labs
      @relbis-labs  6 месяцев назад

      Glad to hear that! Thank you!

  • @sumitbabel5415
    @sumitbabel5415 4 месяца назад

    Very nice

  • @kiran36992
    @kiran36992 8 месяцев назад +1

    Even in traditional pub sub, multiple subscribers possible. IBM MQ, AWS SNS ....

  • @alyeldweny6396
    @alyeldweny6396 Год назад +2

    Thanks for the video, but It will be nice if you remove the music

    • @relbis-labs
      @relbis-labs  Год назад

      Thank you for your feedback! Will definitely work on improving the music part.

  • @ChrisAthanas
    @ChrisAthanas Год назад +5

    Music is super annoying please remove during the lesson

  • @alexzhang9318
    @alexzhang9318 6 месяцев назад +1

    BGM is troubling and distracting.

    • @relbis-labs
      @relbis-labs  6 месяцев назад

      Appreciate the feedback! Will be fixed in next videos.

  • @francogb
    @francogb Год назад +2

    Nice work! Please remove the music

  • @alphabasic1759
    @alphabasic1759 Год назад +3

    This is all such nonsense. The major queue products support the same functionality as Kafka. It’s entirely a matter of how you choose to configure them.

  • @ycce17
    @ycce17 3 месяца назад

    Background music is too loud and shady

    • @relbis-labs
      @relbis-labs  3 месяца назад

      My apologies. New videos will not have this problem!

  • @jenskeckstein1616
    @jenskeckstein1616 Год назад +3

    Good video .. horrible music 🙊

    • @relbis-labs
      @relbis-labs  Год назад

      I really appreciate your feedback. Thank you!

    • @tuanva6484
      @tuanva6484 Год назад

      Mosquitoes music

  • @shabi9
    @shabi9 Год назад +2

    remove the music please

  • @ievgen6209
    @ievgen6209 Год назад +2

    imo, these comparisons are wrong

  • @user-zq8bt6hv9k
    @user-zq8bt6hv9k Год назад +1

    keep your code simple, don't use kafka

    • @relbis-labs
      @relbis-labs  Год назад

      Why not?

    • @user-zq8bt6hv9k
      @user-zq8bt6hv9k Год назад +1

      @@relbis-labs there is no reason to use it. We lived without Kafka for decades, we survived. I've used Kafka in the past, even used it for personal projects. Discovered it was a worthless overcomplicated tool.

    • @relbis-labs
      @relbis-labs  Год назад +1

      A lot of people who use it have a lot of reasons to do so. As in any engineering discipline, we must use the right tool for the job.
      Still really appreciate you sharing your thoughts and your opinion, even if it does not align with our point of view. Having diverse opinions helps everyone to learn and grow.