The Best Queue System for Scaling - Not Kafka!

Поделиться
HTML-код
  • Опубликовано: 23 ноя 2024
  • Hey everyone, In this video, we are going to have a look at different Queue systems and services out there such as AWS SQS, Redis Bull MQ, RabbitMQ, Kafka and also why RabbitMQ really shines out.
    Quick Links
    Premium Docker Course: pro.piyushgarg...
    Video Titles
    Queue System
    RabbitMQ
    RabbitMQ vs AWS SQS
    BullMQ Queue
    Hashtags
    #systemdesign #bullmq #redis #rabbitmq #redis #kafka #nodejs #python #llm #ai #fullstackwebdevelopment #backendwebdevelopment #coding #programming

Комментарии • 62

  • @vineetgarg9125
    @vineetgarg9125 11 часов назад +22

    Dear Piyush, Rabbit creates a separate copy for each queue where it needs to publish message. If there are 1 million messages to fan out to 5 queues, we will need 5x space on rabbit. As you scale it will slow down rabbit and cluster will need more and more space, memory and computing resources. Your opinions on setting up kafka being difficult etc are mere opinion. Rabbit also needs similar setup. The way Kafka handles the fan out use case is not 'hacky' rather smart and efficient. Kafka maintains one copy of each message (ignoring replicas) which consumers on different consumer groups can consume. You have an obligation to your 200k subscribers to research well before publishing any content your channel. Thanks.

    • @shabarinathk8954
      @shabarinathk8954 9 часов назад +1

      Thanks for saying this out loud 😅

    • @amanshrivastava7495
      @amanshrivastava7495 7 часов назад +3

      100% agreed. I am a senior software engineer at confluent, and have some good enough understanding of how kafka works internally.
      The whole USP of kafka is its high throughput in high volume systems.
      Just because you have a bias and opinion for one tool or technology, doesn’t mean you can put out any half baked information on the internet.
      Rabbit has its own benefits and is good for use cases where its required.But saying its the best mq in terms of scaling is lowkey immature.
      Just my thought with over 10 years of working experience.

    • @ryostyles9904
      @ryostyles9904 2 часа назад

      Well said

    • @syedleaf728
      @syedleaf728 14 минут назад

      I think we should appreciate for the work and hope fully next time he tries to not do the same mistake

    • @Krishnadevaraya1
      @Krishnadevaraya1 4 минуты назад

      May be his next course is on rabbit mq thats why he is giving unnecessary hype to it tipical RUclipsr startegy

  • @md-Anamul-Haque
    @md-Anamul-Haque 10 часов назад +10

    please make a course/tutorial of mediasoup

  • @arpandas2074
    @arpandas2074 13 часов назад +11

    Yes We want project using rabbit MQ

  • @NeelPrajapati-v7c
    @NeelPrajapati-v7c 12 часов назад +4

    Ha Bhai banao video ❤❤❤

  • @aadarshgurug
    @aadarshgurug 9 часов назад +1

    definitely we would like to have a full stack project using rabbit MQ

  • @killerboy5278
    @killerboy5278 10 часов назад +1

    yess need a project using rabbit mq

  • @RitikJha-wb8ep
    @RitikJha-wb8ep 12 часов назад +2

    Yes sir want video for project using RabbitMQ

  • @arslanaslam7984
    @arslanaslam7984 13 часов назад +1

    great knowledge brother. make a full video for microservices using Node or Python as you like, having RabbitMQ, K8, etc

  • @jagjitsingh6144
    @jagjitsingh6144 14 часов назад

    Bro I wait for this type of video 🎉🎉🎉🎉🎉 full support brother ❤🎉🎉🎉

  • @TechnicalRNP
    @TechnicalRNP 13 часов назад +3

    So for Pub/sub should we use redis or rabbitMQ? Which one will be better
    For publishing updates
    For eg: the work is processed update msg

    • @Coderex-w9v
      @Coderex-w9v 13 часов назад

      @@TechnicalRNP 🐰 mq

    • @shabarinathk8954
      @shabarinathk8954 9 часов назад

      Kafka is still the king

    • @TechnicalRNP
      @TechnicalRNP 8 часов назад

      @shabarinathk8954 ik no doubt about it but I'm not talking about Kafka 🤦

  • @swapnilpatel3337
    @swapnilpatel3337 14 часов назад +2

    Hello sir waiting for this type of video

  • @explorewithkrrish
    @explorewithkrrish 10 часов назад +1

    amazing

  • @localhub3789
    @localhub3789 8 часов назад

    thanks video was amazing

  • @CodeNinja18
    @CodeNinja18 12 часов назад +1

    Title of the video : Piyush teaching Queues 😁

  • @jaadu2551
    @jaadu2551 6 часов назад

    yes full stack video with rapid mq

  • @vishalmehta7753
    @vishalmehta7753 14 часов назад +1

    Thanks ❤

  • @kuldeepsaini460
    @kuldeepsaini460 13 часов назад

    I think I have learned soo much from a video

  • @PratikGupta-cw3gx
    @PratikGupta-cw3gx 13 часов назад

    Also make video on NATS message system. It's really vast with wesbsocket, jetstream, queue and many more Please make one video on that.

  • @parassharma7041
    @parassharma7041 13 часов назад

    I'm also using rabbit mq for my micro services

  • @shakeebanwar4403
    @shakeebanwar4403 6 часов назад

    Please make a detailed video of rabitmq

  • @sourabhsingh4515
    @sourabhsingh4515 12 часов назад

    project chahiye rabbitmq pe aur agar project nai to jaise kafka ka video hai ek vaisa video for getting started with rabbit mq

  • @NeelPrajapati-v7c
    @NeelPrajapati-v7c 13 часов назад

    Nice explanation ❤❤❤

  • @haniahani5351
    @haniahani5351 11 часов назад

    Yes project with rabbit mq

  • @abhaypundora6841
    @abhaypundora6841 12 часов назад

    Should I learn Kafka or RabbitMQ and use them in simple projects? Any suggestions? ( As a beginner)

  • @SelfLerner
    @SelfLerner 12 часов назад

    Please make a RabbitMQ crash course before project.

  • @Coderex-w9v
    @Coderex-w9v 14 часов назад +1

    Microservices bi kardo please express Kafka docker k8s nginx etc please in video
    But project Mai sari kardo

  • @solocoder2783
    @solocoder2783 13 часов назад

    super knowladge

  • @azharalibhutto1209
    @azharalibhutto1209 12 часов назад

    Great ❤❤❤

  • @prashlovessamosa
    @prashlovessamosa 13 часов назад

    Just a suggestion please build eda with node and rabbit mq.

  • @NeelPrajapati-v7c
    @NeelPrajapati-v7c 13 часов назад

    Make more videos like this topics ❤❤❤❤❤❤❤❤

  • @crazyparrot2786
    @crazyparrot2786 14 часов назад

    Which camera do you use?

  • @Tima-ql7on
    @Tima-ql7on 12 часов назад

    Cricket feeding panel ka artitechture batao bhai

  • @snehasish-bhuin
    @snehasish-bhuin 13 часов назад

    Yes we want project on rabitmq

  • @Coderex-w9v
    @Coderex-w9v 13 часов назад

    Great content 👍❤❤❤❤❤❤❤

  • @drac8854
    @drac8854 11 часов назад

    Bachpan me queue padha hoga are bhai kitna hurt karo ge.... 5 saal pahale padha tha.....

  • @_ayush_oswal
    @_ayush_oswal 10 часов назад

    need a projecttt!!

  • @AKASHROY-i9f
    @AKASHROY-i9f 12 часов назад

    kafka zookeeper kya hota hain bhai

  • @razahussain34
    @razahussain34 12 часов назад

    Sir Rust ko continue karayn

  • @NeelPrajapati-v7c
    @NeelPrajapati-v7c 13 часов назад

    Nice video ❤❤❤❤

  • @Uzaifm127
    @Uzaifm127 11 часов назад +1

    Hoodie kaafi acchi hai Sir. Maybe you can get the attraction from girls.

  • @NeelPrajapati-v7c
    @NeelPrajapati-v7c 12 часов назад

    Project banao Bhai ❤❤❤❤

  • @jatinsharma3792
    @jatinsharma3792 10 часов назад

    Kya h gpu ?!

  • @solocoder2783
    @solocoder2783 13 часов назад

    need a project

  • @akash-kumar737
    @akash-kumar737 14 часов назад

    Oh no, last week I learned Kafka 😢😢😢

  • @codewitharijit3260
    @codewitharijit3260 12 часов назад

    100 like ❤

  • @syscrews
    @syscrews 13 часов назад

    project

  • @KunalVerma.
    @KunalVerma. 6 часов назад

    @piyushgargdev can you discuss some real ideas where I can implement some of these 6 very heavily, not building anything that would need this as of now.

  • @Mcm1182
    @Mcm1182 10 часов назад

    Yes We want project using rabbit MQ