How to choose the No. of Partitions for a Kafka Topic? Horizontal Scaling for Kafka Consumer

Поделиться
HTML-код
  • Опубликовано: 6 сен 2024

Комментарии • 11

  • @READBOOKIQBAL
    @READBOOKIQBAL 22 дня назад +1

    Good Stuff, Keep ti up.

  • @randomstuffsofdayandnight
    @randomstuffsofdayandnight 3 месяца назад

    Is there any default size(in kb/mb/gb) that a consumer can process per second in Kafka ?

  • @navaneethbusha5134
    @navaneethbusha5134 Год назад +1

    great knowledge sharing. If possible, please share your about, how to work over one producer to multiple consumer.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Год назад

      Hello Navaneeth Busha, Thank you for your kind words .. Regarding your request , you can refer below videos --
      Multiple Producer & Multiple Consumer in a Kafka Topic --ruclips.net/video/1Hn74td1vu8/видео.html
      Kafka Consumer Groups CLI Demo | Kafka-Python-- ruclips.net/video/yKzdum_vX7k/видео.html
      Manual Offset Commits & Exactly-Once Once Processing in Kafka Consumer using Python--ruclips.net/video/XRRyO6b9Wqg/видео.html
      These videos have some prerequisites which you can find in this playlist where all Kafka Concepts are explained in systematic order -- ruclips.net/p/PLjfRmoYoxpNrs0VmIq6mOTqXP52RfZdRf
      Hope this will be helpful! Happy Learning

  • @anthonya880
    @anthonya880 Год назад +1

    If possible plz make Kafka videos for Java devs also.
    We could also benefit from ur knowledge.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Год назад +1

      Hello Anthony A, actually, I am from Python background , you can get the theoretical understanding from my videos , and for practical implementation using Java, you can refer Stephane Maarek's lectures or Prashant Kumar Pandey's lectures ....

  • @akbarmunwar5435
    @akbarmunwar5435 Год назад +1

    Great,. Thanks

  • @ramagaur8413
    @ramagaur8413 Год назад

    Nice explanation, I have one question let's suppose we have 200 partition where producer is producing records but at consumer side we can't scale 200 consumers in a consumer group will in that case order of message be maintained?

  • @MrMadmaggot
    @MrMadmaggot 5 месяцев назад

    One thing is important hre, shouldnt it be automatic?