Kafka Topics, Partitions and Offsets Explained

Поделиться
HTML-код
  • Опубликовано: 9 фев 2025
  • НаукаНаука

Комментарии • 43

  • @StephaneMaarek
    @StephaneMaarek  5 лет назад +2

    If you want to learn more, check out my Apache Kafka Series - Learn Apache Kafka for Beginners v2 course : links.datacumulus.com/apache-kafka-coupon

    • @irajonah3108
      @irajonah3108 3 года назад

      I guess I'm kind of off topic but do anybody know of a good website to stream newly released tv shows online ?

    • @roydouglas7264
      @roydouglas7264 3 года назад

      @Ira Jonah try FlixZone. Just search on google for it :)

    • @marcelokairo9092
      @marcelokairo9092 3 года назад

      @Roy Douglas definitely, have been using flixzone for since march myself =)

    • @irajonah3108
      @irajonah3108 3 года назад

      @Roy Douglas thanks, I went there and it seems to work =) I appreciate it!!

    • @roydouglas7264
      @roydouglas7264 3 года назад

      @Ira Jonah Glad I could help :D

  • @777megapixel
    @777megapixel 3 года назад +3

    That's a kind of a lecture people are usually dreaming of! I'm just getting started with Kafka and your lessons have made my day: thank you

  • @MrBdoleagle
    @MrBdoleagle 2 года назад

    your videos are the best in explaining how kakfa works, clear and neat.

  • @aaandrade5
    @aaandrade5 5 лет назад +3

    honestly this is much better than linuxacademy

  • @cvarun9221
    @cvarun9221 Год назад

    The most simplest explanation.

  • @satyaprakashparida5507
    @satyaprakashparida5507 3 года назад

    Thanks a lot. I am thinking that I got the best Kafka materials.

  • @maddymaddy5832
    @maddymaddy5832 9 месяцев назад

    Best kafka video.. thank you

  • @luigitorchia7294
    @luigitorchia7294 5 лет назад +5

    Brilliant lecture!!! thank you!

  • @Gamer_with_knowledge
    @Gamer_with_knowledge 2 года назад

    Thanks a lot for these excellent lectures ❣

  • @pawegrzesik4449
    @pawegrzesik4449 4 года назад +2

    How make partition we need to create? How to calculate the proper number of it? What if I will have just 1 partition?

  • @aleman7
    @aleman7 10 месяцев назад

    hi, great video. i'm trying to find a strategy to resolvé transaction for microservicios comunicated each others by Kafka. Do you think that is posible? thanks for your help.

  • @sreenivasamadenahall
    @sreenivasamadenahall 4 года назад +1

    Thank you, very well explained.

  • @roliagrawal3124
    @roliagrawal3124 Год назад

    So as u said once it’s written at offset we can not update it that means the same data we can not update it?

  • @ValmikKalathia
    @ValmikKalathia 3 года назад

    Thank you. It was a really nice explanation.

  • @swapnila202
    @swapnila202 5 лет назад +1

    Owsomely explained 👍

  • @prasadpsp
    @prasadpsp 4 года назад

    A very good tutorial. thank you.

  • @essskkk
    @essskkk 4 года назад

    Great Lecture , Thanks a lot !!!

  • @yunlin3980
    @yunlin3980 3 года назад

    When a consumer is to consume N records from Partition 0, 1, 2 of a topic, what does it mean? Is it reading N records from each partition? That would make it 3N records in total. Is it reading in round-robin fashion from partition 0, 1, 2, until the total read records is N?

  • @padmanathanramasamy8354
    @padmanathanramasamy8354 2 года назад +1

    In your truck_gps example, you have created 10 partition and created truckId as a key. In this case the first 10 unique truck id will stored on each partition. what happen when we get the 11th truckId to which partition it will go?

  • @adamnhas7547
    @adamnhas7547 3 года назад

    Merci beaucoup. Very clear.

  • @masonlu100
    @masonlu100 4 года назад

    thanks, very helpful

  • @sushmakl4392
    @sushmakl4392 2 года назад

    how do I collect data from Kafka topic as batches and then use poll to send data to Redshift in intervals of time

  • @Pavan-MGM-IT-Training
    @Pavan-MGM-IT-Training 3 года назад

    can some one who is good in PPTs explain how those Message boxes are designed in power point?

  • @DevWonYoung
    @DevWonYoung 5 лет назад +1

    Thank you sir

  • @DragonKlavier
    @DragonKlavier 4 года назад

    Thank you so much!

  • @ranjulahettiarachchi8525
    @ranjulahettiarachchi8525 4 года назад +1

    Thanks you!

  • @dhruvildoshi2368
    @dhruvildoshi2368 5 лет назад +1

    Where does kafka stores offsets of all partitions?

  • @PONSONT
    @PONSONT 5 лет назад +1

    Thank you...

  • @meghanapulavarthy4036
    @meghanapulavarthy4036 3 года назад

    How to fetch offset for particular events in the consumer??

  • @andrewkondrashov6485
    @andrewkondrashov6485 4 года назад +1

    What for i have to use partitions?

  • @markmariq
    @markmariq 4 месяца назад

    You have conflicting information on data retention, another slide says 2 weeks and this one says 1 week.

  • @pradeepb355
    @pradeepb355 3 года назад

    How create dynamic topics

  • @chinmayshetye3
    @chinmayshetye3 2 года назад

    nicee

  • @ethanquenum4778
    @ethanquenum4778 2 года назад

    You must be french.

    • @pierresun3660
      @pierresun3660 Год назад

      no his English is too good for a French