In depth intuition on Manual Offset Commits & At Least Once Processing in Kafka Consumer

Поделиться
HTML-код
  • Опубликовано: 18 сен 2024
  • In this video Manual Offset Commits in Kafka Consumer & At Least Once Processing in Kafka Consumer in Kafka Consumer is covered in detail .
    Architecture:
    --------------------------
    github.com/Sat...
    Prerequisite:
    --------------------------
    Consumer & Consumer Group in Kafka
    • Consumer & Consumer Gr...
    Kafka Consumer Groups CLI Demo | Kafka-Python
    • Kafka Consumer Groups ...
    Kafka Consumer using Python & Concept of Offset-Commit
    • Kafka Consumer using P...
    In-depth intuition on Kafka Consumer Internal Architecture
    • In-depth intuition on ...
    Check this playlist for more Data Engineering related videos:
    • Demystifying Data Engi...
    Apache Kafka form scratch
    • Apache Kafka for Pytho...
    Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
    doc.clickup.co...
    🙏🙏🙏🙏🙏🙏🙏🙏
    YOU JUST NEED TO DO
    3 THINGS to support my channel
    LIKE
    SHARE
    &
    SUBSCRIBE
    TO MY RUclips CHANNEL

Комментарии • 1

  • @AmanChourasia-b3c
    @AmanChourasia-b3c Год назад

    Hi, thanks for this video, have a question, what if we never commit offset, let's say processing is failing again and again, what will be the behaviour? Will there be an infinite polling or offsets will be committed after some retries?