Kafka to Kafka routing with external database table lookup in Apache NiFi

Поделиться
HTML-код
  • Опубликовано: 12 сен 2024
  • This video walks you through how to implement an efficient Kafka to Kafka routing based on an external mapping table.
    Based on some fields contained in the consumed messages, a destination topic must be retrieved from a mapping table of an external database before sending the message to the right Kafka topic.
    There are many ways to implement this use case with many different tools (Kafka Streams, Flink, Spark, etc). Here is a quick example using NiFi with a few processors allowing you to process billions of events super easily.
    Flow definition: gist.github.co...

Комментарии • 1