A Simple Kafka and Python Walkthrough

Поделиться
HTML-код
  • Опубликовано: 25 ноя 2024

Комментарии • 45

  • @arslanzahid4214
    @arslanzahid4214 2 месяца назад +3

    the best videos are usually the most underrated. This video is exactly what I needed. Learning micro servicing for real-time ML applications, and this is so helpful. Thanks a ton for this.

    • @QuixStreams
      @QuixStreams  2 месяца назад +1

      Thank fo watching. Please share our content on X and Twitter to spread the word!

  • @Apex543
    @Apex543 2 месяца назад +3

    how come this video has only 1K likes. gotta appreciate the man's effort

    • @QuixStreams
      @QuixStreams  2 месяца назад +1

      Thanks @Apex543. Please share on socials to help boost the numbers!

  • @arisweedler4703
    @arisweedler4703 5 месяцев назад +4

    I like how he formatted his code with a single space then a save at around 8:10.
    Had to fix the syntax error so the formatted could properly parse the Python. Dude is used to coding like this. Epic

    • @KyleReevesSci
      @KyleReevesSci 5 месяцев назад +2

      It's true, they're so at ease programming in python, it's really enjoyable to watch. Their clear commentary at the same time is like effortless choreography.

  • @souravbarua3991
    @souravbarua3991 6 месяцев назад +8

    Thank you🙏 for this video. Much needed. Please keeps coming this type of tutorial videos of kafka python with quixstreams. Please do make video on making dataframe with quixstreams (next level or say continuation of this video)

    • @QuixStreams
      @QuixStreams  6 месяцев назад +4

      Will do! Stay tuned, there's a video like that planned for this month. :-)

  • @shehanreshin
    @shehanreshin 6 месяцев назад +11

    Love your teaching style

  • @jesusjar11
    @jesusjar11 6 месяцев назад +6

    Wonderful! I dont do any python nor kafka, but surely its entertaining watching setting up a project from the ground up : )

    • @QuixStreams
      @QuixStreams  6 месяцев назад

      Thank you! Glad you enjoyed it.

  • @Ahmed.Abdalla.Mohamed
    @Ahmed.Abdalla.Mohamed Месяц назад +1

    Amazing style of teaching

  • @tonper
    @tonper 5 месяцев назад +2

    I was wondering what Kafka is, I think we could apply this concept at work... A big thank you, you earned a new subscriber

  • @rajkumar3433
    @rajkumar3433 5 месяцев назад +3

    I was looking for streaming data for forecasting model. ❤

  • @EndikaMT
    @EndikaMT 5 месяцев назад +4

    The way you explain is awesome. You are really good at teaching and explaining :)

  • @zedzpan
    @zedzpan 5 месяцев назад +3

    Thank you for this. It was incredibly easy to follow.

  • @chinyerenwigwe5166
    @chinyerenwigwe5166 5 месяцев назад +5

    You just got a new subscriber!!! Simple andl understandable

  • @MaddyIndia
    @MaddyIndia 5 месяцев назад +2

    So clean and easy explanation. Really like your style.

  • @TheMrSnuSnu
    @TheMrSnuSnu 5 месяцев назад +2

    Really good design patterns, thanks for the tutorial

  • @kushagrakumar-l4c
    @kushagrakumar-l4c 4 месяца назад +3

    Excellent video. Could you please provide some insights on how you configured your vim settings? If possible please make a video about Vim configuration for Python developers.

  • @steverosam1265
    @steverosam1265 6 месяцев назад +6

    Thanks. Love this

  • @TheAremoh
    @TheAremoh 5 месяцев назад +4

    Subscribed, liked and notification turned on. Great video ❤

  • @lucasdelargy
    @lucasdelargy 27 дней назад

    Thanks very much for the effort.

  • @florecista1
    @florecista1 5 месяцев назад +2

    Brilliant! Bravo! 👏👏👏

  • @rajkumar3433
    @rajkumar3433 5 месяцев назад +2

    ❤ learning python

  • @dreamyangel1858
    @dreamyangel1858 5 месяцев назад +4

    Neat video

  • @ipelezikis
    @ipelezikis 5 месяцев назад +5

    Nice! I didnt know this library. Any advantages/disadvantages over confluent-kafka and kafka-python?

    • @krisajenkins
      @krisajenkins 5 месяцев назад +2

      The big advantage is stream processing. All three libraries support producers and consumers, quixstreams also adds in Kafka Streams-style processing. If you ever need to write the kind of code that reads from one topic and writes to another, that's a huge addition.
      (There's a new video coming out later today that showcases the stream-processing part of the library. 🥳)
      For the producer/consumer side, quixstreams is actually using confluent-kafka under the hood, and exposes all the same options, so it's basically a superset of that library.
      Kafka-Python's big advantage is that it's native Python. Both quixstreams and confluent-kafka wrap the C client, librdkafka. That may be an important factor to you. Though given how good Python wheel support is these days, it's not as big a deal as it used to be. 🤷‍♂

  • @fanda10
    @fanda10 5 месяцев назад +4

    Hi, nice tutorial! I know it is only an example app, but it’s ok to keep producer open? Would it be better if we open it only just at write time? Thanks. 🙂👍

    • @QuixStreams
      @QuixStreams  5 месяцев назад +1

      Yes, that's fine. It's designed to be a long-running connection. 🙂

  • @SpringerJen
    @SpringerJen 5 месяцев назад +2

    This is neat

    • @QuixStreams
      @QuixStreams  5 месяцев назад

      Glad you liked it! 🙂

  • @CrypticConsole
    @CrypticConsole 5 месяцев назад +8

    why use this over kafka-python or confluent-kafka-python?

    • @QuixStreams
      @QuixStreams  5 месяцев назад +3

      The big advantage is stream processing. All three libraries support producers and consumers, quixstreams also adds in Kafka Streams-style processing. If you ever need to write the kind of code that reads from one topic and writes to another, that's a huge addition.
      For the producer/consumer side, quixstreams is actually using confluent-kafka under the hood, and exposes all the same options, so it's basically a superset of that library.
      Kafka-Python's big advantage is that it's native Python. Both quixstreams and confluent-kafka wrap the C client, librdkafka. That may be an important factor to you. Though given how good Python wheel support is these days, it's not as big a deal as it used to be. 🤷‍♂

  • @yifeitong
    @yifeitong 2 месяца назад +1

    Thanks for the video. I was following the step and got this error: KafkaException: KafkaError{code=_TRANSPORT,val=-195,str="Failed to get metadata: Local: Broker transport failure"}. Can anyone help with this ? Many thanks

    • @QuixStreams
      @QuixStreams  2 месяца назад +1

      There's a problem with the connection to the Kafka broker. This can be due to incorrect broker address, network issues, or broker unavailability.
      Check out the docs here: quix.io/docs/manage/troubleshooting.html#data-is-not-being-received-into-a-topic
      Or ask the community for help here join.slack.com/t/stream-processing/shared_invite/zt-2lxwg3a0l-6NIZuvkFVKrm6UTH_97iSA

  • @aleandromatteoni2462
    @aleandromatteoni2462 2 месяца назад +1

    What ide/text_editor are you using?

    • @QuixStreams
      @QuixStreams  2 месяца назад

      It's Neovim with some custom configuration. We recommend getting started with the Neovim Kickstart project and tailor to your preferences