Introduction to Apache Kafka by James Ward
HTML-код
- Опубликовано: 6 сен 2024
- Please subscribe to our RUclips channel @ bit.ly/devoxx-...
Like us on Facebook @ / devoxxcom
Follow us on Twitter @ / devoxx
Apache Kafka has emerged as a next generation event streaming system to connect our distributed systems through fault tolerant and scalable event-driven architectures. Now open source through Apache, Kafka is being used by numerous large enterprises for a variety of use cases. This session will introduce the basics of Kafka and walk through some code examples that will show how to begin using it Наука
We hardly see someone explaining such a vast topic in such a concise and clear way. Really appreciate all the effort James, Kudos to you :)
I wish Apache's documentation read like he speaks...I have been so confused about the AdminClient API and various Kafka Java libraries and this guy actually defines terms in a clear way...why can't the vendors themselves present their products clearly???
Kafka is open source... so it's up to the community to define.
@@kjeldschouten-lebbing6260 if you are writing and submitting code, I would expect you to at least comment your code at the very least and then documentation on top. The open source community has produced plenty of documentation in their time but obviously may not have the same incentive as a funded company i.e. Confluent
Best Kafka intro by far.
Wow.. That was a absolutely great intro to Kafka. Thanks for that!
you're welcome
Great stuff. Would recommend repeating questions from the audience though as we can't hear it at all.
Good intro to Kafka. Easy to understand and it was explained well. Very good speaker.
Really an awesome presentation this one! cant help but keep coming back to this video to go back to the basics of Kafka..
Very good introduction. I've bought the book Kafka The Definitive Guide and it's all just so amazing. Guys, drop traditional messaging system brokers and adopt the Kafka way.
Precise Intro. Kudos
If a message gets a guaranteed commit to a leader, is it eventually guaranteed to make it to the quorum? If not, what happens to it?
Thanks James Ward!
I like James' way of presentation.
Nice presentation. Thanks
Great video
Writes straight to disk might be a problem for anyone using virtual servers with attached storage.Latency would be a killer, not to mention the overhead of having multiple nodes, even with pagecache to socket enabled. Other factors also come into play e.g. log compacting etc
Great job.
Clearest explanation! Great talk!
I'm confused. These comments seem to contradict each other:
@40:34 - A source is something that produces events, and the sink is something that consumes the event.
@44:58 - I create a plainSink which is... my sink is going to be the way that I get messages into Kafka.
@45:34 - code comments:
// sink is incoming driver messages
// source is outgoing rider messages
A sink in Akka Streams can receive messages which then get sent to Kafka. This gets tricky because in this example everything is bidirectional. There is a Kafka Sink and a Kafka Source. But also a websocket Sink and Source. Connected together like:
Browser -> WebSocket Source -> Kafka Sink -> Kafka -> Kafka Source -> WebSocket Sink -> Browser
Can we use consumer-groups on top of two Kafka Clusters, which are replicated using MirrorMaker?
If yes, will Kafka warranty the "Exactly One Time Delivery" policy?
Awesome talk! thanks
Excellent intro with example
Excellent Presentation
Great introduction to Kafka! Provides a great overview.
Excellent talk. By any chance, are thee slides shared somewhere ? Thanks
Here you go: presos.jamesward.com/introduction_to_apache_kafka/#/
Maybe a bit off-topic question, but how the presentation was made? Is there a tool for creating such presentations?
I used Reveal.JS: github.com/hakimel/reveal.js/
Thanks for the talk here. Very informative and great working life example
How did you make the car moving?
The code for that is at: github.com/jamesward/koober/blob/master/webapp/app/views/driver.scala.html#L88-L107
When talking about a new technology, it is best to stick to super conventional stuff around it - like the langauge and libraries. Don't mix Kafaka with Akka and a currently in fashion JVM language.
i have frequently thousand of files to process. each files takes about 5min. Can kafka distribute thing king of process over computers on my lical network ?
Awesome talk. Many thanks
Sound Introduction about Messaging system
very nice
When you want a good Kafka talk and the dude has the same damn name as you
Awesome , it was very useful introduction I enjoyed that!
great explanation
Where can I find the slides for this presentation?
Thanks
Here you go: presos.jamesward.com/introduction_to_apache_kafka/
Great but the use of the word "node" everywhere confuses me. It seams like one partition is a node, one consumer also is a node if I got it correctly. For him, node is a general term for defining a unity element.
Hi kanail, here node is nothing but a Kafka broker server which actually maintains the copy of partitions.
Thanks
Great talk!
Great video!!!!
If you watch this on 1.25 times the speed, he and his movements look like a Sim-Character and its animations.
could not resist.. indeed!
nice comment, its good with 1.25
one of the best!
Thank you for great information
awesome ,thank you
Thanks, great video! :)
save time, watch at 1.25!
Helpful talk!
Great tutorial....
Thanks 😊
Does anyone have the codes for this
I think this is the sample I used: github.com/jamesward/hello-play-kafka
Awesome..! Thank you..
This is great
hey American people, is this guy Californian? asking cos of his accent
Here's the code example he used: github.com/jamesward/koober
Great :)
I am a Kafka
why he seems so high
Интересная презентация, но боже мой, русские субтитры просто ужас. Query - корейцы?
sorry, I fell asleep. Was it good?
ZNQ
is it me or is this guy really hard to listen to without losing attention?
This guy has never been in real world. Salesman only.
Salesman opens ide??.... see at 43:59... if you say him as salesman for this demo.... LOL you are not an IT guy..
Right.. and his reason for creating 370 repos on github was just to fool you. :)
jamieward45?
thanks