It's probably worth mentioning that messaging systems (like Kafka) don't just do message transportation - they also provide buffering so that producers and consumers don't have to operate synchronously.
This is the vital part, that was 50k oveview on usage but underlying functionality like topics, producer consumer , queing ,de-queing should be explained as well coz thats the beauty of kafka
Starting off with the slide that says "simple at first" is an accurate assessment of Kafka as well... Beware of message formats. Usually the one you use first will stick around forever. Also, leader for each partition is responsible for all reads and writes. The higher the replication factor for a topic, the greater the load on the leaders.
Hands-on Kafka in 35 minutes!! Checkout out this video playlist here: ruclips.net/p/PLSMAAT50NTjRqga9HqKdcA0J_I1h6aw_d , please do subscribe 😊so that I get motivated and keep giving good content.
Thorough Notes Apache Kafka is a solution to the problem of managing and processing streams of data in real-time. Kafka was created by LinkedIn and is now an open-source project maintained by Confluence, under the Apache stewardship. Kafka is a distributed, resilient, and fault-tolerant system that scales horizontally. It can handle clusters with over 100 brokers and can process millions of messages per second. Kafka is used to decouple data streams and systems. Source systems send their data to Kafka, and target systems source their data from Kafka. Kafka can handle any data stream, including website events, pricing data, financial transactions, and user interactions. Once the data is in Kafka, it can be sent to any system, such as a database, analytic systems, email system, or audit system. Kafka can be used as a messaging system, for activity tracking, gathering metrics, stream processing, decoupling system dependencies, and big data integrations. Kafka is used by over 2000 firms, including 35% of the Fortune 500. Companies such as LinkedIn, Airbnb, Netflix, Uber, and Walmart use Kafka. Kafka is used in real-time applications. For example, Netflix uses Kafka to apply recommendations in real-time, Uber uses it to compute and forecast demand and surge pricing, and LinkedIn uses it to prevent spam and make better connection recommendations.
is kafka keeping an address map of all the services? So, if one services wants to send a message to another, it only has to tell the service name. Am I thinking in the right direction?
hi awesome course! I understand Kafka consumers use a pull model to consume data. My question is about connectivity in AWS cloud when the Kafka Consumer is in a separate AWS VPC to the Kafka server . Do we need to configure an inbound or outbound connection to the Kakfa server? thanks for any clarification - Robin
I appreciate your effort to create the video, thanks for that, however I really feel an introduction to Kafka could use some more detail. I found the information very high level and vague.
Quick question. Could dynamo db streams replace apache kafka for most use cases? It has both: db(for events)+ streams. On top of that it's serverless. ? I know it can and do it for cases we use it for. But what is your take?
Is Kafka built with ML algorithms along with decoupling of data streams to various sources? Was it only Kafka since Netflix came up with recommended engines?
If you want to learn more, check out my Apache Kafka Series - Learn Apache Kafka for Beginners v2 course : links.datacumulus.com/apache-kafka-coupon
kindly request for you kafka install i struggle could you please help me. problem for cmd prompt
D €$
@@RajKumar-zo6kl 55555555555555t55555t55555555555t555t555555555555555t555555555555y
Do you have kafka tutorials for golang ? thanx
Hi stephane do you have kafka tutorials for golang ?
You are an awesome teacher, I cleared my AWS SA02 Associate exam with the help of your course on Udemy!
Did you just refer this udemy tutorial or any additional preparation was needed?
It's probably worth mentioning that messaging systems (like Kafka) don't just do message transportation - they also provide buffering so that producers and consumers don't have to operate synchronously.
This is the vital part, that was 50k oveview on usage but underlying functionality like topics, producer consumer , queing ,de-queing should be explained as well coz thats the beauty of kafka
Your courses are the best, helped be get certified a few times on AWS. Thanks Stephane
Starting off with the slide that says "simple at first" is an accurate assessment of Kafka as well...
Beware of message formats. Usually the one you use first will stick around forever.
Also, leader for each partition is responsible for all reads and writes. The higher the replication factor for a topic, the greater the load on the leaders.
Very simply put, probably the easiest to understand explanation on this topic I have encountered yet.
Hats off to you for making such clear and crisp video so that anyone can easily gets a clear picture of Kafka and its use cases....Thanks a lot..!
Exactly what I was looking for when I searched for "What is Kafka"...thank you!
This is the best course I have ever done on kafka. Short and best
This is an underrated channel.
Amazing, Precise, Useful video. Adorable work
This content never gets old ! Thank Stéphane !
I'm about to have a 12 days Kafka training. Thank you for sharing this information about Kafka.
Hey Stephane, I just want to thank you for the AWS SAA-02 course in Udemy. I have bought it and pass the exam.
Congratulations on your achievement! You’ve done great! Keep it going! :)
Better explanation than I could dream of. Hats off to you sir!
This guys' video is so smooth and intuitive. Like it!
Super leture, straight forward, direct point
Excellent presentation👍👍👍
I became fan of Stephane teaching from Udemy..that helped me gain certification..
Excellent way of presenting! So easy to understand with your content in the slide. 👌👌
A great video, no words to explain how its going to help me. Thanks.
Great, effective effort here Stephane
This is a very good introduction ! Thank You so much for doing this.
Hands-on Kafka in 35 minutes!! Checkout out this video playlist here: ruclips.net/p/PLSMAAT50NTjRqga9HqKdcA0J_I1h6aw_d , please do subscribe 😊so that I get motivated and keep giving good content.
thank you so much for a very short explanation . it worked for me.
Very crisp and precise introduction for Kafka to start with. Thank you
Very simple five minute explanation
really understandable, easy explanation . i hope not problem to watch and learn from your video.
great explanation, finally i understood exactly is apache kafka, thanks for your time!
Really appreciated the video. Clear, concise, great examples!
Thanks! The examples/use cases really helped.
Real short and useful. Thanks
Ur explanation was to the point thanks buddy
This video is just amazing!! Thank you.
That was really a great introduction.
Thank you for the neat and informative introduction!
Very clear and to the point video. Thanks a lot Stephane..
Thorough Notes
Apache Kafka is a solution to the problem of managing and processing streams of data in real-time.
Kafka was created by LinkedIn and is now an open-source project maintained by Confluence, under the Apache stewardship.
Kafka is a distributed, resilient, and fault-tolerant system that scales horizontally. It can handle clusters with over 100 brokers and can process millions of messages per second.
Kafka is used to decouple data streams and systems. Source systems send their data to Kafka, and target systems source their data from Kafka.
Kafka can handle any data stream, including website events, pricing data, financial transactions, and user interactions.
Once the data is in Kafka, it can be sent to any system, such as a database, analytic systems, email system, or audit system.
Kafka can be used as a messaging system, for activity tracking, gathering metrics, stream processing, decoupling system dependencies, and big data integrations.
Kafka is used by over 2000 firms, including 35% of the Fortune 500. Companies such as LinkedIn, Airbnb, Netflix, Uber, and Walmart use Kafka.
Kafka is used in real-time applications. For example, Netflix uses Kafka to apply recommendations in real-time, Uber uses it to compute and forecast demand and surge pricing, and LinkedIn uses it to prevent spam and make better connection recommendations.
Thank you Stephen for making this simple to understand video. Keep them coming. 🙏👍
This was AWSOME thank u so much for doing this video 🙏🏻
Thank you for the intro!
great intro to the topic
Great video man
Stephane you are awesome man....you made it easy.. thanks....!!
This was helpful, thanks 🙏
Awesome. Liked and subscribed. Interesting. Keep going. Lots of thanks love and best wishes.
For example is the best part. 🔥
Good explanation& good real life examples , Thank you so much
cool presentation, thanks. Helps a lot 😊
Thank you. It was great video.
Thanks Stephane! Very good intro and explanations with real-time examples!
fantastic explanation over Kafka in such a short time. Thank you so much.
Awesome job, thank you!
Hi. I think it would have been good to mention where kafka queues will be. Ram or disk. Thanks for sharing.
excellent video. thank you for the great content
Real time is not low latency. Real-time is deterministic latency and processing times.
Good first introduction
Insightful video!
Thumbs up for this one. Awesome job. Looking forward to more of them.
Thanks for presenting this one . I'm really Impressed !
Thanks Stephane, great video!
Hi stephane do you have kafka tutorials for golang ?
Is Kafka like a data lake where we can dump data from all source systems?
very clear video thank you
Really good presentation. Thanks, Stephane
great video, straight to the result.
It's very good easy to digest!!!
Hi Stephane the real time recommendations in Netflix witch you gave as example does uses kafka to get those data or is it AI at back-end in Netflix?
Awesome Explanation
is kafka keeping an address map of all the services? So, if one services wants to send a message to another, it only has to tell the service name. Am I thinking in the right direction?
nice video, clear and nice explained. well done
भौते बढ़ियाँ बता हो दाज़्यू तुमल.. जी राया जागि राया
Wonderful introduction!
Good and understandable introduction. Gold!!
Awesome video. Thanks buddy 👍
What I always miss in tutorials is where to not use Kafka and what are the disadvantages, eg. SPOF. What is the difference to a ESB from the 90th?
Kafka is a beast to manage. I'm sure it's fine to develop against. Buts it's a nightmare for most operation staffs.
hi awesome course! I understand Kafka consumers use a pull model to consume data. My question is about connectivity in AWS cloud when the Kafka Consumer is in a separate AWS VPC to the Kafka server . Do we need to configure an inbound or outbound connection to the Kakfa server? thanks for any clarification - Robin
Explained clearly 👍thanks mate!
good video! thank you
Succinctly, right to the point. Thank you Stephane outstanding brief!
Nice intro, thanks buddy
Could you please share any doc describing the steps for Oracle golden gate integration with Kafka?
I appreciate your effort to create the video, thanks for that, however I really feel an introduction to Kafka could use some more detail. I found the information very high level and vague.
great short introduction to Kafka!
Very good explanation
This is a great course.
What s the difference between a distributed messaging system like Kafka and having an API proxy like Apigee please?
Great , I have a question in this source systems and target systems to avoid confusion we use Kafka , Can we use ESB instead or integration bus ?
Is his aws sa02 course enough to pass to get aws certification sitll? thank you
Thanks u made it easy to understand
Quick question. Could dynamo db streams replace apache kafka for most use cases? It has both: db(for events)+ streams. On top of that it's serverless. ? I know it can and do it for cases we use it for. But what is your take?
It would be nice to say what you define as "source system" and "target system" to remove chance of ambiguity.
Great video. Thanks!
What happens when Apache Kafka becomes the bottleneck?
I think REST is not a protocol but a middleware using a protocol like http, to transport data, right ?
Is Kafka built with ML algorithms along with decoupling of data streams to various sources? Was it only Kafka since Netflix came up with recommended engines?
What's the difference between kafka and spark?
Real time is a task executed in a expected timeout, not low-latency
May I ask if it is a good idea to deploy Kafka on Kubernetes in production?
Nice video, thank you!
Excellent!