Apache Kafka Crash Course | What is Kafka?
HTML-код
- Опубликовано: 3 июл 2024
- In this video, we delve into the fascinating world of Kafka, an open-source distributed event streaming platform. Join us as we explore the fundamental concepts and components of Kafka, including Kafka Topics, Message Partitions, and Consumer Groups.
Throughout the video, we will comprehensively understand Kafka's architecture and its significance in modern data-driven applications. Whether you're a beginner or already familiar with Kafka, there's something valuable for everyone in this discussion.
But that's not all! We believe in learning by doing, so we'll also walk you through a hands-on coding example using Node.js. By the end of this tutorial, you'll have a practical understanding of how to implement Kafka in your Node.js projects.
Quick Links
► Gist and Code: gist.github.com/piyushgarg-de...
► Docker Master Course: learn.piyushgarg.dev/learn/do...
Use Coupon "DOCKER" to get 25% OFF
Timestamps
00:00 Kafka Introduction
00:18 Problem Statement
13:15 How Kafka Solves the Problem
22:30 Architecture of Kafka
37:35 Consumer Groups in Kafka
44:42 Kafka with Node.js
Video Titles
► What is Kafka?
► Why do we need Kafka?
► Kafka Crash Course
► Mastering Kafka
► Kafka Nodejs Tutorial
Hashtags
#Kafka #RealTimeDataStreaming #nodejs #EventStreaming #DistributedSystems #BigData #DataStreaming #Nodejs #CodingTutorial #Developer #SoftwareEngineering #TechnologyExplained #DataProcessing #ScalableApplications #ConsumerGroups #MessagePartitions #DataDrivenApplications #OpenSource #Programming
Great Work. Keep it up.
Thanks.
Saptadeep.
Thank you so much, highly appreciated 😀🙌
brooo, this is crazy donation
Sir send me some money also
@@salman1098😂😂😂
Bhai mne do din se khana nhi khaya hai 200 rupye krdo
I have watched the full video from starting to end and enjoyed it. Its amazing to see how clearly you understand the concept and your command on node syntax 🎉
Omg! this is life saver. I am interning in Goldman Sachs from IIT Delhi and didn't have web dev background at all. So I had to quickly learn about Kafka. and this is the best thing one could get.
Bro.. this guy is crazyyyyyyyyy. This was way better than other code videos i watched
This is the best kafka course I have watched on youtube
The way you explained made me to learn this topic *Kafka* which I never heard before I scrolled this random video …. hats off to you for teaching like a friend....👏🙌👏
although I do not know node.js but the way you taught kafka its simply awesome.
Your visual way of teaching is too good, thanks mate
Great lecture….. in one hour you can easily visualise and learn all about kafka in and out. The best part of the video is when he is coding along with visualising what he is coding.
Thank you so much bro, you really don't know how much help you have made by explaining this concept so easily 🙏🙏
Kya video banaya hai Bhai Saab..Top notch..1 hour full utilised..
What a brilliant explanation! I wasn't familiar with Kafka before, and you explained it in layman's language superbly! Kudos to you. Keep creating videos like this!
Really, you literally took me into the world of kafka. Seriously your explanation is superb.
What a true sentence "Half knowledge is very dangerous". Good work buddy. Sweetly swallowing the bitter medicine.
Piyush, I am Usman from Pakistan and I really love your videos, The way to tell things from very basic and use drawings for visualizing things and clarity, it's literally just amazing and easy to follow. Thank you so much for such valuable content. Lots of love from Pakistan to you💖
Got this channel randomly, you’re a gem ❤
Best video on kafka ever. Loved your simple explanation and demo with visualiztion.
I tried many youtube courses for kafka but your way of explaning is so great.. please keep the good work..
You have explained it in very simpler way. Thanks to you man ☺
i so happy that i found your Channel , I was browsing through your channel and found you have created really good content on the things which are currently trending.Thank you ❤
Amazingly simplified explanation, superb!
The way of explaining was extremely good, idk why your Channel is so underrated 💥
I've watched the full video through to the finish and really enjoyed it. Your command of node syntax and your obvious comprehension of the subject are outstanding. 🎉
Great job piyush on explaining the details both visually and with the code approach 💯
While getting the hang of kafka as we go further i started to get the question of how kafka does the message transfer and when you talked about queue and sna architecture approach it clicked the brain. It's the similar how amazon SNS and SQS services works and from that point things got a lot for relatable.
I had a chance to work with pusher messaging service which had the similar pub/sub messaging architecture.
This kafka session turned out to be really amazing.
Looking forward for more of something like this in future.
It came randomly to my recommendation and I clicked on it…before I had only heard of Kafka but you explained it so well. I don’t know if I’ll be using this stuff anytime soon but sure as hell won’t forget how it works ❤
same
BEST EXPLAINATION. I'm so sad that I have discovered this channel soo late.
Great Work. You have provided the example which will be never forgotten.
One of the greatest videos I have ever watched!!!! Thanks Piyush bhai
this channel is a gold mine.
Thank you. You teach the Kafka concepts in a crystal clear way. Love from Bangladesh 🤍🇧🇩
Was waiting for "Why kafka has such a high throughput" answer.
Great explanation, thank you for the effort.
This is the first video I discovered in this channel.
Maja aa gaya bhai.
Thank You!
Thanks for the crash course, maybe this is my first course which I watched completely and understood completely.
Really awesome vedio , good understanding , Hindi m h toh attention span bhi acha rha ! Great job
This is one of the best tutorial on Kafka, Thank you :)
All my Kafka concepts are finally clear today!
Thank you for the crisp explanation!😊
Excellent delivery of the concept thanks man!
One of the great crash course video on Kafka. Great work Piyush 🏆
Mazza Agaya, Kaffi Samay Baad Itne Achi Technical Explanation Video Dekha. Yo have a teaching style similar to Brad Traverse.
Thanks for this content. For first time I attempted to listen to a texh content while I was busy with mundane work and got a wonderful idea and understanding of Kafka. Tomorrow morning I shall implement this and also read further on event driven architecture.🎉
Thanks again
Great work. Understood everybit. One of the best crash courses. Thanks
Genuinely one of the best crash course on youtube I have come across in a while
Thank you
Can you also have further video on such topics like data indexing and sharding
Great watch just before an interview!
Amazing crash course!! Loved it!!
crisp explanation. Great way describing each concept
Crystal Clear. Thank you so much.
Use this whole scenario with a database. Thanks in advance for this soundful knowledge....
Thanks for this amazing course ❤
Wonderful explanation.. Loved the way you explained it minutely..Thanks for the amazing video..!!
Great appreciated to you, You are the one of my favourite you tubers. Keeps continue this type of video regularly. Thanks you so much.
Just 7 min into your video and you are awesome already bro
amazing! best crash course video on kafka.
This is awesome explanation simple , clear and concise with humble tone.
Thank you soo much for such a great explanation, very crisp n clear it is. 🤝❤️
Bhai I rarely comment for RUclips video.. I am mechanical engineer by profession & recently got inspired to learn Data Engineering stack... And you made my day..what a great video to understand Kafka fundamentals... God bless you man with lots of happiness and success... You are great teacher.... Would love to see your crash course as first crash course for anything new learning i will be planning for in future....
one of the best you tube channel found on you tube. you are doing great work bro ❤❤
Thank you I am learning spring boot this is very helpful.
You are a gem Hats off to you mate
Random recommendation resulted into Kafka learning. Thank you❣
Thanks Piyush, really liked the video.
Thank you so much, very well explained.
Lemme try:
Kafka is a distributed message queue, generally used to decouple micro services where one api produces some data, and many others consumes it. Simple.
I don't know why he confused people with DB and Kafka. Kafka is really a queue, you only read data sequentially. Kafka CAN hold data for an infinite period if you want. But it's not made for 'querying' data, instead, it holds the data temporarily so that the producer api don't need to wait for the consumer api to 'read' this data, it can simply dump the data onto the queue and let consumer api read whenever it finds time for it.
If you're even a little confused between Kafka and a DB, this guy is to blame for that.
KafkaStreams and ksqldb, built on top of kafka. But yes you are right!
He is right, he is telling the working of kafka. It's seems that you only uses the technology not understand there working.
When he tried to give definition of throughput, I knew it's time to move to some other video. Bro just keep on repeating zomato uber example multiple times.
I assume you would have better videos on RUclips for explaining Kafka, if you are blaming him for confusing others.
If not, then appreciate his efforts for teaching for free,
@@BANANAS2011 Appreciate efforts who give will give you alcohol when thirsty? Why are you braindead?
Amazing explanation! Love it!
EXCELLANT CONTENT, THE BEST EXPLAINATION I HAVE SEEN ON KAFKA.
so basic explanation with basic examples which is really easy to understand
bhai boht acha explain karte ho aap. Ek baar me samajh aa jaata haii.
I always wanted to learn kafka ,
Thank you so much to putting out such great content.
You made me understand every topic where i was struggling
Much Thanks 🙏
bhai, kya explanation dete ho yaar, maza aagaya
Just Wow!!! Thank you so much.
Thank you so much .
Very easy explanation ... Good work
Appreciating your efforts
Excellent, mind blowing explanation THE BEST you can say
Thank you for the hard work. DB throughput is low because of ACID properties which is not possible in case of Bulk Insert that is without redo/undo so there is a huge risk of data loss but in the cases of Junk data ( Facebook, discord, etc) you accept the risk. In case of financial transactions you need to come up with a strategy where Kafka when full storage and failures in database stops producing until consumer errors are fixed to avoid data loss.
Perfect explanation. Also Liked the way of presentation starting with real life problem and ending with actual implementation of it.❤❤
I have no words this video is amazing please make whole series for kaflka please...........
HI Piyush,
This is indeed a crystal clear video about Apache Kafka. Thanks for sharing this wonderful knowledge for the IT developer fraternity. Thanks for this wonderful video and making the concept so clear.
Thank you very much for a great content and explanations on kafka, you made it very clear, and easy in understanding the topic.🙂❤✌
Please continue providing such valuable information ❤
Super interesting and one of the simplest and consumable explanation. 👏
Superb explanations Piyush. Thank you so much❤
What a great explanation! Hats off to you, sir. I'm wondering why you have only 11K subscribers. You deserve millions!
Not many people interested in Kafka know Hindi, and not many people who know Hindi wants to know Kafka.
he is already at 49k in 2months
@@DanielSmith-hd9iq 60k when i joined
68k when I joined .. nice explanation
@@sandeep_khangar72k when I joined
Thank you. Well explained. I really enjoyed watching it. Very Helpful.
WOW!!!!!!!!!!!!! Excellent , You deserve more than what i'm writing.....
Best one out there.Loved it.
This was great. Thanks for uploading
You explained it very easily Piyush, Keep pushing such content 👍
your way of delivery of knowledge so smooth ..keep making videos like this .
Thank you for this video and saving my life
Very Clear and Concise explanation! The way you dumb down complex topics for your audience is remarkable! Keep up the good work :)
Thank you soo much piyush bhaiya ❤
apka explaination acha tha bhaiya
video ka har ek part samajh aya
Thanks bro🎉 Outstanding explanation
Thanks for awsome content with great knowledge.❤
Thank you so much for the great explanation!
very well explained Piyush, really helpful, Thank You !
Very beautifully explained! Thank you sir for uploading these videos.
Bro very well explained thank you so much i don’t usually comment unless it is something extraordinary, keep up the good work cheers!
Excellent tutorial on Kafka. Great work 👍
You are a really good teacher. Hats off
bro, you are the only Indian RUclipsr explaining/teaching real world tech.