Why do we need Kafka?

In this video, we are going to discuss why we need Kafka and why Kafka has high throughput and what is the difference between Kafka and Databases.
Kafka Crash Course: • Apache Kafka Crash Cou...
Course Links
Full Stack Twitter Clone: learn.piyushga...
Docker Master Course: learn.piyushga...
Hashtags
#Kafka #RealTimeDataStreaming #nodejs #EventStreaming #DistributedSystems #BigData #DataStreaming #Nodejs #CodingTutorial #Developer #SoftwareEngineering #TechnologyExplained #DataProcessing #ScalableApplications #ConsumerGroups #MessagePartitions #DataDrivenApplications #OpenSource #Programming

[@gopalsavaliya3205]

sir plz , make playlist on postgresql database

[@sanketgawande3667]

+1

[@DevOps_Zone]

+1

[@pieceofcode_]

ruclips.net/p/PLuQ7pgFOWEA-6RmU3pgW-K6Yyu3ZlOXbC&si=pRy7iA_kMgsNwjuy

[@gaganyt7861]

+1

[@saksham_1612]

+1

[@CoderBB]

Hey piyush, What if kafka server re-start? Then will the data persisted ? As you told that kafka gets High throughput because it uses primary memory for the operations. But if the system restarts then what happens to the unprocessed data which was stored in kafka before re-start ? Btw nice video 😊

[@akash-kumar737]

I think he is wrong when you say Kafka is fast because it uses RAM but according to ByteByteGo video. It is due to sequential I/O and zero copy technique.
ruclips.net/video/UNUz1-msbOM/видео.htmlfeature=shared

[@vipulsharma9094]

Such an amazing video, I should really thank yt algorithm that I came across your channel. PS:Your Full Stack Twitter Clone course is really amazing.

[@ojasaklecha]

I have a very weird chronology to understand this. Jab hamare ghar ke kitchen me apan bartan dhote hai to unko directly unki jagah pe nahi rakhte hai na, use ek cage ya tub type me rakhte hai, taki vo sukh sake and then ham unhe poch ke unki jagah pe rakh sake. So, similarly, kafka or redis is like vo tab where you just throw or put the data, which is then processed and then stored in the DB.

[@sanjeevkaushal5969]

not weird, it is a perfect example in layman's term..

[@sarwajeetbharti2856]

Acha example h . Basically producers are producing in fast rate n consumer usse aaram se consume kar sakte h .. Retry ka facility bhi hain kafka mein for the consumers in case they were down for some reason.

[@karanvatwani9077]

@@sarwajeetbharti2856 but agr after several retries ke baad bi kafka band hai to consumer wait hi krta rhega consume krne ke liye then? producers kha messages produce krte rhege?

[@vasutke1187]

Ji, Importance of Kafka is explained with high clarity.
Similarly I considered your Video is highly important to learn Kafka.
I feel Great efforts taken to bring this video is highly appreciated.
Thanks & Regards

[@zaid_khan1]

Piyush bhai,
Please, can you make a detailed video on Docker Deep Dive and Kubernetes?

[@SwarajSingh-xs6dy]

hey everyone, Kafka is good, but It is very expenses in production

[@ankit1153]

Please continue your AWS 🙏😭 series it is really helpful.. please please i have watched AWS series video and i have learnt alot not just how to use but also about serverless, linux , ssh .. please continue it.

[@theibad]

Make video on Kafka vs Redis ,why we need them, Is Kafka alternative of redis?

[@AmitMishra-sl6cp]

This video is public, so anyone could be watching, especially if it's your seniors or elders who might feel offended by derogatory terms like Tum, Tu, etc. Learn from Amitabh Bachchan or any other big influencer that they always address their audience as Aap. By the way, thanks for explaining the complex topics in an easy to understandable format..keep up the good work..!!!

[@varunpandey5819]

Sir your teaching skill is so good, thanks for providing such amazing skills 👍

[@dadanish2844]

Tum nahi Appppppppp

[@noumanmunir3166]

You said that while inserting data, db can overwhelm and go down,then the data will be lost,that's why we keep our data in Kafka(or to say the Piplines I think), But Kafka can loss the data as well if the server goes down...

[@FirstnameLastname-cl4op]

Hi Piyush, I like the quality of your videos very much.
Can you list all the technologies required to learn for a full-stack developer to land a remote job?

[@goodrat7]

Your teaching skill is excellent. I have seen someone teaching and me absorbing so well after a long while. You are awesome brother

[@_sanskriti903]

It's like view concept used in database table

[@suyashpurwar631]

Basically a highly scalable buffer

[@anandpawar3]

Awesome video and clearly stated the purpose of Kafka and databases …keep uploading more and more informative videos 🎉 thanks😊

[@FaizSultan430]

Hy piyoush Hope u r doing well please make a crash course on prisma js

[@asynchronous.1]

Hii Piyush Bhaiya, you have said that you will prepare a playlist on aws lambda using serverless. So, please make a playlist in which you cover a project using express.js and mongoDB and its deployment on lambda and S3.
Please bhaiya, make a playlist on serverless. It will be very beneficial.

[@akash-kumar737]

I think he is wrong when you say Kafka is fast because it uses RAM but according to ByteByteGo video. It is due to sequential I/O and zero copy technique.
ruclips.net/video/UNUz1-msbOM/видео.htmlfeature=shared

[@tirthshah2832]

really good example from real life

[@melophilegaming8156]

3:10

[@mithunchandrasaha403]

Very Nice Explanation,Sir.Needs More Tutorial From You.

[@shaqeeb.shaikh2400]

got subscriber

[@dhirajkumarlll]

Thank you 🙏

[@MuzamilQayyum-z2l]

Love you bro ❤

[@DeepakSharma-st6dc]

noice!!

[@shivamdashore6864]

Hi Piyush! Such a great explaination can you please make a video on LLD Design Patterns

[@PramodSharma-dq3pi]

Please make a video/playlist on Flutter open source framework development.

[@agcolony123]

Hi Piyush , what happens for in memory databases??? Is Kafka valid for them

[@saikatdas6126]

@piyush I think there is some mistake in your statement. Kafka is not relying in memory storage. It stores the data in the disk. Kafka works faster mainly due to sequential read write and optimised disk reading capability.

[@dead_holicx3127]

Ya even I was confused then I found this video ruclips.net/video/UNUz1-msbOM/видео.htmlsi=OQQTIrKNUpUpbsku which actually explains the reason why Kafka is faster. Looks like primary storage is disk not memory.

[@prashlovessamosa]

Thanks for making this.

[@FUNNEDUCATION]

It's an amazing video I enjoyed this video and the last video on Kafka. Please one crash course on RabbitMQ. Pls

[@warisshaikh9474]

dher saara love from KHI, PK

[@Error-cf2mj]

sir please aap ek MERN based project pe video laiye....it would be be really helpful...you explain even hard concepts very easily

[@RohitSingh-se6ch]

Can async await resolve this issue of throughput in node?

[@sujan8353]

Can u give a brief idea on notification service. How Kafka is useful here. With real time scenarios. Also if possible can create one demo service of notification. How will be the data flow.

[@pranavwani]

@piyushgargdev should we learn kafka?, as alternatives available (still it is good for large content and stability but just want to know your poin of views)

[@aoopss]

We like your videos 👍 .... From Ludhiana

[@dreamhunder341]

Do i need to use kafka in every api request? Because my application has lots of users. Pls explain

[@chandanmohapatra6782]

Bhaiya plz complete the AWS playlist ..we all are waiting bhaiya..

[@ruchibhagwat1580]

Extremely well explained!

[@Support-Phalestine]

Bro plzz next video ma ya btay k aws skill builder website ma sa koi ek esa course btady Jo deployment k lia ho usma buhat sary course ha samagh ni a Raha kunsa kro

[@susanoo9958]

First. Piyush sir,Big fan of your videos.Thankyou for the great work.

[@shivamsingh7219]

It's like cache,ram and physical memory we are using all features by balancing cost and efficiency.

[@raiyanshaikh4327]

Hello sir, can you please make a video on Apollo federation and subgraph ?

[@animesh414]

are we you use database and Database management system interchangeably here.

[@propubggamer2222]

Recenty got recommend to your channel. And i want to suggest you should compile the videos in one shot as i assume you will get more views, i think you should try to re-upload node playlist to one video without deleting playlist.

[@shubhamgupta-bl1tr]

Sir please come with node js project with Kafca and serverless aws

[@narayanmaity5881]

what is the diffference between kafka and redis? Do we have to use both to make a scalable application?

[@kunalr_ai]

3:16 computer science ki depth pata bhi to hona chahiye depth main jaane k liye

[@shivankpal6449]

please make a video on kubernetes

[@satyanshsingh3041]

create more clone courses like e commerce, music streaming or vedio streaming websites

[@shishiragrahari1855]

Mann can you make tutorial on kafka connect, having a lot of doubts.

[@perrythepalteypus2185]

Excellent video 👏🏻👏🏻 please do same type of explanatory videos on prisma and docker 🚀🚀

[@kunalr_ai]

4:37 Ye sab to college main padhadte hai

[@ashraf7706]

please make a video for iron-session in next js authentication

[@rishidubey8745]

sir one appwrite crash course please

[@mma-dost]

Thanks a lot bhaiya keep making these type of videos like about general software engineering scaling or anything about software development. Thanks a lot bhaiya.

[@jignalpatel2143]

Good explanation ❤

[@sarvesh_k]

how you record your vedio, i am on mac

[@ShivaniSinghYadav-sm3ee]

Great explanation

[@naruto5437]

excellent video

[@Proxy-oh3ic]

Great🎉😊

[@rizwansworld]

Thanks man!

[@dipikeshkumar1538]

Really great video❤️

[@AdityaGupta-im9lu]

dil jeet liya bro

[@shailendravishwakarma8367]

Well explained

[@adityak5193]

Well addressed Piyush.☺

[@Digitalbyfaiyaz]

Excellent explanation 😀

[@kautsaraqsa6912]

Why you make a video with english title but hindi explanation

[@akhilsharma392]

its his choice