Why do we need Kafka?

Поделиться
HTML-код
  • Опубликовано: 2 фев 2025

Комментарии • 108

  • @vasutke1187
    @vasutke1187 Год назад +7

    Ji, Importance of Kafka is explained with high clarity.
    Similarly I considered your Video is highly important to learn Kafka.
    I feel Great efforts taken to bring this video is highly appreciated.
    Thanks & Regards

  • @vipulsharma9094
    @vipulsharma9094 Год назад +10

    Such an amazing video, I should really thank yt algorithm that I came across your channel. PS:Your Full Stack Twitter Clone course is really amazing.

  • @goodrat7
    @goodrat7 Год назад +3

    Your teaching skill is excellent. I have seen someone teaching and me absorbing so well after a long while. You are awesome brother

  • @ojasaklecha
    @ojasaklecha Год назад +17

    I have a very weird chronology to understand this. Jab hamare ghar ke kitchen me apan bartan dhote hai to unko directly unki jagah pe nahi rakhte hai na, use ek cage ya tub type me rakhte hai, taki vo sukh sake and then ham unhe poch ke unki jagah pe rakh sake. So, similarly, kafka or redis is like vo tab where you just throw or put the data, which is then processed and then stored in the DB.

    • @sanjeevkaushal5969
      @sanjeevkaushal5969 9 месяцев назад +3

      not weird, it is a perfect example in layman's term..

    • @sarwajeetbharti2856
      @sarwajeetbharti2856 8 месяцев назад

      Acha example h . Basically producers are producing in fast rate n consumer usse aaram se consume kar sakte h .. Retry ka facility bhi hain kafka mein for the consumers in case they were down for some reason.

    • @karanvatwani9077
      @karanvatwani9077 4 месяца назад

      @@sarwajeetbharti2856 but agr after several retries ke baad bi kafka band hai to consumer wait hi krta rhega consume krne ke liye then? producers kha messages produce krte rhege?

    • @SACHINKUMAR-px8kq
      @SACHINKUMAR-px8kq 4 месяца назад

      Amazing Example

    • @Hakimuddinsaifee-h3n
      @Hakimuddinsaifee-h3n 2 месяца назад

      but isse delay nahi hoga? like manlo mujhe same time data store and usi data ko get b karna hai toh us case me database me to data gaya nahi wo data to kafka me hai

  • @varunpandey5819
    @varunpandey5819 Год назад +4

    Sir your teaching skill is so good, thanks for providing such amazing skills 👍

  • @anandpawar3
    @anandpawar3 Год назад +1

    Awesome video and clearly stated the purpose of Kafka and databases …keep uploading more and more informative videos 🎉 thanks😊

  • @gopalsavaliya3205
    @gopalsavaliya3205 Год назад +38

    sir plz , make playlist on postgresql database

  • @manishthokale4446
    @manishthokale4446 Месяц назад +1

    Nice brother your teaching skill excellent

  • @ankit1153
    @ankit1153 Год назад +3

    Please continue your AWS 🙏😭 series it is really helpful.. please please i have watched AWS series video and i have learnt alot not just how to use but also about serverless, linux , ssh .. please continue it.

  • @mma-dost
    @mma-dost Год назад

    Thanks a lot bhaiya keep making these type of videos like about general software engineering scaling or anything about software development. Thanks a lot bhaiya.

  • @warisshaikh9474
    @warisshaikh9474 8 месяцев назад

    dher saara love from KHI, PK

  • @noumanmunir3166
    @noumanmunir3166 6 месяцев назад +3

    You said that while inserting data, db can overwhelm and go down,then the data will be lost,that's why we keep our data in Kafka(or to say the Piplines I think), But Kafka can loss the data as well if the server goes down...

  • @siddharthghai3438
    @siddharthghai3438 2 месяца назад +1

    very good explain

  • @susanoo9958
    @susanoo9958 Год назад

    First. Piyush sir,Big fan of your videos.Thankyou for the great work.

  • @SarwatIqbal-e5z
    @SarwatIqbal-e5z 3 месяца назад +1

    Excellent explanation

  • @mithunchandrasaha403
    @mithunchandrasaha403 5 месяцев назад

    Very Nice Explanation,Sir.Needs More Tutorial From You.

  • @deveshtembheker1315
    @deveshtembheker1315 9 дней назад

    Dhanyawaad Guru.....❤

  • @prashlovessamosa
    @prashlovessamosa Год назад +1

    Thanks for making this.

  • @saikatdas6126
    @saikatdas6126 9 месяцев назад +2

    @piyush I think there is some mistake in your statement. Kafka is not relying in memory storage. It stores the data in the disk. Kafka works faster mainly due to sequential read write and optimised disk reading capability.

    • @dead_holicx3127
      @dead_holicx3127 5 месяцев назад

      Ya even I was confused then I found this video ruclips.net/video/UNUz1-msbOM/видео.htmlsi=OQQTIrKNUpUpbsku which actually explains the reason why Kafka is faster. Looks like primary storage is disk not memory.

  • @ruchibhagwat1580
    @ruchibhagwat1580 5 месяцев назад

    Extremely well explained!

  • @SM-yx1vp
    @SM-yx1vp Месяц назад +1

    Good explanation but kafka does not store data in-memory, rather it uses disk to write data sequentially.

  • @AdityaGupta-im9lu
    @AdityaGupta-im9lu 7 месяцев назад

    dil jeet liya bro

  • @FirstnameLastname-cl4op
    @FirstnameLastname-cl4op Год назад +2

    Hi Piyush, I like the quality of your videos very much.
    Can you list all the technologies required to learn for a full-stack developer to land a remote job?

  • @unknown_manushya
    @unknown_manushya Год назад +2

    Basically a highly scalable buffer

  • @BSSAPP
    @BSSAPP Год назад

    We like your videos 👍 .... From Ludhiana

  • @SACHINKUMAR-px8kq
    @SACHINKUMAR-px8kq 4 месяца назад

    Thankyou so much for explaining this level

  • @sachinshahmca
    @sachinshahmca 3 месяца назад

    Awesome bhai .

  • @CoderBB
    @CoderBB Год назад +5

    Hey piyush, What if kafka server re-start? Then will the data persisted ? As you told that kafka gets High throughput because it uses primary memory for the operations. But if the system restarts then what happens to the unprocessed data which was stored in kafka before re-start ? Btw nice video 😊

    • @akash-kumar737
      @akash-kumar737 Год назад

      I think he is wrong when you say Kafka is fast because it uses RAM but according to ByteByteGo video. It is due to sequential I/O and zero copy technique.
      ruclips.net/video/UNUz1-msbOM/видео.htmlfeature=shared

    • @atharvdalal9493
      @atharvdalal9493 Месяц назад

      Kafka is not relying in memory storage Kafka Use Disk , Disk refers to storage hardware like HDDs (Hard Disk Drives) or SSDs (Solid State Drives) used to store data permanently.
      Even if the computer is turned off, data on the disk is retained.
      Examples: Your operating system, documents, apps, and large files like movies or databases are stored on the disk.

  • @zaid_khan1
    @zaid_khan1 Год назад +2

    Piyush bhai,
    Please, can you make a detailed video on Docker Deep Dive and Kubernetes?

  • @perrythepalteypus2185
    @perrythepalteypus2185 Год назад

    Excellent video 👏🏻👏🏻 please do same type of explanatory videos on prisma and docker 🚀🚀

  • @orbito_107
    @orbito_107 Год назад

    Recenty got recommend to your channel. And i want to suggest you should compile the videos in one shot as i assume you will get more views, i think you should try to re-upload node playlist to one video without deleting playlist.

  • @FUNNEDUCATION
    @FUNNEDUCATION Год назад

    It's an amazing video I enjoyed this video and the last video on Kafka. Please one crash course on RabbitMQ. Pls

  • @Digitalbyfaiyaz
    @Digitalbyfaiyaz Год назад

    Excellent explanation 😀

  • @dipikeshkumar1538
    @dipikeshkumar1538 Год назад

    Really great video❤️

  • @shrad6611
    @shrad6611 4 месяца назад

    Great Video

  • @adityak5193
    @adityak5193 Год назад

    Well addressed Piyush.☺

  • @FaizSultan430
    @FaizSultan430 Год назад +1

    Hy piyoush Hope u r doing well please make a crash course on prisma js

  • @asynchronous.1
    @asynchronous.1 Год назад +1

    Hii Piyush Bhaiya, you have said that you will prepare a playlist on aws lambda using serverless. So, please make a playlist in which you cover a project using express.js and mongoDB and its deployment on lambda and S3.
    Please bhaiya, make a playlist on serverless. It will be very beneficial.

    • @akash-kumar737
      @akash-kumar737 Год назад

      I think he is wrong when you say Kafka is fast because it uses RAM but according to ByteByteGo video. It is due to sequential I/O and zero copy technique.
      ruclips.net/video/UNUz1-msbOM/видео.htmlfeature=shared

  • @MuzamilQayyum-z2l
    @MuzamilQayyum-z2l 4 месяца назад

    Love you bro ❤

  • @dhirajkumarlll
    @dhirajkumarlll 5 месяцев назад

    Thank you 🙏

  • @jignalpatel2143
    @jignalpatel2143 8 месяцев назад

    Good explanation ❤

  • @shivamsingh7219
    @shivamsingh7219 Год назад

    It's like cache,ram and physical memory we are using all features by balancing cost and efficiency.

  • @ShivaniSinghYadav-sm3ee
    @ShivaniSinghYadav-sm3ee 11 месяцев назад

    Great explanation

  • @ashwin1998-w5i
    @ashwin1998-w5i 2 месяца назад +1

    2:39 that is DBMS

  • @theibad
    @theibad 8 месяцев назад +1

    Make video on Kafka vs Redis ,why we need them, Is Kafka alternative of redis?

  • @shivamdashore6864
    @shivamdashore6864 9 месяцев назад

    Hi Piyush! Such a great explaination can you please make a video on LLD Design Patterns

  • @sujan8353
    @sujan8353 Год назад

    Can u give a brief idea on notification service. How Kafka is useful here. With real time scenarios. Also if possible can create one demo service of notification. How will be the data flow.

  • @Proxy-oh3ic
    @Proxy-oh3ic 7 месяцев назад

    Great🎉😊

  • @tirthshah2832
    @tirthshah2832 6 месяцев назад

    really good example from real life

  • @naruto5437
    @naruto5437 Год назад

    excellent video

  • @rizwansworld
    @rizwansworld 9 месяцев назад

    Thanks man!

  • @Error-cf2mj
    @Error-cf2mj Год назад

    sir please aap ek MERN based project pe video laiye....it would be be really helpful...you explain even hard concepts very easily

  • @PramodSharma-dq3pi
    @PramodSharma-dq3pi 9 месяцев назад

    Please make a video/playlist on Flutter open source framework development.

  • @chandanmohapatra6782
    @chandanmohapatra6782 Год назад

    Bhaiya plz complete the AWS playlist ..we all are waiting bhaiya..

  • @_sanskriti903
    @_sanskriti903 6 месяцев назад

    It's like view concept used in database table

  • @shailendravishwakarma8367
    @shailendravishwakarma8367 Год назад

    Well explained

  • @raiyanshaikh4327
    @raiyanshaikh4327 Год назад

    Hello sir, can you please make a video on Apollo federation and subgraph ?

  • @animesh414
    @animesh414 7 месяцев назад

    are we you use database and Database management system interchangeably here.

  • @agcolony123
    @agcolony123 Год назад

    Hi Piyush , what happens for in memory databases??? Is Kafka valid for them

  • @ashraf7706
    @ashraf7706 Год назад

    please make a video for iron-session in next js authentication

  • @narayanmaity5881
    @narayanmaity5881 Год назад

    what is the diffference between kafka and redis? Do we have to use both to make a scalable application?

  • @Support-Phalestine
    @Support-Phalestine Год назад

    Bro plzz next video ma ya btay k aws skill builder website ma sa koi ek esa course btady Jo deployment k lia ho usma buhat sary course ha samagh ni a Raha kunsa kro

  • @DeepakSharma-st6dc
    @DeepakSharma-st6dc 6 месяцев назад

    noice!!

  • @pranavwani
    @pranavwani Год назад

    @piyushgargdev should we learn kafka?, as alternatives available (still it is good for large content and stability but just want to know your poin of views)

  • @shishiragrahari1855
    @shishiragrahari1855 Год назад

    Mann can you make tutorial on kafka connect, having a lot of doubts.

  • @satyanshsingh3041
    @satyanshsingh3041 Год назад

    create more clone courses like e commerce, music streaming or vedio streaming websites

  • @RohitSingh-se6ch
    @RohitSingh-se6ch 8 месяцев назад

    Can async await resolve this issue of throughput in node?

  • @sarvesh_k
    @sarvesh_k Год назад

    how you record your vedio, i am on mac

  • @shivankpal6449
    @shivankpal6449 8 месяцев назад

    please make a video on kubernetes

  • @dreamhunder341
    @dreamhunder341 Год назад

    Do i need to use kafka in every api request? Because my application has lots of users. Pls explain

  • @shubhamgupta-bl1tr
    @shubhamgupta-bl1tr Год назад

    Sir please come with node js project with Kafca and serverless aws

  • @SwarajSingh-xs6dy
    @SwarajSingh-xs6dy Год назад +1

    hey everyone, Kafka is good, but It is very expenses in production

  • @kunalr_ai
    @kunalr_ai Год назад

    3:16 computer science ki depth pata bhi to hona chahiye depth main jaane k liye

  • @Ommore5528
    @Ommore5528 3 месяца назад

    what is zookeeper

  • @AmitMishra-sl6cp
    @AmitMishra-sl6cp 4 месяца назад

    This video is public, so anyone could be watching, especially if it's your seniors or elders who might feel offended by derogatory terms like Tum, Tu, etc. Learn from Amitabh Bachchan or any other big influencer that they always address their audience as Aap. By the way, thanks for explaining the complex topics in an easy to understandable format..keep up the good work..!!!

  • @rishidubey8745
    @rishidubey8745 Год назад

    sir one appwrite crash course please

  • @Ani-w7z
    @Ani-w7z 3 месяца назад

    Why do we need Kafka?
    Cuz she mommy and great DOT DPS

  • @shaqeeb.shaikh2400
    @shaqeeb.shaikh2400 9 месяцев назад

    got subscriber

  • @kunalr_ai
    @kunalr_ai Год назад

    4:37 Ye sab to college main padhadte hai

  • @melophilegaming8156
    @melophilegaming8156 6 месяцев назад

    3:10

  • @dadanish2844
    @dadanish2844 7 месяцев назад +1

    Tum nahi Appppppppp

  • @adityakulshrestha7033
    @adityakulshrestha7033 Месяц назад +1

    bhai tu thoda sa pagal h jab us video m purani m sab discuss krr raha h toh nayi kyu bana raha h

    • @DhavalAhir10
      @DhavalAhir10 23 дня назад

      तुम्हे kya dikkat h bhai... Dekhna h to dekho varna mt dekho

  • @kautsaraqsa6912
    @kautsaraqsa6912 7 месяцев назад

    Why you make a video with english title but hindi explanation

  • @frazy_fact9473
    @frazy_fact9473 Месяц назад +1

    Thanks ❤