System design basics: What is asynchronous processing?

#asynchronousdataprocessing #differencebetweensyncandasync
#asyncprocessing #queueuses
#systemdesigntips #systemdesign #computerscience #learnsystemdesign #interviewpreperation #amazoninterview #googleinterview #uberinterview #micrsoftinterview
In this video, let's learn how to process data asynchronously.

[@m13m]

Great video Narendra :)
The common pattern for async programming:
1. Callbacks
2. Placeholder style (future, promise and deferred)
3. Queue
4. Signals

[@sandeepharidasula3191]

Nice explanation. Thank you so much.

[@dhanushkakumarage1889]

Good explanation.. thanks

[@RohanMaheshwari7]

Hey man, I have interviews coming up and these videos are incredibly helpful. Thanks a ton! Will keep a lookout for your content.

[@siddharthkumar7561]

Awesome video sir :) Thanks a lott

[@ratnakarjha7716]

Awesome Video of Async processing :)

[@Ayush-gp9tx]

Good one. The usage of real-life examples like the takeaway one was nice.

[@bowang1825]

this is one of your best videos.

[@rangeshprasanna]

Beautifully explained Naren!
Thanks a lot.

[@summitfxx]

Narendra! Great Content. Thanks

[@subinnair3835]

Great Explanation !!

[@321zipzapzoom]

Great content again..wish you a happy new year dear Naren

[@chrisy.703]

this is really good!

[@beinglogicalyadav9750]

Nice explanation.....keep it up bro

[@hnasr]

Thanks for getting a mic 🎙 audio is better

[@chaselong93]

Good content. Thanks, Narendra.
Here are some ideas for other viewers about handling failures. Say a worker reads a message from the queue. The worker starts processing the message, but then the worker crashes. The message is then lost, because it was removed from the queue. One solution is for the message queue to expect confirmation when a message is handled. If a worker takes a message, but doesn't tell the queue "the message is handled" within some time limit, then the message queue software puts the message back in the queue. In this case, it's important for the work to be idempotent or for workers to anticipate race conditions, since a worker might time out some task even if the worker does not crash. If a message is re-queued too many times, then the message is discarded or sent to a "poison queue". Other workers watch the poison queue and decide how to handle the failed tasks.

[@varunvats32]

Great content as always.

[@TechDummiesNarendraL]

Thanks Varun :)

[@Karonaturrr]

This is exactly what I needed, very good video :D

[@kowsikgelli7257]

Great video bro👍

[@asimabusallam3147]

thanks a lot

[@AbhishekSharma-si8ui]

AWESOME

[@narendrayadav71]

Better sound...(Y) Great Video..!!

[@arvindaaswani1303]

Very nice 👍

[@shivprakashy]

Nice work Narendra👌

[@pawandeepchor89]

I am fan :)

[@UntamedRogueMavrick]

Great Video Narendra!!! I got lots of help from the tutorial.

[@shermohammad7750]

nice comment

[@kchaitanya39]

Nice explaination sir

[@chandrashekhar9470]

What a detailed explanation.Could u please suggest how did you learnt all these? Please suggest some study materials.Thanks

[@sharukhrahman7925]

in scalable Point of View can i say this works like a pipeline manner??

[@shivanigoyal1677]

Can you please make a video on fb system design?

[@Gerald-iz7mv]

can you use kafka and rabbitmq as a message queue?

[@pallavisingh2912]

Thank You for the explanation. What happens when the messaging queue crashes?

[@20frieza]

Generally you would not have just one queue for this kind of stuff.. You will have multiple queues. However, coming back to your question, queues are inherently fault tolerant, meaning they log everything and if they fail they create the last state. So if you happened to send a message to queue, and it crashes after accepting the message, in that case, when it is comes back online, it will recreate its last state from the logs and pass the message to the threads. Hope this helps

[@pallavisingh2912]

@@20frieza Thank You..That was very well explained.. :)

[@30808005]

From where do you get the system designs?

[@hasanulislam3112]

Great! How would we handle the downtime of queue(RabbitMQ, Kafka etc)?

[@RandomShowerThoughts]

kafka is durable, we can configure rabbitmq to be the same. So whenever it's back up it'll republish the messages

[@anthonygood4598]

Great video but web app looked like more of parallel processing rather than asynchronous processing.

[@kalyanbabuakula2662]

we are not giving response to the client after video processing but immediately so that client is not waiting for app server

[@user-oy4kf5wr8l]

Jesus Christ... How many things do u know! Narendra :D Thank you

[@TechDummiesNarendraL]

Ha ha, I learn and present. I don't know all

[@user-oy4kf5wr8l]

@@TechDummiesNarendraL r u interested in doing some algorithm videos? (add more ads plz, that's the least we can do :))

[@manikchaudhari9507]

Tyala mahit

[@NikashKumar]

HI Naren,
I need a small help with the system design question i'm trying to solve. It would be helpful if we can have a char or if you share your email. Looking forward. Thank you

[@mdiyasinarafat3904]

Awesome, I have few question. Here (ruclips.net/video/BFcNDPt6SlE/видео.html) you told that we need to pass video reference not the video and send the video in queue is not good practice. Will you clear me how we could send the video reference in the queue? If we save the video another place that also need some time to store the video and how we could optimize that also?

[@bowang1825]

the client needs to upload the video to some data storage like S3

[@AbhishekSharma-si8ui]

AWESOME