this seems like a video on "how Netflix works now", instead of designing a Netflix by yourself. will be more fun if you can start with something simple and then try to scale.
That's what the title says :) There could be another video that can come up with the basic design and build upon it. The intent of the video itself is to showcase Netflix design. I myself want to know how Netflix works.
@@BikasKatwalK Hello if you are interested in getting a quality cartoon logo | gaming logo | cartoon photo | illustrations logo | text logo | business logo, ECT. you can contact me at this gmail address lucysmith3916@gmail.com on Discord @ PaytonArt#7215 Or Text 📲 +1(508)535-5879
Extensive research performed for this presentation. Pros & Cons, IFs and BUTs of most of the component of Sys Diag explained. He gives different options before selecting a solution. One needs to connect the dot and understand the bigger picture of how it's scaled. Thank you.
You have done fabulous job of describing the components of Netflix. It's comprehensive and your efforts are very visible, thank you so much for going the extra mile for others. I hope life rewards you for this!
Your depth in videos and breadth of content is absolutely amazing. Thanks! I really appreciate how clearly you explain things and make complicated systems look quite simple and logical. Please continue with this "starting from basics" approach, it's honestly one of the best on YT. Also, do you have any good book recommendations for ramping up on system design? Like some book that points out a problem and gives a system design pattern to solve it? If there was like a "Elements of System Design" or something that'd be great.
I went through only little part of netflix architecture through their engineering blog before. But thanks to you, now I have full overview of their systems. Also, please make video on Food Delivery app.
00:00 Netflix's system design involves Open Connect and AWS cloud with three main components. 07:15 Netflix uses transcoding to optimize video for different devices and network speeds. 14:10 Advantages of using a gateway service and Hystrix for microservices 20:19 Netflix uses micro service architecture to power its API needs 26:09 Netflix uses caching layer and two types of databases for high throughput and low latency. 32:12 Netflix uses various technologies for data processing and analysis 38:29 Netflix uses personalization and recommendation algorithms to retain users. 44:46 Netflix's Open Connect server is designed for high availability and saves bandwidth. Crafted by Merlin AI.
Very good explanation of each component. Thanks a lot. However, I would highly recommend after all the individual components explanation the end-to-end flow in the architecture diagram on the home page request of what happens and click on the movie to watch how the request flows what components are involved. It's like a summary of the total design in 1 or 2 minutes. Keep up the good work.
Simple and detailed explanation :) I took multiple breaks in between the video to re-evaluate my understanding but your knowledge is really appreciable :)
Nice video. But i would have expected a simple and scalable custom design, that can help us understand how we can tackle/handle this thing on our own instead of knowing how they actually do it.Please do one video on designing netflix basic design from scratch. Thank you.
This is amazing! I didn't like certain parts but overall this is a fantastic video. Clearly shows how much effort in research, articulation, rehearsala, etc. must have gone in preparing this video.
I have a question : 1. What is the flow to capture "last timestamp of content viewed" ? What could be the service level API calls and DB backing this feature.
Very important to learn how to think through while building such systems..... that's where we pass on the actual knowledge so that ppl can learn the thought process rather than memorizing their implementation. Please focus on such a style of presenting these systems.
Thx for sharing and in-depth analysis. One criticism though, I think at 10.51 it went little side ways. You talked about splitting the video to parallel process the upload but subsequent seconds it went straight to transcoded format. I do think 1. Split the video for concurrent upload & merge 2. S3 triggers transcoding
Nice one in the era of 'system design interview preparation' videos, where, they explain cache is to save a DB call and cache can save DB call and further explain that you can save a DB call by reading from Cache and go really deep, cache can save time by providing response quicker 🤪
Excellent way of explanation into step by step instead of showing all at a moment. Really useful to gain more knowledge base. Keep it up. Go ahead....!!
I think this is great. Loved it in the way you have componentized the entire architecture. Really helped me a lot to understand it. Also useful would be to focus a bit more on the different data models in the database. For example just on a high level how data is stored. I would not expect an in depth schema but something on the high level. Also useful would be to include the approximate bandwidth required for such a system. But in all this is great and I really liked it
In addition to that Netflix uses HLS which is a technique of adaptive streaming a m3u8 file decides which chunk to send next according to bandwidth of internet the video you watch is not a mp4 its actually a .ts chunk which the player display you hence its a technique to secure the video too
Hi Narendra, I was asked in a facebook interview about how netflix playback works. Say for example, I pause/close a video while watching a movie and if I open it in a new device say Ipad, It starts playing from where I left off. How do we store that kind of information and for that particular user.
The player might be periodically sending the position of the video you are watching. And the videos are always sent in chunks of data or range of bytes, so they can save the last byte you watched in the database/ cache (per user) when you stopped streaming. Once that is saved, your player (from any device) will do partial get and your video plays from where you left off. I would assume thats how it should work :)
Great Content. Thanks a Million!. Please don't get me wrong. I think the accent is getting in your way when are explaining. not sure if it can done without. Indian accent is the best. LOL. Again Thanks a Lotttttt! for all your efforts and content.
Isn't Open Connect a kind of box that is given to ISP's to make streaming efficient? I mean, I was under an impression that if I am Airtel User, I would be streaming a Netflix video from the box Open Connect box of Airtel and there wouldn't be any switching that will be happening to an other box. I could be totally wrong here or may have misunderstood what I read. :)
Nice video.. One thing I am still confused. If a new video is uploaded to Netflix , then it would chunk and process it to save it in almost 1200 files. Now , where are these files stored ? In Cassandra ? Also, do these files existing in EV Cache ( LRU eviction policy ) ? Can we put these files in CDN as well for quicker access ?
Master-Master wouldn't work. Why? Due to the CAP theorem, you choose either availability or consistency, which means you are out of sync or your system is unavailable if you choose consistency.
this is very good system design topic and i have one simple question, why are we saving the data on Amazon S3 and then transferred to Open Connect servers ? i mean after conversion of the content can we directly store on the OC ?
Im Really very confused. When you defined open connect . I was honestly expecting you to use the AWS managed CDN network CloudFront. As they both use edge locations and Which has streaming possibility, if you use Elastic Transcoder to turn high quality Videos to HLS (HTTP Live Streaming) format and a CloudFront Distribution with a download option to Stream it from S3 its a better option. Or so I thought? I have an interview at amazon coming soon if you could answer this I would really appreciate it!
great video. I have one question. does AWS have global load balancer? if not, can you tell us what kind of load balancer they have created .. do they create one in every region? Also, from mysql database point of view and EC2 clusters, how do they handle global replication of data?
Hey bro how youtube uploads work if the video is large like 500mb or 1gb. Is the upload happens directly on frontend on s3 then link is given to backend or http call is made to backend and wait for its upload
Great video but this is the description of Netflix architecture ie., how exactly they have implemented the system, rather than how to approach this as a problem. I am pretty sure if we give this answer in the interview, the interviewer will definitely be concerned about how the intuition and approachability of the problem is.
Hi! I don't understand if hystrix is a server which proxies the requests or is a wrapper that you use in the endpoint, or is both? Can you clarify how it works ? Thanks!
Great video!!!..Good insights of the architecture. However this explains the actual architecture built by NETFLIX. A step by step approach of how the complex requirements are broken down to designing application by, may be selecting a suitable technology stack or algorithm that can be used is what actually expected in system design interview. That would help people for gaining insights in designing similar applications.
this seems like a video on "how Netflix works now", instead of designing a Netflix by yourself. will be more fun if you can start with something simple and then try to scale.
Agreed, it's better to underrated thought process behind each decision. Anyway, as always, amazing video.
appreciate the content, but imp part of system design is why you have to do it the way you did it and why something else wouldn't work.
That's what the title says :) There could be another video that can come up with the basic design and build upon it. The intent of the video itself is to showcase Netflix design. I myself want to know how Netflix works.
If you really wanted to understand micro details. please refer ruclips.net/channel/UC9vLsnF6QPYuH51njmIooCQ
@@BikasKatwalK Hello if you are interested in getting a quality cartoon logo | gaming logo | cartoon photo | illustrations logo | text logo | business logo, ECT. you can contact me at this gmail address lucysmith3916@gmail.com
on Discord @ PaytonArt#7215
Or Text 📲 +1(508)535-5879
Extensive research performed for this presentation. Pros & Cons, IFs and BUTs of most of the component of Sys Diag explained. He gives different options before selecting a solution. One needs to connect the dot and understand the bigger picture of how it's scaled. Thank you.
Hey, just wanted to say thank you so much for this! I studied your video 2 years ago and got approved at Amazon. All the best!
Thank you for this wonderful video. I work for an SVOD company and found this very informative and it even helped me understand our own system better!
You have done fabulous job of describing the components of Netflix. It's comprehensive and your efforts are very visible, thank you so much for going the extra mile for others. I hope life rewards you for this!
He is Good😊
Your depth in videos and breadth of content is absolutely amazing. Thanks! I really appreciate how clearly you explain things and make complicated systems look quite simple and logical. Please continue with this "starting from basics" approach, it's honestly one of the best on YT.
Also, do you have any good book recommendations for ramping up on system design? Like some book that points out a problem and gives a system design pattern to solve it? If there was like a "Elements of System Design" or something that'd be great.
This is at Business Analyst and Architect level. Wow dude you absolutely nailed this.
This is a SysD primer disguised as Netflix use case. You can really fit these pieces anywhere.
Thanks for your effort!
6:38 . Since Tier 1 load balancing is on the basis of zone, can we really call it Round Robin?
I went through only little part of netflix architecture through their engineering blog before. But thanks to you, now I have full overview of their systems. Also, please make video on Food Delivery app.
00:00 Netflix's system design involves Open Connect and AWS cloud with three main components.
07:15 Netflix uses transcoding to optimize video for different devices and network speeds.
14:10 Advantages of using a gateway service and Hystrix for microservices
20:19 Netflix uses micro service architecture to power its API needs
26:09 Netflix uses caching layer and two types of databases for high throughput and low latency.
32:12 Netflix uses various technologies for data processing and analysis
38:29 Netflix uses personalization and recommendation algorithms to retain users.
44:46 Netflix's Open Connect server is designed for high availability and saves bandwidth.
Crafted by Merlin AI.
Narendra, very thorough and great attention to detail in every aspect of design you explained. Kudos, great work!!
Thank you once again for putting information from several different sources into one place.
Gratitude my brother! I'm so glad for your inspiration to teach me and others!
Very good explanation of each component. Thanks a lot. However, I would highly recommend after all the individual components explanation the end-to-end flow in the architecture diagram on the home page request of what happens and click on the movie to watch how the request flows what components are involved.
It's like a summary of the total design in 1 or 2 minutes. Keep up the good work.
Feel free to go and have it done. And don't forget to shoot video afterwards.
Thanks for this great video! very deep into certain topics... very different. than other design videos on youtube
Thanks for sharing this video. These video might touch many of the lives to get into there dream jobs
Thanks baby. I have been looking for system design interview questions. You made it simple.
baby :D ...
@@raviprakashagrawal9478 host -> #floored :D
lmao.
Narendra sir #sakhti pighalna nahi hai
Simple and detailed explanation :) I took multiple breaks in between the video to re-evaluate my understanding but your knowledge is really appreciable :)
I think most of the guys take multiple break. Even i took many.
you did very hard work, man. Thanks a lot.
Nice video. But i would have expected a simple and scalable custom design, that can help us understand how we can tackle/handle this thing on our own instead of knowing how they actually do it.Please do one video on designing netflix basic design from scratch. Thank you.
Great work @Naren, Keep inspiring many more through these kind of real world theories !!
Wish you all the very best !!
This is amazing! I didn't like certain parts but overall this is a fantastic video. Clearly shows how much effort in research, articulation, rehearsala, etc. must have gone in preparing this video.
He Is A Genius
I have a question :
1. What is the flow to capture "last timestamp of content viewed" ? What could be the service level API calls and DB backing this feature.
24:05 i paused the video to see if dogs are barking in mt street !
8:50 also
Quite enlightening with a lot of minute details for most of the components that fall under Netflix System, thanks a lot Narendra
Very important to learn how to think through while building such systems..... that's where we pass on the actual knowledge so that ppl can learn the thought process rather than memorizing their implementation. Please focus on such a style of presenting these systems.
Thx for sharing and in-depth analysis. One criticism though, I think at 10.51 it went little side ways. You talked about splitting the video to parallel process the upload but subsequent seconds it went straight to transcoded format. I do think 1. Split the video for concurrent upload & merge 2. S3 triggers transcoding
A great explanation for such a complicated system
How can the 2 screens or 4 screens strategy of netflix be implemented?
Good question..
One of the best explanations I would say.
Another great session! Study vidoes like this and then practice at Meetapro with mock interviews will help you land multiple offers.
Nice one in the era of 'system design interview preparation' videos, where, they explain cache is to save a DB call and cache can save DB call and further explain that you can save a DB call by reading from Cache and go really deep, cache can save time by providing response quicker 🤪
Excellent way of explanation into step by step instead of showing all at a moment. Really useful to gain more knowledge base. Keep it up. Go ahead....!!
Really appreciate the video. Nicely explained.
I think this is great. Loved it in the way you have componentized the entire architecture. Really helped me a lot to understand it. Also useful would be to focus a bit more on the different data models in the database. For example just on a high level how data is stored. I would not expect an in depth schema but something on the high level. Also useful would be to include the approximate bandwidth required for such a system. But in all this is great and I really liked it
He Is Great I love the way he address
Great work. Thank you, please, continue with it.
Nice video with almost all details. Great work!
unbelievably detailed. thank you
best netflix architecture video ever. Great job Narendra!
ENJOYED it ,Well done
this is freaking awesome thanks for vid man!
Fantastic video explaining a streaming system design. Well done!
Very nice. Thanks for explaining module wise. This brings clarity.
Thank you Naren! Great explanations!
It would be nice to refresh this video in 2020. Thanks for great work!
what about the transcoding architecture and video chunking ?
In addition to that Netflix uses HLS which is a technique of adaptive streaming a m3u8 file decides which chunk to send next according to bandwidth of internet the video you watch is not a mp4 its actually a .ts chunk which the player display you hence its a technique to secure the video too
Thank you so much for your work, amazing job 🙏💪😌
Very thorough and insightful. Thank you for making this.
Which profile get when after doing study of this, and which course I have to do for this
Hi Narendra, I was asked in a facebook interview about how netflix playback works. Say for example, I pause/close a video while watching a movie and if I open it in a new device say Ipad, It starts playing from where I left off. How do we store that kind of information and for that particular user.
The player might be periodically sending the position of the video you are watching. And the videos are always sent in chunks of data or range of bytes, so they can save the last byte you watched in the database/ cache (per user) when you stopped streaming. Once that is saved, your player (from any device) will do partial get and your video plays from where you left off. I would assume thats how it should work :)
It would be really helpful if you could mention why Netflix is not using CloudFront AWS service? Since Netflix uses most of AWS,.
Great video man! by far one of the most thorough vid on system design! Really appreciate your effort on this
Great explanation. learned a lot. 👏👏
Thank you for your tremendous effort. Detailed and well explained...
Really detailed video for each component. Keep up the good work.
you are unmatchable !!
Great Content. Thanks a Million!. Please don't get me wrong. I think the accent is getting in your way when are explaining. not sure if it can done without. Indian accent is the best. LOL. Again Thanks a Lotttttt! for all your efforts and content.
Wow this is an amazing comprehensive overview! Thanks for your effort
Dude you are a legend...
Thanks for the epic videos!
Thank you for ur great work! We thank you a lot!
Thanks for kind words!! :)
@@TechDummiesNarendraL of course we should thank you, we didn't pay anything and we learn a lot from you. There has no reason to complain 😊
How about security? How does Netflix makes sure only authorized users can view the content?
Great video! Nicely explained
This is a great video. Thank you!
Yeah seriously, the best explanation!.
What is ec2 workers? Did we mk that up
Thanks , highly effective space for learning System design
Isn't Open Connect a kind of box that is given to ISP's to make streaming efficient? I mean, I was under an impression that if I am Airtel User, I would be streaming a Netflix video from the box Open Connect box of Airtel and there wouldn't be any switching that will be happening to an other box. I could be totally wrong here or may have misunderstood what I read. :)
Where'd you get that T shirt? Its dope!
Nice video.. One thing I am still confused. If a new video is uploaded to Netflix , then it would chunk and process it to save it in almost 1200 files. Now , where are these files stored ? In Cassandra ? Also, do these files existing in EV Cache ( LRU eviction policy ) ?
Can we put these files in CDN as well for quicker access ?
So how to exactly design a system which can support users uploading videos and watching videos?
Very good explanation, thank you sir.
Just another kudos for interesting video. What do you thinks about their use of Cassandra? Why it but not just another instance of ElasticSearch?
Excellent.I really appreciate such a great work.It helped me a lot to understand how the system works. Expecting more videos.
very well structured video. very informative. thanks :)
Master-Master wouldn't work. Why? Due to the CAP theorem, you choose either availability or consistency, which means you are out of sync or your system is unavailable if you choose consistency.
this is very good system design topic and i have one simple question, why are we saving the data on Amazon S3 and then transferred to Open Connect servers ? i mean after conversion of the content can we directly store on the OC ?
Im Really very confused. When you defined open connect . I was honestly expecting you to use the AWS managed CDN network CloudFront. As they both use edge locations and Which has streaming possibility, if you use Elastic Transcoder to turn high quality Videos to HLS (HTTP Live Streaming) format and a CloudFront Distribution with a download option to Stream it from S3 its a better option. Or so I thought? I have an interview at amazon coming soon if you could answer this I would really appreciate it!
Yes that would be an acceptable way to transcode and stream content. However he is defining how Netflix does it which is using their own CDN system.
I think probably already invested into open connect, so after moving to AWS didn't want just to throw them to trash but reuse it.
Amazon Prime uses CloudFront, NetFlix use a propriertory CDN
great video. I have one question. does AWS have global load balancer? if not, can you tell us what kind of load balancer they have created .. do they create one in every region? Also, from mysql database point of view and EC2 clusters, how do they handle global replication of data?
Thanks , this was really helpful
28:10 You said SSD is little higher than the time taken to read data on RAM. But I think RAM is way more faster than SSD
I think you are right.
Also ram storage type is SSD.
What job roles would I need to search for if I needed someone with this level of knowledge for a somewhat similar database?
great work! excellent collection of videos. extremely informative
the stateless explanation around 25:00 is kind of lacking.
can you make a system design in a system using Microsoft products? if you have one already please recommend.
Hey bro how youtube uploads work if the video is large like 500mb or 1gb. Is the upload happens directly on frontend on s3 then link is given to backend or http call is made to backend and wait for its upload
Really appereciable.You are doing good for people.Thanks a lot for your efforts.
Great video but this is the description of Netflix architecture ie., how exactly they have implemented the system, rather than how to approach this as a problem. I am pretty sure if we give this answer in the interview, the interviewer will definitely be concerned about how the intuition and approachability of the problem is.
This was awesome! Learned a lot
It's really detailed video with very nice explanations. Thank you.
That was very interesting, excellent work. Thank you!
Thank you so much for sharing your knowledge.
yella videosallu beedi nayee boglodu khandita :) Great videos though :)
Thanks for sharing the video. It was very helpful.
Your content is really amazing. Keep it up! Maybe make a video on designing instagram next :)
@Ryan Bridges Thanks and sure
I appreciate your research. Keep it up
Thank you, this helped me alot
Hi! I don't understand if hystrix is a server which proxies the requests or is a wrapper that you use in the endpoint, or is both? Can you clarify how it works ? Thanks!
Agreed and even I'm expecting a more valid and potential reason to use hystrix. @Tech Dummies - Narendra L, please shower your thoughts
Great video!!!..Good insights of the architecture. However this explains the actual architecture built by NETFLIX. A step by step approach of how the complex requirements are broken down to designing application by, may be selecting a suitable technology stack or algorithm that can be used is what actually expected in system design interview. That would help people for gaining insights in designing similar applications.
yes, but that would stretch the video by hours. may be I will plan to do smaller videos on different components. Thanks