System Design Interview: Design Amazon Prime Video
HTML-код
- Опубликовано: 17 июн 2024
- Want to learn how to answer system design interview questions and land the job? Make sure you're interview-ready with Exponent's system design interview prep course. Start free. bit.ly/3uZ2jfu
Abhishek Kumar (Engineering Manager, Flipkart) designs a system for a video streaming service like Amazon Prime Video. He talks about load balancing and delivering reliable user experiences.
Chapters -
00:00 - Introduction
00:47 - Question
01:12 - Requirements
06:16 - Design
21:34 - Follow-up questions
23:32 - Interview Analysis
24:04 - Tips
Watch more videos here:
- Amazon SWE answers system design interview question: • Amazon System Design I...
- Google SWE answers algorithms interview question: • Google Software Engine...
- Google TPM answers Tiktok system design interview question: • System Design Mock Int...
- Microsoft SWE answers algorithms interview question: • Microsoft Software Eng...
👉 Subscribe to our channel: bit.ly/exponentyt
🕊️ Follow us on Twitter: bit.ly/exptweet
💙 Like us on Facebook for special discounts: bit.ly/exponentfb
📷 Check us out on Instagram: bit.ly/exponentig
📹 Watch us on TikTok: bit.ly/exponenttikttok
ABOUT US:
Did you enjoy this interview question and answer? Want to land your dream career? Exponent is an online community, course, and coaching platform to help you ace your upcoming interview. Exponent has helped people land their dream careers at companies like Google, Microsoft, Amazon, and high-growth startups. Exponent is currently licensed by Stanford, Yale, UW, and others.
Our courses include interview lessons, questions, and complete answers with video walkthroughs. Access hours of real interview videos, where we analyze what went right or wrong, and our 1000+ community of expert coaches and industry professionals, to help you get your dream job and more!
#softwareengineer #softwareengineering #tech #software #entrepreneurship #product #softwaredeveloper #systemdesign #systemdesigninterview
Want to learn how to answer system design interview questions and land the job? Make sure you're interview-ready with Exponent's system design interview prep course. Start free. bit.ly/3uZ2jfu
This is a good vidoe. Great work Abhishe and thank you. Here is my 2 cents as an enthusiastic techie.
1. An autoscaling group needs to be tied to the target group in which the ec2 instances (or compute instances depending on the cloud provider) are present.
2. The client should break the file into chunks and send across each chuck to the backend video service.
3. each chuck should be sent to the aws transcoder service and you should receive back 3 chunks from the service for the tablet , mobile and PC.
4. Once this is done each chunk can be stored in a separate s3 subfolder under a folder with the movie name. (s3 has prefixes and delimiters which are like a folder structure.) The corresponding meta data table where a movie is a List should have information relating to all the chunks of a movie and the type of chunk ie mobile, movie or tablet.
There also needs to be error checking of each chunk by the service and a retry mechanism with a certain number of retires in case a chunk does not get uploaded properly.
5. The search service should basically have a trie internally that gives hints when a movie is typed in the search bar.
6. The s3 bucket needs to tied to cloudfront distributions at several locations which will cache the video. I don't think there is an explicit need to setup several s3 buckets in several regions.
One can just enable the cross region replication feature in s3 directly.
Regards
Mukund Sridhar
(Architect)
Wow mukundsridhar4250! Thanks for taking the time to share your knowledge! Appreciate it 🙏
The best video on your channel that I have watched so far. Abishek crushed it. Great end tips. Great drawing. I really liked drawing out each endpoint as a service, and how he scaled up after doing the base case.
Abhishek explanation was too good. Really appreciate this video. Hope we get more such videos. For sure I am saving and sharing this video.
This is one of the very crisp system design mock interview I came across with. Abhishek, You are really flluent in what ever you are saying. I liked the way you had connected everything, therefore, grasping the interviewer's attention. I really learnt a lot from you. The way you communicate, organize thoughts and orchestrate everything in a platter is really outstanding. Once again thanks a lot Abhishek and team Exponent for this video. It is by far the best System Design Interview I came across till now.
Hey Avinash, we really appreciate the kind words. Glad you found our video useful!
They way Abhishek articulated, drew and explained is amazing, i was hooked for the entire video and learnt a ton.
Hoping for more such mock interviews.
Thanks Exponent and Abhishek
Glad you liked it! More system design videos on the way.
I don't think that Abhi gave enough reasoning for why uploads should be fast. In the case of RUclips I would agree that uploads should be fast, videos are shorter, you have many smaller creators/uploaders, and viewers are more likely to want to see videos quickly after they are uploaded as RUclips videos are more likely to have time relevance. For Prime video it's almost entirely movies and tv shows which are long form content, with fewer uploads from larger creators (studios), meaning that the workflow for uploading a video is a more formal and involved process (ie copyright checks) that would happen days before the content is watchable. Ultimately it doesn't change the design that much, the processing queue is already async, nor do I think that this is a huge error on Abhi's part.
Thank you, this is a helpful suggestion. I still think the faster downloads part is key, but yes, it'd have been fun to talk about the additional content validation and preprocessing part.
Thank you so much Abhishek, clear and crisp explanation of System Design
Great clarity of thought right through the video! Really loved the way Abhishek approached it.
Great video! Wish we had enough time for API design and Schema Design, but really great explanation
I didn't know interviews can go this perfect as well. Abhishek should make some videos on how he approaches any system design interview problems.
Love this, thanks !!
Thanks Abhishek! This is really helpful!
Well done system design. I think there is a lot to learn from this one over the Netflix system design video from this channel. A lot of the concepts would apply.
Amazing video! Thanks to both interviewer and interviewee!
Glad you enjoyed it!
Amazing explanation Abhishek🤩
Quite nicely done!
For interviewee, API design and Database design, estimation. For interviewer, could have more depth questions, that's what I met in my pass interviews.
Great video, thank you so much !
Really good and easy to follow
Thanks Abhishek
Awesome Video!
I do have one question, so in object store are we storing the video as a whole? or we are storing the chunks with certain lengths i.e 5 or 10 min lengths of clip?
Really good one!
Who's this guy, that was so good. Abishek nail It
It would be great to have a capacity estimation of the storage and its implementaton.
He mentioned that the customer would upload the video. I dont think any customer uploads video to Amazon Prime. Maybe he prepared RUclips and used it here. :) He clearly mentioned "RUclips videos" in the next statement. He simply blurts out without even understanding the subject. He is just throwing words without any context. He mentioned the CAP theorem which is not required there. No doubt Kevin's face is so surprising.
@jasper5016 think of content creators as directors, producers or production house uploading the video themselves. Or Amazon people uploading them instead of the stakeholders
Yeah. I noticed the same )) It's not about Prime
i suppose one thing to handle a popular release is we can bring it onto the platform a few days ahead cache it and make it public on the release time 🤔
I was thinking the same. Good call!
dont fall for this mock interview. most of the system design interviews does not happen like this, it will be constant interference from the interviewer, he will not be just sitting like a doll and listening to you. no system design interview ever happens like this in real life unless you are giving interview in faang
That's why they mentioned 'mock'.
Do you mean the interference is good or bad. In my opinion, the interference is okay until is goes with mutual respect. I have noticed cases, where interviewer misbehave, makes fun of the candidate.
Usually interviewers have a direction they want to go in, and no interference means he's ok with you saying anything and isn't trying to test your abilities
I didn’t think Amazon prime video had an upload feature, am I missing something? Great examples and tips at the end to do one requirement at a time, thanks!
Well, someone does upload the content right? The number of content creators are not as many as ones available on youtube.
Most probably videos on Amazon prime go through a vetting process, however there's surely an additional interface for selected people to be able to upload the content.
I agree! I think he actually misunderstood the requirements a little. While uploading *is* an important part of amazon prime video, it's not a user-facing feature. The interviewee seems to assume that "creators" are uploading to the platform. I suspect no one outside amazon uploads videos directly into amazon prime.
Amazon likely has TWO upload interfaces, not one. An external upload interface, where license content holders and amazon-subcontractors can pass raw high resolution content over to amazon, and an internal interface that processes that raw video for encoding and to add metadata (what actors are on the screen at what time, imdb info, closed captioning, etc). Only the internal interface would distribute videos to the amazon prime video servers after passing some kind of review.
The interviewee's focus on availability vs consistency seems like a misstep if you expect that Amazon is the only consumer of the video publishing process. He seems to think that Amazon Prime works more like RUclips. And who knows, maybe he's right! But I think he should have asked further about the design parameters instead of assuming he knew them just because he was familiar with the product. At least then we would know better what he was designing!!
@@assumptionsoup totally agrees with you. I took many systems design interviews and this is big RED Flag for the interview.
@@abhishek0647 true, although i think it might have been good to elaborate on that a little more, given that it's probably a very different process from how youtube/instagram/tiktok handles uploads. anyways, thanks for doing the video and responding!
@@shivers222 agreed. I'll try to record it sometime later on. It'd be a good topic to dive deeper into
he is very good
Thanks for the video, curious to know what tool are you using for documenting and drawing.
Hey Yogesh! The whiteboard being used here is an online whiteboard called “excalidraw”. They have a free and paid version so do check them out if you are interested!
I'd hire this guy
I agree with availability vs consistency, but I'm pretty sure "end users" don't upload videos on amazon, unless you count internal customers. I know the CTO of a video streaming service and we've talked about this, and they receive these super large files from studios, then do their own manipulation and encoding and upload to storage themselves.
He just copy pasted the design of youtube.
So this is kind of generic video servicing application design which is fine in interview, until and unless interviewer restricts you after you present the functional requirement.
What has a streaming video has anything to do with CAP theorem . I am not saying it has no relevance. But if you want your streaming video platform to be highly available with some latency tolerance then you have to think about using CDNs and other caching strategies. You are elevating something that has no major part to play.
If there is no counter question, anyone with even lesser experience can answer this question better.
how does the api for upload video looks like ? are you gonna chunk video and upload, what sort of protocol for transferring ( and streaming) chunked data looks like ? there is no API design covered, which should have been I believe. How do you handle the scenario where user pauses video, switches off device for few days and comes back and resumes? Are these not very fundamental of such platform like prime ?
Shouldnt the Cache layer speak to Object store as well for new requests?
Thanks a lot for this wonderful explanatory video.
Have a doubt though - shouldn't the cache also communicate with the object store to retrieve video apart from cdn?
No, we will be using the CDN to interact with the actual files. A cache is a very costly component. The size of video files will be large and using cache for them will not be an efficient solution.
We will use cache to store file url and other metadata for the video. And the CDN will be used to render the actual video files in a fast and efficient manner.
I hope this answers your query.
even i had the same question. thanks for askin and for the answer
Chapters (Powered by ChapterMe) -
00:00 - Introduction
00:47 - Question
01:12 - Requirements
06:16 - Design
21:34 - Follow-up questions
23:32 - Interview Analysis
24:04 - Tips
does the data streaming happen directly from s3 or the video view service gets it from s3 and streams it to the user? i would assume we could directly stream from s3
You can and S3 provides you the option of doing the same. The final choice of how you want the streaming to work is yours. All approaches come with their own set of tradeoffs.
The only thing I couldn't quite understand is why using the Object Storage (in this case S3) for storing videos instead of also using a CDN, and not only using it as a Cache
Not sure if I understand your comment properly, but the reason why I chose to store the video files in an object store is for persistence and replication. I would not want to accidentally lose even a single file uploaded onto the platform. It'd lead to a bad user experience.
The reason for using a CDN over cache is for faster video streaming service by ensuring the right set of videos are in close proximity and thus lower latency and better viewing experience.
I hope this helps.
Does the upload part mean Amazon prime video has user uploads where I can just log in and upload whatever video I want like RUclips? Never knew that was a feature there
Umm it’s Amazon Prime, not RUclips! You don’t need a load balancer to upload video, you just store the contents in a CDN I think.
Exactly, I thought the same,
good video
slightly more opposing force would have been appreciated though
There is no upload feature available for end user so I think we can ignore it
Only one question which tool you are using. Looks fast and friendly
Hey narutoind! If you are asking about the whiteboard tool then the answer is “excalidraw”. They have a free and paid version so do check them out if you are interested!
What is the editor that Abhishek is using?
Excalidraw
Very beginner friendly and when we are saying it's a mock interview, at least some questions from the interviewer were expected. He didn't give any insight on the storage part, replication. I think storage was very crucial for streaming platforms. Only by mentioning the tools name not going to work in a real interview.
It is mentioned that we use map reduce concepts to split and encode the videos before pushing into s3, then why did the interviewer asked if the videos will be split in the questions?
Not experience about video upload and stuff, but why we need video splitter instead uploading it directly to s3?
Hey nff_1950! Video splitting has the following benefits:
- Size optimization: Videos can be large files, and splitting them into smaller segments allows for more efficient storage and transfer.
- Ease of upload: Splitting a large video into smaller segments makes the upload process more manageable. If there's an interruption during the upload, you can resume from where it left off instead of starting the entire process again.
- Parallel processing: Splitting a video enables parallel processing, where different segments of the video can be uploaded simultaneously. This can significantly speed up the overall upload time.
Hope this helps!
Loved the clarity of the component design but he didn't dive into data modeling or api design. Would his analysis be considered enough for a real interview?
Also would have been better if cost analysis was done.
My answer would be yes. I wouldn't have done anything differently even when interviewing at a company.
I have given multiple system design interviews at product companies with positive outcome.
An interview is to assess a candidate's approach and ability to explain their design and solution.
The 2nd half of an interview is more oriented with interviewer follow up questions. If they had asked me to do API or DB design, i would have ditched some detailed explanation from this video in exchange for explaining the API or DB design.
Long story short, within 45 mins of an interview, I'd prefer going deep into a few topics (discussed with the interviewer) and explain this properly. I would not try to over do my skills by a brief explanation of multiple topics.
Just to reiterate, this is my personal opinion. I prefer a depth first approach of explanation. Others may prefer a breadth first approach.
Do what best suits you. It is also advisable to discuss your potential approach with the interviewer at the start of the session, define the scope of what you are planning to do, and then proceed with the same for the duration of the interview.
It depends on interviewer wether he want to change path or is good for him
What app was used for the note taking Abhishek used?
Hey AwpshuN! The whiteboard app being used here is an online whiteboard called “excalidraw”. They have a free and paid version so do check them out if you are interested!
Abhishek, do you take Nick interviews?? If so, please let me know how I can book one?
Are you referring to mock interviews?
@@abhishek0647 yes!!
Which whiteboard platform is being used here?
Hey Alok! The whiteboard being used here is an online whiteboard called “excalidraw”. They have a free and paid version so do check them out if you are interested!
I didnt undertand the CDN service and view video service. What CDN is for ? viewer service is interacting with CDN
CDN is a content delivery service which is a component designed to interact and cache flat files such as images and videos in a fast, simple and efficient manner.
We are using CDN as a caching service between the viewer and the file storage service (S3) to serve the video files to users with the least possible latency.
Please refer to exponent's course video on CDN for a better understanding of the same.
I have a question. are we storing the full videos at CDN level ? or only few intial seconds of a video. because if we are storing the full videos then it will become another storage which will cost very heavily.
No, we will not be storing the full video, but chunks of it at the CDN level.
good point on cost optimization.
what's the name of drawing tool Abhishek used? it's kind of neat and looks very natural drawings.
Hey apurvraveshia5168! The drawing tool is called “excalidraw”. They have both a free and paid version!
Since when does Amazon Prime Video allow you to upload?
Why should the TTL for a hot/trending video be low if its meant to be viewed by more number of user shouldn't it stay in the memory for the more time or TTL should be more. Although one can argue that we won't be able to server the latest update but that can also be pushed by invalidating the cache.
thanks for the video! the font on the screen is a bit hard to read though...
Which tool Abhishek is using to draw?
Hey adityaranjanyadav1776! The tool being used here is an online whiteboard called “excalidraw”. They have a free and paid version so do check them out!
Can someone explain me the hot video part where Abhishek suggested two solutions 1. We can do cache force reset 2. Make ttl very low .
When a video is 'HOT' or quite popular. You'd want them to be available in the cache.
So you can either force update the cache and ensure the popular video is available in it.
If you make the TTL low for a cache, the objects in the cache will be evicted quitckly and only the popular videos will exist in the cache.
I hope this helps,
Abhishek
what is the tool are you using for design in this video
Hey redfly2963! The tool is "excalidraw"
What's the software he's using?
Hey Lakshman! The software being used here is an online whiteboard called “excalidraw”. They have a free and paid version so do check them out if you are interested!
This is a good video but not an accurate replica of the actual system design interview. This looks like someone already knew about the system design interview. In the actual interview please ask the clarifying question, in this case, we can add the video and decide the date to make it available to watch and some videos are not available for some regions, etc.
Hi Tejendra! Thanks for watching and taking the time to share your thoughts!
what is the text editor he is using?
Hey 1nOnlySB! Do you mean the whiteboard? If so, it's called "Excalidraw"
What is this board that he is using to draw diagram
Hey santosh_bhat! The whiteboard used here is "Excalidraw"
Wouldn't you also want delete video for content that Amazon loses the rights to or if they want to remove it because they don't want to pay royalties when the video is viewed?
Hey pauldesrivieres7083, you are right that there are other functional requirements that we could consider e.g. deletion. It is important to note that in an interview, it is not expected for the candidates to cover all possible functional requirements since there are often too many. You can just cover the main system requirements to keep the scope manageable (unless otherwise stated by the interviewer).
Guy never talked about partitioning though
I wander what the design tool the guy used is?
Hey Zhong Yang! The design tool being used here is an online whiteboard called “excalidraw”. They have a free and paid version so do check them out if you are interested!
@@tryexponent thanks dude ^_^
We don't have to make service for each verb 😓
Why are we splitting the video? Why not store at as just one object?
Imagine you're uploading a single 10GB video file, and if, due to a network glitch, it gets stuck at 99.9%, you'd need to re-upload the entire 10GB. However, if you divide the 10GB file into, say, 100MB chunks, and a failure occurs at 99%, you'd only need to re-upload that specific chunk. Moreover, by utilizing multi-core, multi-thread capabilities, you can upload all these smaller chunks simultaneously, resulting in faster uploads compared to uploading a single large file sequentially. I hope that clarifies it.
are videos flat files 7:23 ?
yes, a binary file called a flat file
I didn't understand the response given for the follow-up question asked. Can somone help me here?
How to support video releases that are predicted to have a lot of demand:
1. Force push to cache: Proactively distribute video content to edge servers before high demand to reduce latency, minimize server load, and ensure faster access for users.
2. Reduce the TTL: Lower the TTL for video content to fetch the latest version more frequently, providing real-time updates and quick adaptation to changes during anticipated periods of high demand.
@@tryexponentthank you
It's not enough and need go more deep with more details such as the schema of the database, the qps, the number of hosts.
Amazon Prime does not have creators. He designed RUclips. Not Prime service
but... the public can't upload video to Amazon Prime... why the heck is this treated like it's a thing?!
prime is not youtube.
Film and TV distribution works similarly to uploading to RUclips. Although, it’s restricted to specific users and production companies.
@@tryexponent No it does not. I worked at a startup streaming service that was taking in digital masters from studios and re-compressing them and providing them to users.... The studio does not "upload" to the service like a youtube user. That's not how the industry works.
Sorry, but you're wrong. this is a false premise.
Web Server.
This is really not a good format for an interview. A bunch of boxes and arrows that leaves more questions than answer is NOT how a real interview is conducted. For instance, the moment you draw that box that says "processing queue", the interviewer will ask, what is the nature of that queue, what is actually in that queue? where are the segments of a split video are stored? is it a different storage than the object store depicted? Or when the interviewee mentions "Elastic Search API service" what does it mean? does it mean Elastic search is actually used? Then what is the metadata store? Why should they be kept separate? This is NOT a real interview is conducted.
yes. I too feel that there are a lot of things missing. When happens if while sending the chunks to split server, the upload server crashes. The same with split service to encoder service. There is no data model to show how the video chunks are mapped to the actual video ID. And too many services are talking to Metadata DB, which begs the question, why not have a metadata service. If this is the actual interview then I am sure these questions would popup.
i think this guy miss system design concepts from very basic level. He was lost into his own thought and interviewer was like you only go explain assume and complete the interview. Guy was total lost.
He miss basics to clarify question. It seems like he was teaching rather then requirement gathering or what user wants. Good part was he was explaining well and justifying what he knows lol ., that was same thing we can learn from this.
He lost me in the first three minutes when he prioritized uploading videos as part of his functional and non-functional requirements. Platforms like Amazon Prime have hundreds of thousands of reads for a single upload.
kevin looks lost in space.
Sigh. You can tell the interviewee has no experience in designing a video streaming service. What he showed was a typical data-driven website process.
The intent was to highlight the same, how to approach a problem with the best possible intent when you don't know how to solve it. Took a different approach than other videos to keep it realistic from a mock interview perspective.
He was rambling a lot.
Thank you for the feedback. It is the first tech video I had ever recorded. I will continue working on my communication and presentation skills. I had a lot of learnings from this video.