Love the "True-crime stories" vibe, where all the details are uncovered step by step. Great story telling! I really like how your channel is positively progressing over time.
10/10 As a developer in a small company it's hard to scope out what needs to be done to make a solution *infinitely* scalable. It's great to understand how big companies handle big data to provide insight on how I can develop solutions Cheers
Just watched it all! It's enlightening that you mentioned each problem they faced and what different practical techniques and technologies they used to overcome them)
Absolutely impressive how they made all of these pieces fall in line and interface correctly. I imagine it would be hell to diagnose a bug on such a complex system. Where do you even start? They would've had to choose from dozens of different terminals and log systems to even start looking at what is happening.
I really like this topic especially because I'm a backend dev that uses Python. It highlights what amazing stuff you can do with it outside machine learning and AI.
@@ninobach7456 Its build really well, and has a lot of community with experience behind it. Its also easy to setup and develop with. But flask and tornado are also populair (but i wouldn't recommand them unless you work in a team that knows what they are doing. )
Posts and messages are generally not modified quickly, so that's cool. But what about the rapidly changing ones like comments, likes, etc? How can we be sure that the cached value in the CDN is the actual value or atleast close? (Yes I'm talking about one of the two hardest problems in CS)
This video made me feel like a speck of dust in the field of web programming. I use php and mysql to store and retrieve info from one server. With a million users per day the way I handle the load is by making the server more powerful rather than scaling up horizontally. This is such an eye opener :|
I don’t think that’s a bad thing. I think there’s actual a really good use-case for vertically scaling your existing server and is often overlooked! Simplicity is super helpful.
Absolutely mind-blowing! This documentary showcasing how Instagram scaled to 14M users with just three engineers is a testament to their incredible ingenuity and resourcefulness. It's a prime example of how a small, dedicated team can create monumental impact through innovation and smart engineering. Truly inspiring for aspiring tech entrepreneurs!
i think you are wrong buddy, the user application normally will have a set point of where to request the data, that set point is always a CDN . in other words all URLS on the user side goes to the CDN, then if the CDN contains the data and the data is not stale it returns the DATA, the Server Application never needs to translate the Object Storage URL to a CDN URL , its Just that the User Application is never aware of all that sort of thing or even that the Server Application will send the Object Storage URL to the CDN.
it's crazy to think how Python powered Instagram in its early stage where it experienced massive growth, given Python's reputation for being a not so performant language.
Python still powers Instagram, however they have their own in house CPython version called "Cinder" which has much better performance and is tailored exactly to their requirements.
I really enjoyed the content of the video 🎉 but I was a bit irritated by the flow or the narrative rhythm of the video. There was a lot of silence/emphasis on unimportant animations. Don’t want to be unappreciative, thought! I enjoyed it anyways but it’s just something I noticed ❤
Hey, thanks for the video. It was fun watching it. As a software engineer, myself, I enjoyed it very much. First you explained the challenge and I thought about what I would use to solve this, and then I watch further, and it was always the same solution the guys from Instagram came up with.
I had to solo craft entire infrastructure for a company that is now operating in dozens of countries. When it keeps going for longer, you switch from engineering issues to mental issues..
With all that complexity, resources to buy, developers to pay, have you ever wondered how the app manages to stay free of charge ? Remeber, you’re the product.
I don't think three developer could handle all these if they were using something like Node js or any other framework. My company is moving away from Django towards Node, which will definitely cost them more and also mean i need to start searching for a new job.
Hi everyone :) I got married lately and was on a bit of a break! Glad to be back and posting videos! Let me know what you want to see.
Congratulations
Congratulations
Congratulations
Congrats!! :)
Congrats!!!
I really like how you turn software architecture into a compelling narrative! You earned my subscription.
Love the "True-crime stories" vibe, where all the details are uncovered step by step. Great story telling! I really like how your channel is positively progressing over time.
10/10
As a developer in a small company it's hard to scope out what needs to be done to make a solution *infinitely* scalable. It's great to understand how big companies handle big data to provide insight on how I can develop solutions
Cheers
Just watched it all! It's enlightening that you mentioned each problem they faced and what different practical techniques and technologies they used to overcome them)
Agreed!
those 3 did that.. meanwhile me on my WFH day: watching youtube all day doing no work smh
I generally don't watch such video but the presentation of this video ket me hooked to the end. Its just amazing! Kudos to you and your team!
These videos are so interesting! Always the things we take for granted are somehow the most fascinating.
I love these kind of videos. Keep it up Lewis ❤
Absolutely impressive how they made all of these pieces fall in line and interface correctly. I imagine it would be hell to diagnose a bug on such a complex system. Where do you even start? They would've had to choose from dozens of different terminals and log systems to even start looking at what is happening.
Brother your content is becoming something else, it's like watching million dollars documentary, keep it up
I really like this topic especially because I'm a backend dev that uses Python. It highlights what amazing stuff you can do with it outside machine learning and AI.
the quality of this video is insane
Mind blown! Great video!
Horizontal Scaling is Awesome, I love the concept.
Amazing that Django handled the entire application sided of things. Always loved python for web programming.
Is Django the go to for back end development in Python?
@@ninobach7456 Its build really well, and has a lot of community with experience behind it. Its also easy to setup and develop with. But flask and tornado are also populair (but i wouldn't recommand them unless you work in a team that knows what they are doing. )
@@ninobach7456 Not anymore, async frameworks like FastAPI are taking over.
@@ninobach7456yes, among Flask and FastAPI
@@ninobach7456 pretty much
Your contents are at another level, lewis
Nice way to teach system design, totally liked it.
This is amazing.
Nice explanations, I loved every bit of it!
Really love the format of going through each layer one at a time.
I love your story time videos. They are informative and entertaining. The unicorn part got me 😂
As always keep up with your videos! 😉🔥
i really like how the videos are made. keep up the good work
You can see the effort put into these videos. I see a great future for this channel. My subscription is yours oh great one.
Basically the 3 engineers uses Amazon ready-to-use technologies :-)
Great content man
I love how you make engineering principles suspenseful and interesting. Well done. New sub.
Posts and messages are generally not modified quickly, so that's cool. But what about the rapidly changing ones like comments, likes, etc? How can we be sure that the cached value in the CDN is the actual value or atleast close? (Yes I'm talking about one of the two hardest problems in CS)
One of the best system designs video 🎉
Great video! Mad editing skills, Lewis. Love the vibe of this video. Felt like an episode from Mr. Robot hahah
This video made me feel like a speck of dust in the field of web programming. I use php and mysql to store and retrieve info from one server. With a million users per day the way I handle the load is by making the server more powerful rather than scaling up horizontally. This is such an eye opener :|
I don’t think that’s a bad thing. I think there’s actual a really good use-case for vertically scaling your existing server and is often overlooked! Simplicity is super helpful.
Loved the content, really amazing, would love to see your videos on different firm's infrastructure to understand tech better.
Video starts: "How did three software engineers alone..."
You should start making more videos like this, like how companies handle things 😇
great video, it is very inspiring to see what those engineers were able to build with that three principles🎉🎉🎉
Quality Content! Keep it up Lewis!
knowing whats going on in the background is important even more interesting the way its being delivered here thank you
this video is underrated
Super interesting video. Good Job :)
You must be one of three legendary engineers. Thanks for amazing content.
This format is great! Keep up the great work!
Wow, this is Netflix level documentary!
when i see this type of videos
i know surely that I'm still a beginner
Bro the scaling needed for everything is too immense to think of
That was so helpful. Thank you.
contetn is gold, its like im wathing netflix crime documentaries
This video is truly incredible in its quality and content! Special thanks
Absolutely mind-blowing! This documentary showcasing how Instagram scaled to 14M users with just three engineers is a testament to their incredible ingenuity and resourcefulness. It's a prime example of how a small, dedicated team can create monumental impact through innovation and smart engineering. Truly inspiring for aspiring tech entrepreneurs!
Hi chatgpt
ChatGPT response
i think you are wrong buddy, the user application normally will have a set point of where to request the data, that set point is always a CDN . in other words all URLS on the user side goes to the CDN, then if the CDN contains the data and the data is not stale it returns the DATA, the Server Application never needs to translate the Object Storage URL to a CDN URL , its Just that the User Application is never aware of all that sort of thing or even that the Server Application will send the Object Storage URL to the CDN.
please more content like this
are trends just data optimization for instances? because everything is just locally relevant
Absolutely amazing
Have a lot to learn as backend engineer
it's crazy to think how Python powered Instagram in its early stage where it experienced massive growth, given Python's reputation for being a not so performant language.
Python still powers Instagram, however they have their own in house CPython version called "Cinder" which has much better performance and is tailored exactly to their requirements.
I love this new way to study system design
Please don't stop producing this kind of video, it's really good!😃
This is really good. Thank you so much for the awesome content.
Great stuff!
Congratulations bro🎉
Make video on AI in video games
Stay tuned :)
More of this!!!
Amazing video, I'm using some of the tools mentioned in the video.
great video and great presentation of the whole things, nicz work and thank you
my mind:
Guni-corn 💀
I saw a talk from Instagram engineers talking about celery framework server for background task scaling
Great story telling, loved it!
Amazing Insights
i'm amazed as well as inspired to lern these tech!
How did you find these informations, I mean technologies Instagram used and may have even stopped using right now
I really enjoyed the content of the video 🎉 but I was a bit irritated by the flow or the narrative rhythm of the video. There was a lot of silence/emphasis on unimportant animations. Don’t want to be unappreciative, thought! I enjoyed it anyways but it’s just something I noticed ❤
Very good editing
Great post. Subscribed to your channel.
Loved it , I have subscribed to your channel now 👍🏻
Every ting seems good but Infoq London summit says something different like Casandra as well
Awesome video! Thanks !
Hey, thanks for the video. It was fun watching it. As a software engineer, myself, I enjoyed it very much. First you explained the challenge and I thought about what I would use to solve this, and then I watch further, and it was always the same solution the guys from Instagram came up with.
Nigga, this shit was crazy, and i loved it, keep it going gang 🚀
I had to solo craft entire infrastructure for a company that is now operating in dozens of countries.
When it keeps going for longer, you switch from engineering issues to mental issues..
Great video!
i love this episode! make more please!
Where did you get the slick animated icons at the three rules portion? I loved those! Especially the reinvent the wheel one!
With all that complexity, resources to buy, developers to pay, have you ever wondered how the app manages to stay free of charge ? Remeber, you’re the product.
Thanks for your sharing
This was sooo good so informative and entertaining
Do Snapchat next
As always great content Lewis did you see discord went down yesterday ? can you make a video on that thank you
This is Modern dystopia 😅
Thanks for the great video!
You spell it Gunicorn btw.. This is common knowledge. \s
if you made this video a while ago it would've been super helpful haha
Gunicorn is G-Unicorn - stands for Green Unicorn lol so it pronounced Either GUNI-Corn or G-Unicorn depending on what you'd feel good about.
Brilliant engineering.
Good old days when Kubernetes wasn't a thing
how do you create these videos? Specially the graphics that you show to explain the architecture and flow of the request/response?
This video is beautiful.
Simple, Instagram is not a technology innovation. One software engineer could be also enough
07:24 why should there be more than 25 connections?
As an iOS engineer ,this video is too backbend I’m kinda confused love it by the way .
100 good developers > 500 average developers
10 elite developers > 500 average developers
Wondering why they used memcache instead of redis for DB results caching.
Omg! 25 instances!? Impossible 😮 😂
Make a video on how RUclips is made
I don't think three developer could handle all these if they were using something like Node js or any other framework. My company is moving away from Django towards Node, which will definitely cost them more and also mean i need to start searching for a new job.
Going with the hype.Django is so productive and capable.
Why would python with django be more performant than node/js with express?
@@ToniVucic I didn't mention performance; what you can build on node with 8 developers, 2 Django developers can achieve it in maybe lesser time.
Incredible production quality! Please keep it up.