20 Whitepapers that changed the world [For Senior Software Engineers]
HTML-код
- Опубликовано: 2 июн 2024
- Here are some whitepapers that you must read as a software engineer. These technologies have changed the world and inspired hundreds of systems through their ideas to tackle scale, reliability, and performance.
WhitePapers: interviewready.io/blog/white-...
Whitepapers have the benefit of discussing practical implementation details and the related tradeoffs to engineering products. The best engineers worldwide have written them after years of work, so don't miss any of them!
00:00 Who should watch this?
00:29 Memcached Design Tradeoff
01:40 20. TikTok Monolith
02:55 19. Meta FlexiRaft
03:54 18. Google Spanner
04:30 17. Meta Minesweeper
05:33 16. Apache Cassandra
06:07 15. Apple FoundationDB
06:36 14. Amazon AuroraDB
07:11 13. Google Pregel
07:45 12. Google Dapper
08:37 11. Google Chubby
09:12 10. Google Megastore
10:04 9. Google Bigtable
10:44 8. Google Map-Reduce
11:38 7. Google File System
12:25 6. Meta TAO
13:05 5. Meta Memcached
13:40 4. Google Monarch
14:23 3. Meta GorillaDB
15:22 2. Amazon DynamoDB
15:52 1. Google Zanzibar
17:00 Links in Description
Designing Data-Intensive Applications Book: amzn.to/3SyNAOy
Github: github.com/InterviewReady/sys...
#SystemDesign #WhitePapers #SeniorEngineer
Who loves System Design?
✋🏼
But not the system design interview
its a tradeoff :P
Me
xD@@piyushasutkar5423
One of my favorite videos so far. Thanks!
These types of videos are much needed. Great work!
Thank you!
I just needed this right now. Thank you for the video.
Great video! Thank you for taking the time to share this information 🤓
Man, when will you stop blowing our minds with your awesome content and mostly the selection of it.
Keep posting such awesome stuff.
Thank you so much 😀
Just 2 whitepapers deep into the discussion, I am loving this one.
I would love more content like this! just awesome!
These kinds of video are really great. It feels like "here are the resources for some things you are interested in and go do the homework on the things you are interested in". Great content.
Glad you enjoyed it!
look forward to more videos like this from Gaurav!
Thanks ...good summary narrative for each
Dear Intelligent software engineers,
Please do not implement solutions mentioned in this video just because you understand. Remember that such high scalability is not needed for 90% of companies. If you implement such things then people like me has to suffer endless hell of debugging :(
Wow, 1 stop for tons of information ❤
God bless you Gaurav. I learnt a lot of stuff about system design from your videos. I come from a service background with focus on enterprise business applications but your content gave me the excitement to look at building applications that can scale. Good Job Keep it up
Thank you!
Awesome.. added in my list
Great Content Gaurav, I've just started working as a Data Architect and this video felt like an expedition to my own learnings in the past couple months. This is probably the best content I've gotten online in a long run, you should really dispense more knowledge on enterprise architecture as it is still a very untapped area in the online learning sphere.
Thank you!
I'll work on it 😁
No, I should thank you @@gkcs :)
This is an excellent initiative and very high quality content. By the way, did you repeat MemCached in the video?
Since too long I was looking for something like this only but didn't know what to search...
Thanks it's very helpful
~ Danishan [Amity University]
Thanks a ton for this video. Atleast, I got starting point to read whitepapers now XD
Thanks for the summaries. Those scrolling animations were quite hurting my eyes. Maybe it is because of my monitor's refresh rate.
I will suggest to make yourself as foreground when you are talking and those scrolling animations in background.
Also I would like if you can make individual detailed explanatory videos.
Damn, well explained, thanks!
Gaurav just dumped a ton of learning on my plate. A feast.
Amazing video..Thanks a lot
super interesting! Thanks
Hey Gaurav, huge thanks for this valuable content! Best wishes from Kyrgyzstan.
Thank you!
Gold in its content!!
This is real software engineering!
Very nice video 👏
It would be great if you could walk through these papers.
Deep dive one paper a week.
Wow thanks a lot for this 🙏. You awaken my interest to desire for knowledge, Imagine the satisfaction once I understand these interesting and at scale technology.
Awesome!
Keep sharing more
First youtuber whom I could watch at normal speed than 1.5x
Lol I went to switch the playback speed out of habit but then I realized there was no need to 😂
Raft paper should be on top because it is widely adapted for various use cases most of the Distributed SQL are using it.
It's hard to choose among them, they are all gems!
Since this is related to software engineering, I have kept RAFT and Paxos aside. They are usually implemented using libraries in most companies.
Thanks Gaurav
I'm going to print all of these and make reading them my belated 2023 New Year's Resolution.
Great idea 😁
any festival discounts coming up sir ? wanna buy the course :)
Should I read these papers as a beginner, and will it help me?
Amazing read @gkcs
Nice
Cassandra was developed by the same engineer who developed DynamoDB paper while he was at Amazon
Thanks Algorithm for recommending this, I'll watch later. 🙏
What is the difference between whitepaper and research paper?
You should also create a blog post about this! I want it to be shared easily
It's there in the description!
I need to return back to school.
U should have also included Satoshi nakamoto's bitcoin white paper in the video too
Great video. How did you found this white papers? Is there any website where we can see these papers?
I read from various sources. Google Research, Microsoft Research, and Meta Research are my favourites.
I also use the citations from these papers to find other useful papers.
After watching this video, questioning myself about my work as a software engineer😂
Don't! We've all written (and will yet write) plenty terrible code. It hardly matters, if it accomplishes what it needs to.
And these white papers need to solve extremely huge, complex architecture problems. Most projects don't need to. Many projects can be badly structured and inefficient because they don't have maintainability and scaling requirements.
@@reed6514In other words, yes you suck, but most of us suck, so it's OK.
@@megamaser 😄🤣 kinda lol
one for frontend too
Do you subscribe to any sources that distribute these white papers as they are published?
meta is great!
System Design chose me, I didn’t choose it. I dream in multi-dimensional shards.
why don't you discuss those papers in your course ?
Hello Gaurav,
I am looking for location, where I can get all these white paper. I m looking for Frontend as well.
The blogpost is linked in the description.
Link to papers would be much appreciated!
It's in the description, at the blog.
I am struggling to watch the video because of the scrolling through the papers, somehow it is straining my eyes. I am not trying to read the words displayed, but rather the motion on the screen. I do not have an epilepsy or any condition of that sort. I recommend you perhaps scroll slowly through the written text, I love the content though ❤
I think cassandra pre-dates dynamoDB
"What Every Programmer Should Know About Memory" Ulrich Drepper
Audio quality has decreased in recent videos
Bro your Contents are great, but please buy a good mic
👍💯💯
OK, I am a beginner. Please tell me just one paper to start with.
Start with the Facebook Memcached Paper.
thanks you@@gkcs
Have you tried implementing any one?
Billion users are huge number of users, 8 billion is world population.... Reading to feel nice is different but not even single startup in past 10 years have reached this much of user base because no Idea is such a mind blowing that it reaches to everyone... there are lot of things they have already tried lot of Phd. level knowledge is needed to understand these things
Facts
bc .. no one has studied any paper just started commenting share more such stuff,,
SUGGESTION:
Please fix your audio setup. Your voice in "some" videos is distorted & sharp which hurts my ears. The sound quality makes your useful videos harder to consume.
Here in less than a minute
Your video is cool, but let me react about a specific point. You seem to be confused about open-source software. Open source is not "a possible solution for small companies" as per your statement. By doing so, you insinuate there is a hierarchy between open sources (for small companies) and closed sources (for those with cash), implying the latest is better. This can be further from reality. Most of the internet runs on open source. AWS, Apple, Cisco, Google, Android and much more are using open-source code as the base for their custom implementations. Open-source is the reason why the internet is what it is today, without it the evolution we've witnessed since 1991 would be different. If today you can publish your video and be watched from anywhere around the world, and possibly make money, it's because open-source software was leveraged by small AND large companies during every little step that led to where we are today. So I invite you to understand a bit better what it is about and avoid making such statements in the future. Cool video by the way. Cheers
Hey Benjamin, that's a good point. I did not intend to rank order contributions or tech in any way. I also do not believe open-source or closed-source are inherently better or worse than one another in terms of capability.
Your audio doesn't sound great. A little tinny and hollow.
Loved the video, though.
How can you miss Kafka's whitepaper. This is blasphemous
I think it's a great system, but (here is the controversial bit)...I didn't like the whitepaper :/
It's ironic you call Cassandra a clone of Dynamo DB when it's a clone of MongoDB when mongo was open-source
wooo I'm building the authN/authZ sys at my startup and the coolest solutions are basically implementations of Zanzibar :) [ Authzed, ORY keto, OpenFGA and big brands like auth0 also making their own versions.]