To those people complaining that this is not a great presentation - I would rather listen to somebody who really knows what he's talking about, and is enthusiastic about it, than listen to somebody who is a "professional presenter". I''m no fan of Facebook, but we should all be grateful when we get to listen to someone who is an expert in their field giving us the benefit of their experience.
Agreed. I work at a small startup, so when he says things like "It's unacceptable to have a 2ms latency between the servers and datacenters", it's just like...whoa...
This talk really underscores the importance of optimization. I like how they got into the guts of the servers (such as network drivers) in order to make more efficient use of memory and processor use. Also, the switch from TCP to UDP made a lot of sense.
Holy. Just having the string length instead of doing `string.length` saved so much money. It's crazy to think at the scale that Facebook has, having one duplicate line could cost millions of dollars in time over it's lifetime.
Many folk seem to reckon powers of 2 are wasteful. Java's ArrayList grows by powers of 1.5. SQL Server grows database files by powers of 1.1. These are general purpose algorithms. In your case powers of 2 might be the right thing. Understand your data and test accordingly!
what is memcash? how does it work exactly? What are the memcash problems ? How did they solve it? If you think he explained it well. stfu then. he was talking and barging about facebook teamwork nothing more nothing about tech
Yeah, the majority of the interrupts go to processor 0, the possible optimization is to deliver the interrupts to each core and let threads with hard affinity handle each interrupt. You can do it if the server is owned by one process.
Hey great vid....I need some help here.The 'Gaming' tab has replaced my 'Friends' tab on my Facebook account... Is there a way to reverse this? I'm on a desktop PC ...Please note, You wont see it on your account once it is functioning properly ... But on my account on the area at the top of the page where there is usually : Home, Friends, Watch, Marketplace ,Groups etc, I am seeing 'Gaming' instead of 'Friends'...But not on all the Facebook accounts (For example:- if I log into my wife's account its fine and as it should be)...I also noticed, my new friend request has severely throttled down as a result; my account is set so everyone can send me a request...About two weeks ago it reverted just for a moment an the friend request bumped back up...but sadly was short lived...tried several attempts to contact Facebook and the Community for help...but nothing so far . Your help is appreciated.
+DropsyDugo Memcache is efficient if you are working just with strings. Redis is helpful, if your keys/values are other data structures, like lists, sets etc. I think, as in Facebook, majority of the data (posts, comments, links, pictures) are strings (or can be serialized/de-serialized into string), they went for Memcached. Also, Mark says, they implemented memcache in 2005 (or at least got inspired from Live Journal). Redis, on the other hand, was created in 2009.
To those people complaining that this is not a great presentation - I would rather listen to somebody who really knows what he's talking about, and is enthusiastic about it, than listen to somebody who is a "professional presenter". I''m no fan of Facebook, but we should all be grateful when we get to listen to someone who is an expert in their field giving us the benefit of their experience.
Agreed. I work at a small startup, so when he says things like "It's unacceptable to have a 2ms latency between the servers and datacenters", it's just like...whoa...
Agree 10/10! It was indeed a great talk offering so much to learn! The sheer & genuine enthusiasm of Mark is truly inspiring :)
Paying my respects to Zucc here, he does a good job at explaining memcache.
This talk really underscores the importance of optimization. I like how they got into the guts of the servers (such as network drivers) in order to make more efficient use of memory and processor use. Also, the switch from TCP to UDP made a lot of sense.
indeed, it's still supporting the TCP connection though client has the choice
Video from 2008, uploaded in 2013, watching in 2020. RUclips algorithm, unresolved mystery ...
*2021
2024
August 2024
Watching this 11 yrs later. Been using memcached for a while, in my quest to know the brains behind this i came across this video
Holy. Just having the string length instead of doing `string.length` saved so much money. It's crazy to think at the scale that Facebook has, having one duplicate line could cost millions of dollars in time over it's lifetime.
Zucc is so much more personable when he isn't trying to be personable. A nerd in their element is so endearing
The video cuts off right when it gets to the really good stuff!
I think it's awesome that andrew WK party hard breaks in at 14:47
Many folk seem to reckon powers of 2 are wasteful. Java's ArrayList grows by powers of 1.5. SQL Server grows database files by powers of 1.1. These are general purpose algorithms. In your case powers of 2 might be the right thing. Understand your data and test accordingly!
What is called this kind of knowledge?
@@rodrigueskorn computer science
11:16 and that brought about the largest ddos attack years later for github
Anyone have a link to the rest of the lecture?
This is an interesting video. Mark explains this well, without being too technical.
14:45 ...?
For a moment, it seemed like a scene from Inception
@@thyagtubes LOL yes what what was that.
lmao
Glitch in the matrix
Nice work on the interplay of coding/design decisions and real expenses at long term and large scales
8:07 are these the right slides??? :P
Mark Zuckerberg is great at explaining complex things so simply.
what is memcash? how does it work exactly? What are the memcash problems ? How did they solve it? If you think he explained it well. stfu then. he was talking and barging about facebook teamwork nothing more nothing about tech
Daddy Zuck talking about memcache - omgz
Very good presentation
Who stole the rest of the video? ;-)
RUclips must have ate it all up for breakfast :(
UDP missed packets
That's what you get if you don't say ACK.
Yeah, the majority of the interrupts go to processor 0, the possible optimization is to deliver the interrupts to each core and let threads with hard affinity handle each interrupt. You can do it if the server is owned by one process.
Why tf are you winlking
Is there kernel patch for making slab allocation from power of 2 to 1.3 ?
Hi, we recommend joining and posting in the Developer Community Forum for assistance: tinyurl.com/y6g8l2e5
Do they still use memcached? What does their current stack look like?
World really missed an brilliant engineer
Did he write memcahce or did he just deploy it on FB? because thats a big difference
Good presentation that I can keep watching
watching this 8 years later.
awesome in depth understanding
where is the rest?
when is last time Z presented a tech talk?
Iterate really fast, build really bad UI / UX... woot..
Basically: build buggy software, and fix only what people complain about. Not bad for a student, terrible for a large company.
Superb sir
Good morning sir!
so basically he made redis for facebook?
memcached isnt by facebook and its older than Redis and during the making of this video,Redis wasnt there if I am not wrong
@@vaishakm6 You're right.
Redis released 2009
Memcached - 2003
why facebook didnt switched to some other technology?
because the scale at which they are working changing the technology could break many things I guess.
Am I the only one that keeps scrolling up?
and it saved millions of dollars!
it is not finished
2 -> 1.3
Thanks yt algorithm
Hey great vid....I need some help here.The 'Gaming' tab has replaced my 'Friends' tab on my Facebook account... Is there a way to reverse this? I'm on a desktop PC ...Please note, You wont see it on your account once it is functioning properly ... But on my account on the area at the top of the page where there is usually : Home, Friends, Watch, Marketplace ,Groups etc, I am seeing 'Gaming' instead of 'Friends'...But not on all the Facebook accounts (For example:- if I log into my wife's account its fine and as it should be)...I also noticed, my new friend request has severely throttled down as a result; my account is set so everyone can send me a request...About two weeks ago it reverted just for a moment an the friend request bumped back up...but sadly was short lived...tried several attempts to contact Facebook and the Community for help...but nothing so far . Your help is appreciated.
Just google everyone's name in this video...
Why?
just love zuck❤
facebook, why memcahe and not redis?
+DropsyDugo Memcache is efficient if you are working just with strings. Redis is helpful, if your keys/values are other data structures, like lists, sets etc. I think, as in Facebook, majority of the data (posts, comments, links, pictures) are strings (or can be serialized/de-serialized into string), they went for Memcached.
Also, Mark says, they implemented memcache in 2005 (or at least got inspired from Live Journal). Redis, on the other hand, was created in 2009.
+Pankaj Kumar it's been one year! Thanks for the answer :) )
Redis launched in 2009, this video is from 2008...
It will always be a rip off of myspace
Just say is not good
This is the most lame presentation I have recently watched
Fuck you error 505