Scaling Redis at Twitter

Поделиться
HTML-код
  • Опубликовано: 25 дек 2024

Комментарии •

  • @hnasr
    @hnasr 5 лет назад +8

    Amazing session! Very knowledgeable

  • @hnasr
    @hnasr 5 лет назад +2

    29:00 this guy who asked the question about persisted connection is sharp. I would add Whether the proxy is a layer 4/7 or Whether its a TLS termination proxy or not also participates in the latency. If the connections are persisted and stateful from proxy/server then latency will be great. The const comes from establishing tcp/tls ..

    • @gsb22
      @gsb22 3 года назад +3

      Bro, I have seen your comments on like 10-20 videos easily and this is still high assuming you might not have commented a lot.
      This much common in viewing history means I'm unknowingly following your path and might become as knowledgeable as you in future.

  • @itamarhaber9666
    @itamarhaber9666 10 лет назад +6

    Great session - thank you for sharing this!

  • @CoachJagruti
    @CoachJagruti 7 лет назад

    Great work presenting. Thank you for being so clear and fact based.

  • @JaeTask
    @JaeTask 10 лет назад +4

    Very interesting. thanks for the insight.

  • @NitirajSinghRathore
    @NitirajSinghRathore 10 лет назад +2

    One question actually. Which library did she mentioned around 24:46 which is used for talking between services? I can't hear it properly.

  • @denys2388
    @denys2388 5 лет назад

    Very great talk. Thanks so much for it

  • @rangermauve
    @rangermauve 10 лет назад

    Really insightful. Thanks for putting this up.

  • @ЖанШевалие
    @ЖанШевалие 8 лет назад +2

    At 49:00, the perception that relational DBA's don't like stored procedures is inaccurate. What they don't like is _Dynamic SQL_ (i.e., the relational term for 'on-the-fly scripting'). Deployed stored procedures can be optimised when they're slow, as long as their return remains compatible. It's actually preferable to have stored procedures, than a comparable amount of code sent down to the database unwrapped to do the same thing. Relational databases scripting languages are mature and production-ready, and there're optimisations possible on procs that aren't possible on standalone commands. They have to be skilfully used, that's all.
    NB: Strictly speaking a closer term for on-the-fly scripting could be temporary stored procedures, but those are hardly used, that's why I don't consider them here.

    • @ranusyue
      @ranusyue 7 лет назад +1

      You are probably right. I didn't have this as first-hand information so I quite likely got it wrong. I agree that it's a big improvement for reliability/performance if the scripting is deployed instead of ad-hoc.

  • @dattashish
    @dattashish 9 лет назад +1

    Very nice video, appreciate the effort...would be nice to see how redis is used in conjunction with storm to parallelize operations...

  • @squirly4
    @squirly4 10 лет назад

    Great talk. Redis+Caching.

  • @andydollar007
    @andydollar007 9 лет назад

    Fascinated talk

  • @AlexVsLife
    @AlexVsLife 9 лет назад +2

    Great video and also very interesting! I just wish I knew what it all means. Without studying comp sci this all seems very foreign.

  • @rudirestless
    @rudirestless 7 лет назад

    I have been brought here by University of California, San Diego's Course on Big Data !

  • @AdrienJarthon
    @AdrienJarthon 10 лет назад

    Great talk, thanks !

  • @nedvedyang
    @nedvedyang 8 лет назад

    Very good

  • @gokukakarot6323
    @gokukakarot6323 4 года назад

    What does it mean, redis can see what the server can do and its not doing and make a service out of it :/

  • @hengwei2403
    @hengwei2403 7 лет назад

    you know, abstract level.. so cute

  • @ipozgaj
    @ipozgaj 10 лет назад

    Main problem with Redis is that it scales terribly. The fact that it runs on a single core only is a huge limitation, as you have to run multiple instances per physical server to full utilize it, which becomes a management nightmare if you have anything more complicated than a trivial deployment.

  • @BrianBulkowski
    @BrianBulkowski 10 лет назад +5

    You people should try Aerospike. It's an open source project that's used at massive scale in the advertising industry. It is an in-memory system that solves _all_ your requests --- it has the same high performance as Redis, it has clustering that works, it is multithreaded. Since it's been in deployment for years, a lot of the hard problems of memory allocation, network optimization, etc have been solved.
    Instead of putting out yet another open source project, how about working with us to contribute a Redis protocol compatibility layer?
    Contact me at brian@aerospike.com

    • @Thinking-Fish
      @Thinking-Fish 10 лет назад

      Looks like a solid project with clean code. I only read a little bit but I do appreciate the work.
      I don't think we will simply use it to replace our existing and in-development stack though. Long story but I'm sure you are familiar with how the ecosystem argument goes.

    • @BrianBulkowski
      @BrianBulkowski 10 лет назад

      Yao Yue
      Would you be open to a conversation? We have customers in advertising working at very similar scale, and we've satisfied all of your wishlist --- years of production experience. In Aerospike, we believe there is a better Redis --- one with clustering and flash out of the box, today. Please reach me directly, we can have an honest technical discussion.

    • @hottimelineevents8165
      @hottimelineevents8165 10 лет назад +1

      I've read some of Aerospike, it looks great that Aerospike is 10x faster than Cassandra and MongoDB

  • @darkpill
    @darkpill 5 лет назад +5

    Very amazing tech behind what’s really a pretty shitty service.

  • @oneforallah
    @oneforallah 2 года назад

    FIRED

    • @QUINTIX256
      @QUINTIX256 2 года назад

      In your retirement years, you’re going to look back upon your manchildhood with despair.

    • @oneforallah
      @oneforallah 2 года назад

      @@QUINTIX256 yes bruh already feeling dreadful about all the layoffs, it wasn't meant to be funny. I was just stating what happened.