Shuffle Sharding
Shuffle Sharding
  • Видео 14
  • Просмотров 27 123
OxE - Seattle's options - Ranked Choice Voting and Approval Voting - Deep dive and Q&A.
This November Seattle is voting on whether to change voting systems. This video is a deep dive into the three options; keeping the current system, using Ranked Choice Voting, or Approval Voting, along with Q&A at the end.
Просмотров: 384

Видео

0xD - Safekeeping with no Combination - building and operating systems that handle sensitive data
Просмотров 5502 года назад
How can we build and operate systems where even the service provider does not have access to the data that is being managed?
0xC - Side-channels and jitter
Просмотров 4052 года назад
Why doesn't jitter or noise mitigate side-channels?
0xA - Distributed Systems Engineering: Idempotency
Просмотров 9432 года назад
In our tenth stream we get into Idempotency, a really core topic for understanding distributed systems.
0xB - A short one on Shuffle Sharding
Просмотров 1,1 тыс.2 года назад
In our 11th series we go deep on Shuffle Sharding, the namesake of this channel!
0x9 - Distributed Systems Engineering: Idempotency
Просмотров 1 тыс.2 года назад
In our first session on Distributed Systems Engineering, we dive into Idempotency.
0x8 - "How do I get people to do the right thing?"
Просмотров 1,3 тыс.2 года назад
In our first Principal Engineer soft skills session we'll cover one of the most common challenges senior engineers face ... "How do I get people to do the right thing?" ... whatever that means!
0x7 - Functional Programming in C
Просмотров 3,5 тыс.2 года назад
Our brains think differently in Functional Programming languages and that's really useful! More useful than the languages themselves. Here we go through how functional programming techniques were used in s2n, a C99 code base, when C is about the least functional programming language around!
0x6 - A deep dive into DNS
Просмотров 8 тыс.2 года назад
A deep dive into how DNS works including full walkthroughs of name resolution, from someone who has built several DNS services.
0x5 - Shuffling and Sampling
Просмотров 6692 года назад
A deep dive into Fisher-Yates shuffling and reservoir sampling. Two easy algorithms that we can learn a lot from.
0x4 - Deep into blockchains and NFTs
Просмотров 5372 года назад
How do blockchains work? We dive into blockchains as used in crypto-currencies and NFTs.
0x3 - Side Channels
Просмотров 5742 года назад
A deep dive into side channels; what are they and how can we protect systems against them?
0x2 - Confidential Computing at AWS, the Nitro system and Nitro Enclaves
Просмотров 2 тыс.3 года назад
A deep dive into how the AWS Nitro System provides confidential computing between AWS and AWS customers, and how Nitro Enclaves can be used by customers to build a confidential computing boundary around sensitive data processing that is isolated even from themselves.
0x1 - How AWS SIGv4 and SIGv4A work
Просмотров 6 тыс.3 года назад
A deep dive into how web requests are signed and authenticated for Amazon Web Services

Комментарии

  • @boluwatifeogundeyi9206
    @boluwatifeogundeyi9206 2 месяца назад

    Interesting one, thank you for this!

  • @0xmureeb
    @0xmureeb 3 месяца назад

    thx!

  • @DF-ss5ep
    @DF-ss5ep 5 месяцев назад

    These sub keys (hashes) are generated when a secret access key is requested and propagated to services at that time, right? The way it was explained made it sound like there was some batch job generating keys every day

  • @DF-ss5ep
    @DF-ss5ep 5 месяцев назад

    The red phone is for calling Jeff Bezos when quantum computers break RSA.

  • @HelloThere-xs8ss
    @HelloThere-xs8ss 9 месяцев назад

    very cool. And yes, DNS nameservice

  • @santanaaybar7466
    @santanaaybar7466 11 месяцев назад

    It was quite helpful. Aversion to risk is aversion to change, not necessarily aversion to growth but it can be, specially when it comes to department and company culture, whether it’s lack of cohesion in team work or growth.

  • @TreeLuvBurdpu
    @TreeLuvBurdpu Год назад

    OMG the first 15 minutes is "functional programming sucks and i don't understand it". I hope that's not the whole thing.

  • @luvpreetsingh8020
    @luvpreetsingh8020 Год назад

    Nice!

  • @dokiikod
    @dokiikod Год назад

    thank you

  • @ChrisJackson-js8rd
    @ChrisJackson-js8rd Год назад

    couldnt agree more when it comes to team members who prefer top submit clever (or obscure or impressive) code over simple code

  • @Aaronanimeify
    @Aaronanimeify Год назад

    This is a magnificent video and explanation about DNS and even shows you real commands to utilize.

  • @coderlicious6565
    @coderlicious6565 Год назад

    I created a lambda with a function URL. is there a straightforward example for making a call to this URL with fetch, or jquery ajax, etc. ? ( or even axios within react )

  • @markhathaway9456
    @markhathaway9456 Год назад

    While saying you were using FP concepts, you were describing a combination of data and functions which sounded very OO to me.

  • @samjackgreen
    @samjackgreen Год назад

    something funny about discussing cutting edge security tech and relying on holding up sheets of paper to the camera 🤣🤣

  • @manuelcop
    @manuelcop Год назад

    Could you link the tweet/docs you are mentioning at 39:09 please?

  • @giladaperio
    @giladaperio Год назад

    Thank you for the elaborate explanation.

  • @Amapramaadhy
    @Amapramaadhy Год назад

    tldw: you send your `id` along with fancy `hash(key_for_that_id)`. AWS can then look up their stored copy of `key_for_that_id` and calculate hash(key_for_that_id) on their end. As long as the two hashes match, all is well. [Fancy here means they also take region, service name, date, url into account etc]

  • @AlexLi-zige
    @AlexLi-zige Год назад

    one of the best video explaining sigv4(a)!

  • @meshushelly
    @meshushelly Год назад

    Great stuff, thanks Colm!

  • @RABWA333
    @RABWA333 Год назад

    better if you explain with diagram (visualization method), not easy to follow and had to stop watching and look for another resource

  • @recurrenTopology
    @recurrenTopology Год назад

    Given my political leanings I was happy to see Peltola win in Alaska, but my guess is this is actually an example in which RCV failed to find the Condorcet winner (would have beat either of the other two candidates in a head to head), who was likely Begich. Doesn't mean there was anything about the election that was rigged or unfair, but I don't necessarily think its a great example of RCV best representing voter preference.

  • @kixiqu
    @kixiqu 2 года назад

    Thanks for putting this together, it's cool stuff! One factor that wouldn't be relevant in a better world: it's a lot simpler to talk about the validity of an approval vote. Given that our society has reached the point of people trying to discount first-past-the-post votes based on supposed patterns in when they were counted - it makes me pretty doubtful that we'd handle ranked choice runoffs calmly and logically. That said, people don't talk enough about the benefits of those indirect impacts on coalition-building, so this was neat.

  • @hansonchar
    @hansonchar 2 года назад

    Currently curl 7.75+ supports Sigv4. It would help drive adoption of Sigv4a if curl supports it.

  • @hansonchar
    @hansonchar 2 года назад

    0x1F44D

  • @hansonchar
    @hansonchar 2 года назад

    Is that red phone behind just for decoration? :)

    • @ShuffleSharding
      @ShuffleSharding 2 года назад

      It's how I leave the matrix. It's a working phone!

    • @hansonchar
      @hansonchar 2 года назад

      @@ShuffleSharding 😮

  • @AR-jx1sy
    @AR-jx1sy 2 года назад

    This is fantastic!

  • @paulobu9420
    @paulobu9420 2 года назад

    Hi Colm, 0x9 and 0xA are duplicated btw (both Idempotency). Thanks so much for taking the time to do these videos. They are very instructive at many levels.

  • @vdrozdenko
    @vdrozdenko 2 года назад

    So, why didn't you just remove region information from the hmac hash to make token work across regions? It must have been very expensive to optimize performance for public/private key encryption considering AWS scale

    • @programming.jesus1234
      @programming.jesus1234 Год назад

      Because that isn’t allowed, it is not hard to gen another sig for another region

  • @dennis6947
    @dennis6947 2 года назад

    I had this in my bookmarks when it was on twitch and to my horror it was removed, luckily I found it here so I can finally watch it. Why was it removed from Twitch?

  • @lucasa8710
    @lucasa8710 2 года назад

    Caralho mano, o cara vez o video de bom coração e os cara fica reclamando pqp, q povo chato

  • @lammbo1986
    @lammbo1986 2 года назад

    At 53:07 or so. Is there a bug in the code? You aren't guaranteed to fill the list if the data_size > sample_size. I think you need to fill all the samples, then start sampling using random numbers. This manifests when the sample size is only a bit smaller than the overall data size. Sometimes the sample list doesn't fill up but if data is sufficiently large the chance a sample won't be filled trends towards 0.

    • @HaraldKubota
      @HaraldKubota Год назад

      Yes, I found that too. The fix is easy: until the sample set is full, add items as they come in (as explained in words, but the code does not do that part).

  • @hos7012
    @hos7012 2 года назад

    how to do that with laravel , or php through sdk? there’s no clear ref?

  • @realityos
    @realityos 2 года назад

    Excellent video. Excellent background. :)

  • @ddimasik
    @ddimasik 2 года назад

    nice glasses )

  • @vjmonik4792
    @vjmonik4792 2 года назад

    Is there a way to suppress sound of twitch when a user is joining or posting comment ? The sound is very distracting and sometimes we miss important keywords that you are saying because of that sound. Thanks

  • @abinavviswanathan4367
    @abinavviswanathan4367 2 года назад

    Really great video

  • @colinwhittaker4557
    @colinwhittaker4557 2 года назад

    Loving your work here :)

  • @andrewnester3929
    @andrewnester3929 2 года назад

    That was super informative, thanks a lot!

  • @jinnzhu768
    @jinnzhu768 2 года назад

    Nice lecture! Could you please add all the videos to a series tutorial playlist? Thanks!

  • @poweredbysergey
    @poweredbysergey 2 года назад

    Interesting

  • @poweredbysergey
    @poweredbysergey 2 года назад

    Nice!

  • @poweredbysergey
    @poweredbysergey 2 года назад

    Cool!

  • @microfx
    @microfx 2 года назад

    the noise in the background is annoying ... is that a computer?

    • @CringeBruhovski
      @CringeBruhovski 2 года назад

      Are you really a programmer?

    • @microfx
      @microfx 2 года назад

      @@CringeBruhovski one of the best

  • @DuRoehre90210
    @DuRoehre90210 2 года назад

    Using unsigned variables for plain bool values. What a waste.

    • @jorionedwards
      @jorionedwards 2 года назад

      Unnecessary maybe, but a waste? Explain.

  • @ArgenFenian
    @ArgenFenian 2 года назад

    Loved the content so far. The only issue is that the video quality is 480p so when it gets to the coding section, it's really hard to read the screen, even when you make the font bigger. Other than that, great content. I missed breakfast cause I got hooked on the topic.