Yan Cui
Yan Cui
  • Видео 147
  • Просмотров 193 360
The inception story of Cognito & secret to succeeding at AWS | ft. David Behroozi
Ep #105 of the Real-World Serverless podcast
Thank you to Momento for supporting this episode. Momento's real-time data platform empowers developers to build innovative products faster and more reliably than ever before. Visit gomomento.co/theburningmonk for more information.
David Behroozi, a 15-year Amazon veteran, tells us the inception story of Amazon Cognito and the cheat code for succeeding at AWS.
He also gave us a demo of Speedrun, his latest project since leaving Amazon. It turns your GitHub markdown into executable blocks of code that remember your context (e.g. AWS account and region) so your runbook can be executed right from the markdown.
Links from the episode:
* David's LinkedIn...
Просмотров: 257

Видео

Is this new serverless development framework better than Amplify? | ft. Thomas Nixon
Просмотров 47714 дней назад
Ep #104 of the Real-World Serverless podcast Thank you to Hookdeck for sponsoring this episode. If you're looking to level-up your event-driven architecture, then check out their serverless event gateway at hookdeck.com/theburningmonk and help support this channel. Thomas Nixon, CTO of Baseline, shares stories from the trenches about the challenges of adopting serverless technologies. He gave u...
Community building, being an enabler, is serverless dead? - ft. Allen Helton | Real-World Serverless
Просмотров 161Месяц назад
Ep #103 of the Real-World Serverless podcast Thank you to Hookdeck for sponsoring this episode. If you're looking to level-up your event-driven architecture, then check out their serverless event gateway at hookdeck.com/theburningmonk and help support this channel. Allen Helton on being an enabler, building communities, and is serverless dead? Links from the episode: * Help Olivia's Fight Again...
Event-Driven Architecture: events vs commands
Просмотров 7982 месяца назад
This is a preview lesson from my upcoming workshop, "Production-Ready Serverless". If you liked this, then please check out the full curriculum at productionreadyserverless.com. You can get 15% OFF with the code "RUclips15" during checkout. Hope to see you there! In this video, let's discuss the difference between events and commands and their respective roles within an event-driven architectur...
Domain-Driven Design (DDD): Domain vs. Integration events
Просмотров 1,1 тыс.2 месяца назад
This is a preview lesson from my upcoming workshop, "Production-Ready Serverless". If you liked this, then please check out the full curriculum at productionreadyserverless.com. You can get 15% OFF with the code "RUclips15" during checkout. Hope to see you there! In this video, we will discuss the difference between domain events and integration events in Domain-Driven Design (DDD) and when to ...
EventBridge: should you have centralized event bus or one bus per service?
Просмотров 7542 месяца назад
This is a preview lesson from my upcoming workshop, "Production-Ready Serverless". If you liked this, then please check out the full curriculum at productionreadyserverless.com. You can get 15% OFF with the code "RUclips15" during checkout. Hope to see you there! In this video, we will discuss the pros and cons of the two most popular topologies for arranging event buses in a multi-account setu...
Peek behind the curtains of the AWS Heroes & Community Builders programmes
Просмотров 3762 месяца назад
Ep #102 of the Real-World Serverless podcast Take a peek behind the AWS Heroes and Community Builders programmes with Farrah Campbell, who was a former AWS hero turned AWS employee. Nowadays, Farrah heads up both the AWS Heroes and Community Builders programmes. Links from the episode: * How to become an AWS hero by Danielle Heberling dev.to/aws-heroes/how-to-become-an-aws-hero-10h8 * S3 no lon...
AWS Lite, Web Components, Functionless and WASM with Brian LeRoux
Просмотров 4273 месяца назад
Ep #101 of the Real-World Serverless podcast In this episode, I spoke with Brian LeRoux, co-founder of begin.com and creator of the Architect framework. Brian is also an AWS Serverless Hero and is currently working on enhance.dev, an HTML-first full-stack web framework. In a wide-ranging conversation, we discussed: * the Architect framework * Lambdalith vs. Single-purpose functions * Building a...
LocalStack v3 is here and it's kinda amazing!
Просмотров 2,7 тыс.4 месяца назад
Ep #100 of the Real-World Serverless podcast In this episode, I spoke with Waldemar Hummer, founder and CTO of LocalStack. We discussed what's new in the latest version of LocalStack and highlighted some of the most interesting additions. One particular highlight for me is the ability to identify IAM permission errors between direct service integrations. For example, when an EventBridge pipe ca...
Azure Functions: DEEP DIVE with Microsoft MVP, Ian Griffiths
Просмотров 9234 месяца назад
Ep #99 of the Real-World Serverless podcast In this episode, I spoke with Ian Griffiths, a Technical Fellow at Endjin, a Microsoft MVP, and the author of O'Reilly's Programming C# 10.0. In this episode, we took a deep dive into Azure Functions, how it works and how it differs (significantly) from AWS Lambda. Links from the episode: * Bye bye Azure Functions, hello Azure Container Apps endjin.co...
How does LLRT differ from Bun, Nodejs and Deno?
Просмотров 5474 месяца назад
The new Low Latency Runtime (LLRT) for Lambda is a game-changer. It's designed from the ground up to run in Lambda's constrained execution environment, unlike other JavaScript runtimes. ✅ Recommended playlists: Real-World Serverless podcast on RUclips ruclips.net/video/jxL5Zk12JUE/видео.html My BEST videos of 2023 ruclips.net/video/jxL5Zk12JUE/видео.html 🔔 For more free videos on RUclips, subsc...
How DAZN streams live sports to MILLIONS of concurrent viewers
Просмотров 1,1 тыс.4 месяца назад
Ep #98 of the Real-World Serverless podcast In this episode, I spoke with Bob Hannent, the principal architect of DAZN's video playback and delivery system. This system is responsible for streaming live sporting events to millions of concurrent viewers. We discussed the many challenges that come with streaming live videos at scale. How to ensure uptime even when your CDN partners suffer an outa...
Why is AWS building a JavaScript runtime?
Просмотров 2124 месяца назад
General-purpose runtimes such as Node.js and Bun are not optimal for a constrained execution environment such as Lambda, because they're not designed for these environments. The trade-offs and design decisions they make do not align with the constraints and needs of a Lambda customer. That's why, instead of trying to make the general-purpose runtime fit into Lambda, it's worth asking "what woul...
Why Fathom is running serverless at scale instead of containers
Просмотров 2524 месяца назад
Fathom is running tens of thousands of Lambda concurrent executions at peak. At that scale, it would be cheaper to run them on containers, but the team would need to hire additional skillsets into the company at a great expense, which raises the total cost of ownership (TCO) of the solution. And for Fathom, the total cost of ownership is everything. ✅ Recommended playlists: Real-World Serverles...
What makes LLRT the FASTEST JavaScript runtime for Lambda?
Просмотров 1,6 тыс.5 месяцев назад
Ep #97 of the Real-World Serverless podcast In this episode, I spoke with Richard Davison, the creator of the new LLRT (Low Latency Runtime) for Lambda. We talked about the motivation for a specialised JavaScript runtime for Lambda, how it achieves the insane cold start time and the trade-offs they had to make. Links from the episode: * GitHub repo for LLRT github.com/awslabs/llrt * API compati...
How Fathom saved $100,000 per year on their AWS bill!
Просмотров 1 тыс.5 месяцев назад
How Fathom saved $100,000 per year on their AWS bill!
How Dunelm went from on-prem to serverless while going faster
Просмотров 4915 месяцев назад
How Dunelm went from on-prem to serverless while going faster
AWS Lambda: why you shouldn't built a Lambdalith
Просмотров 4976 месяцев назад
AWS Lambda: why you shouldn't built a Lambdalith
AWS Lambda: optimizations for loading container images
Просмотров 4517 месяцев назад
AWS Lambda: optimizations for loading container images
Serverless Framework v4 with Austen Collins
Просмотров 1,2 тыс.7 месяцев назад
Serverless Framework v4 with Austen Collins
AWS CDK L1, L2 and L3 constructs explained
Просмотров 8357 месяцев назад
AWS CDK L1, L2 and L3 constructs explained
Sam Williams is building AI-powered apps with serverless
Просмотров 5597 месяцев назад
Sam Williams is building AI-powered apps with serverless
Rise of the AI Engineer with Shawn Wang
Просмотров 2 тыс.7 месяцев назад
Rise of the AI Engineer with Shawn Wang
AWS Lambda: TOP 5 cold start mistakes
Просмотров 1,2 тыс.8 месяцев назад
AWS Lambda: TOP 5 cold start mistakes
AWS CDK: problem with creating reusable L3 constructs
Просмотров 4048 месяцев назад
AWS CDK: problem with creating reusable L3 constructs
Father of DevOps on the Future of AI and DevOps
Просмотров 2,2 тыс.8 месяцев назад
Father of DevOps on the Future of AI and DevOps
The Most Costly Serverless Mistakes
Просмотров 1,5 тыс.8 месяцев назад
The Most Costly Serverless Mistakes
The hardest part of CDK, according to an AWS DevTools Hero
Просмотров 5828 месяцев назад
The hardest part of CDK, according to an AWS DevTools Hero
He built a hotel booking system that costs $0.82/month to run
Просмотров 2,3 тыс.8 месяцев назад
He built a hotel booking system that costs $0.82/month to run
How to implement caching for serverless applications
Просмотров 2,6 тыс.8 месяцев назад
How to implement caching for serverless applications

Комментарии

  • @MikeYinger
    @MikeYinger 6 дней назад

    As always, great content. @ 36 mins in, there is a discussion around Amplify (I'd given up on Amplify years ago) and you mentioned Gen2 making Amplify more accessible. Have you found time to see if Gen2 is flexible, like baseline?

  • @TheJohnnySilver
    @TheJohnnySilver 7 дней назад

    The most unexpected thing with CDK is that you are not always getting what you have described in code. For instance, an extra lambda function when you set a retention period.

  • @SocketsGuru
    @SocketsGuru 11 дней назад

    you explained this topic better than aws docs

  • @mdmoniruzzaman703
    @mdmoniruzzaman703 17 дней назад

    What if i have a aws timestream database ingested externally? how can i subscribe any new data inserted to the database?

    • @theburningmonk
      @theburningmonk 17 дней назад

      AFAIK timestream doesn't give you a data change stream that you can subscribe to, so you'd have to create your own. How are you getting the data that you write to Tiemstream? Do you get them as a S3 file?

    • @mdmoniruzzaman703
      @mdmoniruzzaman703 10 дней назад

      @@theburningmonk i have aws iot topic captured by a kinesis data stream. The kinesis data stream trigger a lambda function which is responsible for dumping data into timestream database.

  • @UberEverywhereSKRT
    @UberEverywhereSKRT 18 дней назад

    anything is better than amplify. It sucks and i hate it. love ur vids

    • @theburningmonk
      @theburningmonk 18 дней назад

      Thanks! I've been stung by Amplify CLI too, but I heard gen 2 is much better. I haven't tried it out myself yet, so I will reserve my opinions for now. What would you say were the biggest problems with Amplify CLI?

  • @michaelmenard8614
    @michaelmenard8614 19 дней назад

    a great watch. I am definitely interested in checking this thing out

  • @josherney9820
    @josherney9820 27 дней назад

    Excellent video, thanks for sharing

  • @Kirtjep
    @Kirtjep Месяц назад

    Hi is there a chance to get only Step Function testing module from your course?

  • @MarokoJula-wf6lz
    @MarokoJula-wf6lz Месяц назад

    cheers

  • @suchethkumar8998
    @suchethkumar8998 Месяц назад

    Are Devops engineers going to loose jobs to AI ? Please let me know

  • @william3588
    @william3588 2 месяца назад

    this is great! thanks

  • @ChrisEbertGP
    @ChrisEbertGP 2 месяца назад

    Farrah rocks!

  • @eduponzoni
    @eduponzoni 2 месяца назад

    Nice one, Yan! Succinct, simple language, and straight to the point. Very good. Thanks for recording and sharing!

  • @florianvandillen
    @florianvandillen 2 месяца назад

    Very good explanation!

  • @XStrikeSuper
    @XStrikeSuper 2 месяца назад

    How is Command is different from Lambda Invoke? You can wait for response from lambda invoke

    • @theburningmonk
      @theburningmonk 2 месяца назад

      Conceptually they're different things. Events and commands are used to model your system's behaviour and their interaction, and a Lambda function is used to carry out some business logic in response to an invocation request. In your example, the invocation event might be a "command", if the event carries a message that requests some action to be performed. But Lambda functions can be invoked in response to an event too. Commands often follow a request & response pattern, but not all request & response communications are related to processing commands.

  • @RaulMercado
    @RaulMercado 2 месяца назад

    Thank you for the video, very instructive and clear.

  • @markraven6950
    @markraven6950 2 месяца назад

    awesome content

  • @samwilliams7694
    @samwilliams7694 2 месяца назад

    Having been in the Community Builders for 5 years now, I think it's an incredible program and something that has helped me connect with other people in the space. It's helped me make better content and get insight into features that are in the pipeline. I recommend applying to anyone who creates any kind of content around AWS

  • @johncerpa3782
    @johncerpa3782 2 месяца назад

    Awesome explanation

  • @ADV-IT
    @ADV-IT 2 месяца назад

    Hello AWS Heroes!

  • @mach-7260
    @mach-7260 2 месяца назад

    good information, thanks for this interesting video

  • @kisanpakhreen
    @kisanpakhreen 2 месяца назад

    Farah is an amazing human being. Being an AWS Hero is one of my career goal. Been in community builder program for 4th year now :)

  • @harvenius
    @harvenius 2 месяца назад

    legends

  • @illyam689
    @illyam689 2 месяца назад

    Thanks for this amazing podcast!

  • @lerneninverschiedenenforme7513
    @lerneninverschiedenenforme7513 3 месяца назад

    Feedback: Would be awesome, if the 'next lesson' could be linked in the description.

    • @theburningmonk
      @theburningmonk 3 месяца назад

      This is a preview lessons from my course, the "next lesson" it refers to is part of the course but I haven't released it on RUclips. I've added a link to the full course in the description instead.

  • @lerneninverschiedenenforme7513
    @lerneninverschiedenenforme7513 3 месяца назад

    thank you very much!

  • @BangBang004
    @BangBang004 3 месяца назад

    35:39

  • @khawajashams1639
    @khawajashams1639 3 месяца назад

    This was an incredible podcast. Thank you Yan for driving such an awesome conversation! and Bob for the deep dive behind the scenes at DAZN.

    • @theburningmonk
      @theburningmonk 3 месяца назад

      Thanks Khawaja! It was one of my fav episodes as well

  • @menglin7432
    @menglin7432 3 месяца назад

    A problem I often face is too many limitations, which requires another service to overcome that limitation. Soon, you'll have a porridge of serverless services.

  • @Sholable
    @Sholable 3 месяца назад

    Nice video - but it would be good to go deeper into the types of stacks that use these services.

  • @lorezyra
    @lorezyra 3 месяца назад

    Is there blog/medium page that highlights these best practices?

  • @chrisl8073
    @chrisl8073 3 месяца назад

    Really enjoyed this. Lots of invaluable insights into Azure Functions borne of real-world experience. Particular highlights for me were ~11:55 discussion on the pricing plans, and then at ~18:15 about the nature of scale-out and how this can affect costs; ~40:00 micro-VMs like Firecracker which I had never heard of, and then the challenges of using Azure Functions at ~45:00 including the impact of dependencies on other parts of the Azure platform. Thanks Yan and Ian for a very informative chat.

    • @theburningmonk
      @theburningmonk 3 месяца назад

      Thank you for the summary and glad you enjoyed it!

  • @sathviktumoju1195
    @sathviktumoju1195 3 месяца назад

    Best video on concurrency

  • @tidb1ts
    @tidb1ts 4 месяца назад

    Very cool presentation. LocalStack looks neat for those who are vendor locked. My hot take is, don't get vendor locked in the first place. Choose OSS tech that you can host yourself (and run locally) or that cloud providers offer support for. If you have to use a cloud specific API, use interfaces for adaptability and build software that is oblivious to its implementation.

    • @theburningmonk
      @theburningmonk 4 месяца назад

      For a more nuanced discussion discussion about lock-in, have a watch of Gregor Hohpe's talk about the different dimensions of "lock-in" and understanding the cost of avoiding "lock-in" ruclips.net/video/Ud9h1hJgoKk/видео.html He also has a good article too "Don't get locked up into avoiding lock-in" if you're interested in a different perspective. martinfowler.com/articles/oss-lockin.html

  • @equinozio22
    @equinozio22 4 месяца назад

    Didn’t know it didn’t had a free tier…

    • @theburningmonk
      @theburningmonk 4 месяца назад

      I think you can still use the open source version, right?

  • @danieljohnmorris
    @danieljohnmorris 4 месяца назад

    Thank you for these!

  • @imsarvesh_
    @imsarvesh_ 4 месяца назад

    Hi Yan, Any plans to cover Localstack in your upcoming course?

    • @theburningmonk
      @theburningmonk 4 месяца назад

      I'm thinking of doing it for the Production-Ready Serverless workshop (productionreadyserverless.com/) in May, but it'd be pretty high level though. Because a) I haven't used it much myself, and b) some of the new features like IAM enforcement is only available on the paid plans (there is a 14 day free trial, but that's not enough for the length of the workshop)

  • @MuratKeremOzcan
    @MuratKeremOzcan 4 месяца назад

    Make a course?

    • @theburningmonk
      @theburningmonk 4 месяца назад

      maybe, I haven't used it enough myself though, so might not be the best person to do it

    • @MuratKeremOzcan
      @MuratKeremOzcan 4 месяца назад

      @@theburningmonk noo no, we only trust you to teach this, WTB course

  • @chineduecheruo8872
    @chineduecheruo8872 4 месяца назад

    Thank you

  • @joaopedroafonsocerqueira4586
    @joaopedroafonsocerqueira4586 4 месяца назад

    Well said @BobHannet. Was an amazing project you guys put up to stream DAZN to millions over the last 7-8years :) . And was also great to be part of the side , Data family of it :)

  • @andreadiotallevi5780
    @andreadiotallevi5780 4 месяца назад

    Fascinating interview!

  • @Root-uno6nw
    @Root-uno6nw 4 месяца назад

    Maybe they'll secure their CDN one day.

  • @cyrilgorrieri
    @cyrilgorrieri 4 месяца назад

    What about ECS with Fargate? This is fully serverless as well and completely managed by AWS

    • @theburningmonk
      @theburningmonk 4 месяца назад

      I like Ben Kehoe's definition of serverless being a spectrum: ben11kehoe.medium.com/the-serverless-spectrum-147b02cb2292 with that in mind, Fargate is more serverless than EC2, but not as serverless as Lambda because it doesn't scale to 0 and does not offer usage-based pricing, two of the litmus tests for "fully serverless" services: www.gomomento.com/blog/fighting-off-fake-serverless-bandits-with-the-true-definition-of-serverless That's not to say that Fargate might not be a bad option for Fathom, but it's definitely not as hands-off as Lambda, which is what the Fathom team is looking for from what I gathered.

  • @BobHannent
    @BobHannent 4 месяца назад

    It was good to chat with you Yan!

    • @theburningmonk
      @theburningmonk 4 месяца назад

      Was great to have you on the show, loved the insights into the streaming side of things!

  • @JuliaT522
    @JuliaT522 4 месяца назад

    Thank you it’s nice to have advanced topics like this discussed

    • @theburningmonk
      @theburningmonk 4 месяца назад

      Glad you liked it. It's one of my fav episodes so far as well. There's a lot of really interesting technical challenges that goes into video streaming at scale, it's under-appreciated

  • @systemBuilder
    @systemBuilder 4 месяца назад

    @Bluescape we used step functions to build AMIs hardened for govcloud usage. The first step in the state machine was to check if AWS had published a new AMI to begin with, otherwise quit, and it was nice to see this logic execute as state transitions ... Overall we had about 20 state transitions to build an AMI. So the cost per AMI was $0.005. since our step function ran once per week in 2 environments, overall cost was $0.01 per week or 52c per year ....

  • @gariklaw
    @gariklaw 4 месяца назад

    @theburningmonk Can you please give some concrete examples where cold starts are more spikey and stair-stepped? Just curious for specific use cases here. Thanks!

    • @theburningmonk
      @theburningmonk 4 месяца назад

      It's not that cold starts are more spikey, but when you have sudden spikes in traffic, cold starts is more likely to be a concern. With the introduction of proactive initialization (see aaronstuyvenberg.com/posts/understanding-proactive-initialization) most cold starts will really impact users - e.g. when you do a deployment in the middle of the day, or when existing workers are replaced. But if you have a sudden spike in traffic, then you need more workers to handle the load, so Lambda would need to create new execution environments on-demand, and you'll see lots of cold starts in that moment. An example would be a social network, when a popular user posts something, suddenly everyone logs in and start interacting with the app. You can't plan for these kinds of spikes.

  • @RDarrylR
    @RDarrylR 4 месяца назад

    It’s great hearing about real world use cases running at scale. Thanks!

  • @enriquecordero6163
    @enriquecordero6163 4 месяца назад

    Greetings Yan Cui, I would like to know your opinion on when to use a container instead of a lambda, apart from when the process lasts more than 15 minutes. By the way, eagerly awaiting the launch of productionreadyserverless

    • @theburningmonk
      @theburningmonk 4 месяца назад

      When you either 1) can't use Lambda because - e.g. you need to run for more than 15 mins, or 2) it doesn't make economic sense to use Lambda in TCO terms - e.g. when you have a high throughput API (say, averaging 1000+ RPS) and you have a team that knows how to run containers at scale. The TCO bit is important, because it depends on whether you need to hire additional skillset into your organization. If you do, then that makes massive difference, and that's why Jack said in the video that, it'd only make sense for them to containerize if the cost of Lambda reaches 2-3 full-time devops engineers, because that's probably the minimum you'd need to operate a containerized environment 24/7.

    • @enriquecordero6163
      @enriquecordero6163 4 месяца назад

      Same topic, focused on AppSync: Is an HTTP resolver to a payment API, for example, capable of handling 1000 transactions per second? I purchased your AppSync course and want to implement it where I work.

    • @theburningmonk
      @theburningmonk 4 месяца назад

      Always check the quotas page for the service you want to use. They might not be exhaustive but it's a good starting point. You can do it by googling "<service name> quotas" or go to the "Service Quotas" console in your AWS console. For AppSync specifically, you're looking for this page: docs.aws.amazon.com/general/latest/gr/appsync.html In terms of throughput, you're concerned about the "Rate of request tokens", which roughly translates to 2,000 RPS but that's a soft limit and can be raised. There might be a hard limit somewhere, but it's likely much higher than the 2,000 RPS default limit.

  • @mritunjayshanker8870
    @mritunjayshanker8870 5 месяцев назад

    Which metric show the lambda cold start time....or id there some other configurations

    • @theburningmonk
      @theburningmonk 5 месяцев назад

      The closest approximatation is the initDuration, which is reported in the Lambda REPORT logs, but is not a metric. You can analyze it with CloudWatch Logs Insights. There are also some other time associated with downloading the artefact, and allocating a space in the fleet. But those are outside of your control, so it's best to focus on the initDuration, which is how long does it take to initialize the execution environment on a worker instance.