Send records to Kinesis using AWS Lambda

In this video we will learn how you how to write a lambda function which can produce messages to a Kinesis data stream. I’ll also explain some important aspects of Kinesis that you need to think about when you are coding your Kinesis producer applications.
Timestamps:
- Intro: 0:00​
- Thank you!: 1:29
- More intro: 2:23
- Write Lambda function: 3:04
- Time for testing: 6:15
Code example: github.com/endre-synnes/pytho...
JSON object: github.com/endre-synnes/pytho...
Subscribe button animation: touchtechnologyreview.com/sub...
Follow me on Github: github.com/endre-synnes

[@leonvan445]

Very helpful, thanks Endre. Can you please do an example with put record batch demo?

[@EndreSynnes]

Thank you 😄 yes, I will look into it. This is a very useful feature for sure 🙌🏼

[@xuesongli7255]

Nice video, thanks! How many shards do you have in your Kinesis data stream? Do you have to define the shard amount?

[@EndreSynnes]

Thank you! 😄
I make use of the Kinesis Data Stream created in this video: ruclips.net/video/Obwuug7dUSE/видео.html.
It's of type on-demand, meaning I don't specify the number of shards. By taking a look at the AWS documentation (aws.amazon.com/blogs/aws/amazon-kinesis-data-streams-on-demand-stream-data-at-scale-without-managing-capacity/), I can see that a Kinesis Data Stream created using on-demand mode, is created with a default capacity of 4 MB/s and 4,000 records per second for writes. If this can be directly translated to "provisioned mode", it seems to be 4 shards. Keep in mind this will change depending on your usage 😄.

[@amugill6599]

Very helpful and well-explained. Thanks! Can you please show how to create data in a Kinesis stream that can be
copied to the DynamoDB database.

[@EndreSynnes]

Thank you!😄
Yes I will look into it and see if I can make a video about that!😊

[@victoriabressan4557]

Hello! I would need a similar solution but sending the objects directly to kinesis firehose.

[@EndreSynnes]

Hi 😊
Just to make sure I understand correctly, you mean like sending records directly from another source than a Lambda function? For example directly from an API Gateway like this: docs.aws.amazon.com/apigateway/latest/developerguide/integrating-api-with-aws-services-kinesis.html