Using Amazon MSK as an event source for AWS Lambda

In this video, let's discuss how to set up a test Amazon MSK cluster and configure key elements in the networking configuration so that the set-up can invoke a Lambda function whenever messages are getting published in a particular topic.
Prerequisite:
-----------------------------
Learn AWS VPC , Subnet , Route Table, Internet Gateway with Hands-on Demo
• Learn AWS VPC , Subnet...
VPC with Public and Private Subnets in-depth intuition with Hands On
• VPC with Public and Pr...
AWS VPC NAT Gateway In-depth intuition
• AWS VPC NAT Gateway In...
AWS VPC ENDPOINT in depth intuition & hands on
• AWS VPC ENDPOINT in de...
Using Amazon VPC Endpoints to Access DynamoDB in-depth
• Using Amazon VPC Endpo...
Getting Started with AWS Managed Streaming for Kafka with in-depth service setup
• Getting Started with A...
Creating a Serverless Apache Kafka(MSK) publisher using AWS Lambda
• Creating a Serverless ...
Documentation Reference:
------------------------------------------------
docs.aws.amazo...
Steps for the Lab:
-------------------------------
github.com/Sat...
Check this playlist for more Data Engineering related videos:
• Demystifying Data Engi...
Apache Kafka form scratch
• Apache Kafka for Pytho...
Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
doc.clickup.co...
🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY RUclips CHANNEL

[@KnowledgeAmplifier1]

Don't forge to hit the LIKE button if the video helps , took me 2 weeks to make this! Thanks for watching 😊

[@venkatasharma]

great explanation

[@ImranNazir-of1on]

Much needed video
Thanks for sharing

[@KnowledgeAmplifier1]

You are welcome Imran Nazir! Happy Learning

[@MrMadmaggot]

Shouldn't you create 2 nat gateways? Or with only one NAT, which is tied to a PRIVTE ROUTE TABLE that is attached to the two private subnets is enough, after all both subnets share the same LOCAL IP (which is the VPC's IP)?

[@PoojaGupta-bi1kw]

I'm new to AWS. I've a requirement to create an springboot producer app which connects with MSK and produces the data, could you help me with cluster config and sprinboot app configs in this case?

[@mounikakrishna277]

What if the msk is in the same public subnet and same vpc as the lambda, Do we still need to create a nat gateway?

[@carlpei6570]

🔥🔥⚡

[@satwikkumar-eq6fm]

How to connect to private ec2 instance inside of a public ec2 instance for Mac?

[@ManishJindalmanisism]

Hi.. in this why have not we put lambda in a VPC? Was that intentional?

[@KnowledgeAmplifier1]

Hello Manish Jindal, it is optional , not necessary ...

[@venkatasharma]

how to send messages to SQS from lambda. Could you please explain