Day-18 | AWS Cost Optimization | Most Popular Cloud and DevOps project| Event Driven Serverless
HTML-код
- Опубликовано: 26 авг 2024
- Support my work
www.buymeacoff... Hi Everyone, My Name is Abhishek and my channel is focused on delivering Free content on DevOps and Cloud. Follow my channel for practical learning of DevOps and Cloud. Don't miss the FREE DEVOPS COURSE in Playlists.
In this video, We will learn how to implement the cost optimization project on AWS using lambda functions and event driven serverless architecture.
Private Telegram Channel For Doubts Clearing
www.youtube.co...
Instagram: / abhishekveeramalla_off...
GitHub Repo for this video
github.com/iam...
Book 1:1 with me on TopMate for career guidance
topmate.io/abh...
Public Telegram Channel For Notes and Updates
t.me/abhishekv...
About me:
========
LinkedIn: / abhishek-veeramalla-77...
GitHub: github.com/iam...
Medium: / abhishekveeramalla-av
#devops #futureofdevops #kubernetes #sre #aws #azure
DEVOPS FAQ
DEVOPS
WHAT IS DEVOPS ?
WHY DEVOPS ?
HOW TO LEARN DEVOPS ?
LEARN DEVOPS IN 60 DAYS ?
NON IT TO IT BACKGROUND ?
IS DEVOPS EASY TO LEARN ?
BEST DEVOPS COURSE
FREE DEVOPS COURSE
#AbhishekVeeramalla
BEST DEVOPS VIDEOS
DEVOPS INTERVIEW QUESTIONS
EASY DEVOPS VIDEOS
BEST WAY TO LEARN DEVOPS
PYTHON FOR DEVOPS
PYTHON PROJECTS FOR DEVOPS
LEARN PYTHON
PYTHON PROJECTS FOR AWS
AWS PYTHON PROJECTS
AWS LAMBDA FUNCTIONS
WHAT IS GITOPS ?
WHY GITOPS ?
LEARN GITOPS ?
GITOPS FREE COURSE
What is AWS ?
LEARN AWS FOR FREE
AWS COURSE
AWS COURSE FOR DEVOPS
AWS CLI Deep Dive .
.
Disclaimer: Unauthorized copying, reproduction, or distribution of this video content, in whole or in part, is strictly prohibited. Any attempt to upload, share, or use this content for commercial or non-commercial purposes without explicit permission from the owner will be subject to legal action. All rights reserved.
Thanks!
Thanks alot for supporting the channel
00:07 Cloud cost optimization
05:46 Stale resources on AWS can lead to higher cloud costs
11:35 Create a Lambda function to delete unused EBS volume snapshots
17:38 A Lambda function is used to delete snapshots that are not associated with any volume.
23:21 Increase default invocation time for Lambda to 10 seconds
28:59 Learn how to manage cloud cost optimization in AWS accounts
34:47 Demonstration of creating and deleting snapshots
40:01 Lambda functions can be scheduled to run automatically using CloudWatch events.
Wonderful person
Wonderful attitude
Wonderful teaching
The world needs more people like you
I'm not exaggerating
God bless you 🙏
Thanks alot
Thank You Sir.
Requesting you not to delete any course of yours as they are going to be helpful to recall everything watching your videos in future.
Huge respect to you Sir.
😍
Thank you so much Abhishek for AWS Cost Optimaization demo......I was working on AWS Cost Optimaization from 1-1.5 years but this approach is very efficient / time saver / chances of making mistakes are very less and able to save AWS resources cost drastically.
Thanks again🙏 and waiting for another such content🤩🤩🤩
You are welcome 🤗
Each and every word in the python script understood how it is going to fetch the running instances , after fetching it will check for snapshot. If that snapshot doesn't belong to any running instances or EBS, directly delete it. After deleting, again using try block once again checks the volume of snapshot if it is present or not. Really impressed with the code Abhi Bro
Ur explanation and execution is on point, very simple and engaging. Thanks for contributing your knowledge to the Devops community and the fellow Learners.
Thanks bro
I just came across your shot video on zero to hero aws,wanted to watch all the previous videos and want to practice too
Subscribed to your channel,Thanks
Amazing
This is the concept which i was asked in the multiple interviews and i just said i haven't worked on it and we look for instance utilizes alone something like that
Thanks for the explanations 😮😊
😍🚀
We can apply the same for s3 as well right
Wow what a quick response 🎉
Excellent explanation in simple way from beginner point of view with detail step by step information. Waiting for such type of real time projects which can be added to resume for fresher & experienced one. Completed hands on from day 1 to day 18. Thanks a lot.
Amazing
bro your content is really good many paid courses fail to deliver this type of content
Hi Abhishek, Well-explained in a friendly manner that is easily to grasp the logic, you showed here. Thankyou so much.
Thanks a lot
Implemented the cost optimization demo Abhishek it was good getting errors and rectifying those and setting up the policies with ec2 and snapshots and creating ec2 from volume creating snapshot with the help of your code I was able to implement removing stale snapshot which is not associated to the volume " This is the final response Deleted EBS snapshot snap-0c443b848464 as its associated volume was not found." Thanks a bunch Abhishek.
🚀🚀
Awesome project brother, I did it and gained insights about CloudWatch and Lambda Function!
Great to hear!
Excellent information, Sir kindly make more videos explaining the concepts and applications of Terraform in AWS in details and how to configure AWS NETWORKING Networking with details steps explained
Noted
best youtube channel for devops. i am developer and enjoy your teaching keep it up bro
For some reason I didn’t find the describe volume permission before and when tried to run the lambda test it didn’t give any errors about it - but when I finally found it and added it it worked like magic thank you very much !
Absolutely detailed and crystal clear! Thanks, Abhishek! You're a maestro!!!!!
My pleasure 😊
This is super useful! Thank you Abhishek :)
Words are less to express my gratitude 🥰
Thank you so much 😀
Very helpful video . Thank you Abhishek for sharing the knowledge with clear explanations of the concepts along with a neat demo . Well done and keep up such good work !
My pleasure
Thank you for bringing a such cool Projects.❤
😍
It is a wonderful project. Thank you very much.
Demo performed and executed as you have done and got the exact .. output..Thanks sir for the wonderful explanation and teaching and demos as well❤
Thanks anna.. Performed the demo.. everything worked and learned all good stuff. Thank you
You are welcome
Hi Abhishek, hope you are doing well. You are closer to the completion of AWS course. I would like to request you to please announce the Azure 30 day course ASAP. Thank you 🙏
🥳
successfully implemented the project and also integrated with sns
done
Amazing Video🔥
Just one word Awesome!!!! Felt very happy after understanding the concept and able to successfully execute it without looking into the code....Kudos Abhishek
Kudo to you 🚀
I appreciate all your helpful information. I would like you to please make a video explaining how to set up a production grade eks cluster with the help of other services...it must have high security. We know how to set up eks clusters, but do not know the best practices.
I made video couple of days back about kubernetes security and same applies for eks as well
So simple language , easy to understand . Thank u so much 😊
You are welcome 😊
Thanks Abhishek for the best explanation on cost optimisation and lambda functions...i have no words to thank you.....and thanks for this good work as you are providing this top notch content for free ....thanks a lot bro❤
Thanks Abhishek Sir. Keep teaching like this but you deserve more subscribers.
Thanks abhishek successfully executed and understood everything crystal clear👍🙂
Thanks for this tutorial 👍....One Request After this aws series If its possible for you then please start a Open-shift tutorial and mainly Python tutorial with practical implementations for devops ...
I will take a note
Awesome explanation for cost optimization
Thanks a lot
Most welcome!
thanks bro.....and please make a vido on how to create multi master eks production cluster with high security
Please watch videos that I posted a couple of days back of kubernetes security.. it applies for eks as well
thanks lot for helping in learning aws lambda function topics
All the best
Thank you Abhishek sir for such content nice and briefly explain the lambda function and project thank you again
It's my pleasure
Gained lot of knowledge by this video thank you sir :)
Most welcome!
Hi Abhishek, Thanks for such wonderful videos and series. Your teaching skills are awesome. Can you please make video on AWS CDK also?
Sure
thanks for giving wonderfull session for cost optimization.
Thanks, Abhi
Welcome
thank u so much abhishek sir for sharing the knowledge
Thank you for providing such an informative session and creating these helpful videos. Do you plan to cover topics related to determining the overall cost of resources before building anything on AWS?
Noted
Wonderful project 👏
Thanks
You will soon touch 100K Subscribers. Advanced Congratulations Abhishek Sir
Thanks 🙏
abhishek I get the concept but what I am worried about is the code, like how will i be able to write the code of other kinds of scenarios. What can be the solution here?
We are doing python playlist
Brother best explanation. We stopped at event bridge scheduler, how we will explain this step in Interview. I want to know it looks critical since aws is event driven function. Please continue on aws lambda in some other project.
Hey, its very simple, just select the required API action (for example when EBS is created) and Cloud watch will trigger the lambda function you provided whenever the EBS is created. That's it.
Thanks for the video anna i will add this into resume
Superb teaching
welcome
Cost optimization
People move to cloud because
1. Overhead of infrastructure
2. Cost of infrastructure management
Cloud cost is down only if you use it efficiently.
Taking snapshot of volume means taking backup of volume.
Even after deleting ec2, and volume aws will keep charging for snapshot of volume.
The resources you have forgotten and are being charged are called stale resources.
Cloud cost will go high.
So we as devops engineer have to look for stale resources. Eg, Snapshot that are not attached to ec2 or any volume, send notification or delete the snapshot
Great!!
please make a complete video on prometheus architecture including jobs, exporter ,all metric type and one project on that only .It will be very helpful as i can't see any complete video on that in youtube also
Noted
Sir after completion of AWS, we need Azure masterclass because company is demanding knowledge of Microsoft Azure nowadays.
I will try
Well explained
Please make an video for AWS KMS
Yes
It took me 3 daays to realize that you have to create the policies in the policies tab on the left-side of the iam dashboard in order to attach the policy to the role lol
Haha
Successfully completed the demo.
Thank you
Welcome
Love you Abhi...my best bro !!!
😍
To good explanation sir
Thanks and welcome
Thanks man. such a fantastic help. God bless you.
Welcome
Project is filtering and deleting the stale resources.
We will use lambda function to write python code. By using module boto3.
Boto3 will talk to aws API and give information about stale ebs snapshots.
Since lambda function is event written you can trigger it using cloud watch.
Thanks for the video! ✨
You're so welcome!
@@AbhishekVeeramalla Also, please make a video on AWS Solutions Architect Certification. And how to prepare for it!
completed..!
Videos are great! Could you kindly make same zero. To hero series for sre role
Bundle of thanks for such content. Can we schedule the script to run only once a month?
Yes
I wait today video ❤
Thanks 🙏
@@AbhishekVeeramalla Please sir I have been on the ultimate cicd implementation with argo cd but the pipeline always failed at the stage of building the docker image. it is giving me "docker command not found " although I have docker up and running and also I have created the credentials to let jenkins connect to my dockerhub registry. Please could you guide me?
Hi can you please make vdo on AWS console-to-code ( New feature )
Thank you.
Welcome 🙏
Abhishek in industry we take snapshots either manually or by some script for backup, how can we incorporate the same in this project where it will delete or note only the snapshots which has been taken manually only..
Hi @abhishek how we perform health check in ec2 instances can you share info here
Ok sure
Once we will add the Cloudwatch schedule. We will be notified or something like that?
U need to add sns
Anna, please SNS integrate chesi chupinchandi asalki ardham avvateldh nenu chala sarlu try chesa
Thank You !
You're welcome!
Thank You ❤
what the architecture role in cost optimization ? can you give me some insight of how the architecture involved
Thank you 😍
My pleasure 😊
very well explain
Thanks
hi abhishek, can i put this COST OPTIMIZATION project in my resume, even if i don't know python as a language.????
😶😶
Yes, you can
sir am a aws and devOps engineer who does't know the phython, any video i can learn phython easily.
is it neccessary for aws and devOps engineer to learn the python ??
Sir can you make BillOps poc and put video
thank you
Thank you so much 😀
But sir when organization has minimum snapshot
In this case they can delete it manually.
.....
Abhishek can do this project using root user
Super Content...So useful.....Thanks Dude..
Dude, How much python learn need for Devops????
Watch day 1 in python playlist .. I explained in detail
Love From Pakistan
👍
1st Like❤
Thanks 🙏
Tq
snapshot life time with in 30 days?
❤❤❤
Thanks 🙏
Bro any fresher recruitment for AWS devops PLEASE SHARE
Sure
@abhishek Could you please send me the python code am not able to find in above github repo
Thank you🙏
Welcome
thankyu helpfl
Hi Abhishek quick question why have you created role which has ec2 as principal and given snapshot read write access to it , I thought you keeping lambda as principle and given it snapshot read delete policy to it will work
because snapshot is a feature of ec2 not lambda
Hi Abhishek, Suppose there are so many resources which we want to remove which is going to take more than 15 min (max execution time for lambda) then will lambda will scale out for more container to finish that job in max time or it will just fail as timeout , pls clarify
You can split your code and invoke other lambda function from this one
But better to keep your execution time short by writing effective code .. if its not an option your split the code and invoke another lambda
Sir followed as you did, but The Snapshot was not deleted, when i run the test there is no error, it just shows staty id, request id. No message of snap shot deleted. What might be the issue.
did you check the volume from which you take snapshot is attached to any instance?
@@dilligpay4 yes
@dhanushgowda7593 You probably have missed adding DescribeVolumes or DeleteSnapshots permission to the role and you cannot see the error due to the usage of try/except in the script. You can see the exact error by removing those two lines (29 and 34) and then executing the function.
Does devops engineer need to write coding in python
thanks bro. I tried with this hands-on but shapshit isnt getting deleted.wht can be the problem
Check the cloud watch logs
Want know benifits of taking membership
there is a telegram group where you can ask questions but it is more of a support to the channel.
I joined u r telegram group
But in that no access to chat