AWS - CloudWatch Logs
HTML-код
- Опубликовано: 29 июн 2024
- How to stream Application logs from EC2 instance to CloudWatch and create an Alarm based on certain string pattern in the logs.
Useful contents:
1. IAM Policy
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"logs:CreateLogGroup",
"logs:CreateLogStream",
"logs:PutLogEvents",
"logs:DescribeLogStreams"
],
"Resource": [
"arn:aws:logs:*:*:*"
]
}
]
}
2. awslogs.conf file contents:
[general]
state_file = /var/lib/awslogs/agent-state
[application_logs]
region = ap-south-1
datetime_format = %b %d %H:%M:%S
file = /var/log/application.log
buffer_duration = 5000
log_stream_name = {instance_id}
initial_position = start_of_file
log_group_name = application_logs
If you like this video, you can get more content from me at www.awswithchetan.com/courses...
Hope you like it.
Happy learning !
~Chetan
Email: awswithchetan@gmail.com
Email: awswithchetan@gmail.com 
Наука
Mr Chetan Agarwal.. You are such an Awesome Trainer.. I am watching all your videos and I so impressed with your knowledge and the way u train.. it is going to mind so easily.. Keep it up.. You are the Best Trainer I have seen in my life..along with one more my earlier Boss..
Very helpful, Chetan. I love how you get right into the demo. Keep up the great work!
Loved your way of teaching. even paid courses don't give such clarity. 🙌
Thanks Buddy for giving such wonderful lectures with so clarity. The people like you who shares their knowledge with we learners selflessly are like Gods for us. Thanks a lot from bottom of my heart. Please continue like this. God bless you always.😊
Thanks a lot Pankaj .. m staring a day with such a positive comment 😊
Thank you even I have tried this and was looking for alternatives but i guess this is the best way. Also you have explained it perfectly 👍
Great explanation & video. Keep posting with new videos to cover all the required topics for SSA-02. Cheers🙌🏻
Will you please help me?
How can I put my logs (from frontend ) in Cloudwatch
Really amazing tutorial. You are the best. I needed content like this.
Great explanation! Very straight forward
Very good information, precise. Thanks for sharing.
Thank you. Very good info for beginners.
thank you, it save my time
Thanks for giving such wonderful lectures with so clarity. Can we add more log file from same ec2 with different log_stream_name in same log_group_name
Great content! Thank you so much
Thank you for awesome tutorial
Thanks, nice explanation
Great job!!
YOU ARE AMAZING
Good one. thanks!
Lazy question time. You speak of the Log agent. I believe there is a unified cloudwatch agent now. are the configuration details the same? Possibly update video to reflect?
Hello sir, how can we make sure Instance ID is printed on the email alert? I have created similar Alarms to check the status of several ssm agents (ssmagent log) but instance id is not getting printed on the email body.
I want to know if in email alert is it possible to get the events or logs or packets on specific conditions?
Thanks for sharing
If I have another EC2 machine streaming log to the same log group but with a different log stream and there is an error message detected will this trigger the alarm. In short, the metric is limited to the log stream or the log group?
Thanku for this one.. but I want if service will be down and the logs will not be generated in that case mail alert should be triggered. Can you please help me..??
Hey bro, how did you delete the contents of the configuration files?
How to do the same for aws cloudwatch logs insight queries ??
can we collect the filenames that are being processed in logs so that files names can send through alarm
Where can i find your aws all video...Please let me know
Thanks, btw how do the alarm work? Will it check the string all over again any time or will it only check the new string added in the application.log? I imagine if it check all string from the beginning it will be create alarm all the time, right? Please kindly englight me.
Hi Wase, it would be based on alarm period parameters. Typically its last 5 mins or say 10 mins. It will check only those logs which were received in given period.
Thank you
Anyone know how to send log from frontend !!!! And log them on Cloudwatch
thank you
For window machines, how we can do....
Hi, Thanks for the video. I have created alarm to trigger for every 5 minutes to send email alert for errors. But it only triggered in the first 5 minutes. After that i didn't get any notification whole day even though there are errors in the log file. Any reason?
Actually it depends on state change. By default alarm will be triggered when the state changes from normal to alarm state. If its already in alarm state it won’t send new notification. However you can change this setting and configure to send notification everytime the alarm state is detected.
We already have cloudwatch role .Why you have created new policy can you please explain.
Can anyone know what is the cost estimation for this "Metric Filter" ? @chetan Agarwal
thank you for this amazing video but i have one question like i want to set an alarm if in cloud watch it finds "false false". means if there are two false words in one line, how can I send an alarm for this?
please help me in this as soon as possible
Should be possible with CloudWatch logs filter and patterns. Just google and you should be able to understand various filter and patterns you can apply.
What if we need to collect logs from multiple ec2 replicated instances
Did not understand what do you mean by replicated instances? Otherwise process should remain same for every ec2 instance.
Hi, I am migrating the data from on premise to RDS, all process is done, and i have started the data migration task, but it is failing. how can i generate the logs that why it is failing?
aws.amazon.com/premiumsupport/knowledge-center/manage-cloudwatch-logs-dms/
Sir am not able to download awslogs in ubuntu while using the command " sudo apt-get install -y awslogs" what is the problem
did you google it?
is there ia any option to trigger a mail about ec2 server which is not logged in for a month?
You may have to collect the ssh logs and create cw alarm if no new logs from one month. There could be other better ways but need to check.