Grafana Loki for Beginners | Grafana Loki and Promtail | Log Aggregation and Visualization
HTML-код
- Опубликовано: 9 июн 2024
- Learn More Here: www.itpanther.com/blogs/
Buy my grafana courses on Udemy at a special price for a limited time:
www.itpanther.com/prometheus-...
www.itpanther.com/grafana
Grafana Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate, as it does not index the contents of the logs, but rather a set of labels for each log stream. Grafana Loki can be used to search, analyze, and alert on logs. It can also be used in conjunction with Grafana, a popular open-source data visualization tool, to create dashboards and visualizations of log data.
Promtail (short for "Prometheus Log Tail") is a daemon that reads log files and sends the log data to a Loki instance. It is designed to work in conjunction with Grafana Loki to provide a log aggregation and analysis solution. Promtail runs on each node in a cluster and reads log files, extracting relevant metadata (such as labels) and sending the log data to a Loki instance. It can automatically discover new log files and can be configured to handle logs from various sources, such as Docker containers, Kubernetes pods, and system logs. This allows for a more efficient and centralized log management system.
Timeline
00:00 Grafana Loki Introduction
01:50 Grafana Loki Architecture
02:50 Grafana Loki and Promtail Installation
05:35 Understanding Promtail Configuration File
09:52 Configuring Loki data source in Grafana
Buy my Udemy courses at a special price for a limited time:
✅ www.itpanther.com/prometheus-...
✅ www.itpanther.com/grafana
✅ www.itpanther.com/python
✅ www.itpanther.com/liferay
✅ www.itpanther.com/apachenifia...
✅ www.itpanther.com/apachenifi
✅ www.itpanther.com/redis
🤝 For collaboration or other inquiries connect
📧 Email: learnwithvikasjha@gmail.com
📞 Whatsapp: +917042103414
Connect on Social Media:
LinkedIn: / vikasjha001
Twitter: / vikasjha001
Instagram: / vikasjha001
🚀 Enjoying our tech videos? Help us raise a virtual toast! 🍻
If you've found our tech insights, tutorials, and reviews valuable, consider supporting us by buying us a virtual beer. Your contribution helps us continue creating quality content, investing in better equipment, and exploring even more exciting tech topics.
🍻 Your support means the world to us! Every "beer" brings us closer to creating more engaging, informative, and fun tech content for you.
🍺 www.buymeacoffee.com/learnwit... 🍺
Thank you for being a part of our tech community. Together, we can make technology more accessible and enjoyable for everyone!
Stay tuned for more tech adventures! 📱💻🎮 - Наука
You can connect to me on LinkedIn if you have any query: www.linkedin.com/in/vikasjha001/
Join Grafana Group on Telegram: t.me/GrafanaGlobal
My most precious takeaway from this guide is vim ZZ shortcut, thank you very much!
Great one Vikas! It's very helpful. Keep making more videos on Grafana !!
Glad it helped.
Amazing insight. Thanks a Ton!
Glad it helped !
Hi Vikas, thank you so much for this video, would like to ask if you can make another one with Promtail installed via Helm? Apparently, installation via Docker is only advisable for testing and development purposes. Thanks
Sure, I will post.
HI, i have a quey. when u click on the log that is returned after selecting the label there are detected fields. I am not getting anything like that the only fields i am getting is host, job and filename. how can i get extra labels?
Hello, is there any tutorial on how to install promtail on multiple servers, means receive the logs for multiple machines, because on my end it works only on one machine.
Hello Vikas, Can you please solve my issue I have install loki on local system and promtail and the application on VM. I have configured loki and promtail to scrape application log. In the same grafana dashboard the query is not returning any logs and stats. but when I run the same query in query Explorer-> live mode the query is returning logs.
Thanks you Vikas, It helped me to understand more basics of query formation and other things as well, but will you be making details videos to make complex queries or making dashboard by using those query ?
Sure, I will make other videos if there are interest from viewers.
sir if i will to alert logs and i have the situation log of ssh? Why i have to many problem
you are the best man I have performed video perfectlayy
Great bhai, do subscribe for more.
Helpfull. Thanks a lot.
Glad it helped brother and thanks for sharing the feedback.
Hi Vikas. have just started learning about Grafana and I have a query. If we need a graph or any chart which grafana doesn't offer(out of box), is there a way to write custom code for same (in angular/react) ?
Grafana is fully opensource and you can develop as many custom component as you want.
Hi vikas, Can you make video on how to download the logs with time frame and tar file download using API with any code like golang etc!!
Thank you so much...
You are welcome.
Hey hi, actually im using xk6 for send logs to loki, is it possible to send our own messages to loki like " This is loki test by chandru" Message
How to store Grafana Loki logs in Azure Blob Storage
Thanks you Vikas for your all videos ,I am trying to make a dashboard for windows event logs,not able to find any way to make it ,pls help me on this.
Use Grafana Loki bro.
how to download logs from grafana-loki
how to Install a Second Promtail Service?
Can we change this default port 3000 to any other because I'm already using it in one of my applications
Yes, you can change it, while running container just provide different port.
Absolutely useless, I followed all the steps but Grafana will not connect to Loki... it just wont and if I try to open localhost:3100 it brings back an error 404, even though /metrics brings all those metrics.
Hi - I have this config running on my monitoring server and want to scrape the config from Mr production server. I have put the IP and port of my production server in the promtail-config
But It looks like it is still only returning my monitoring server logs.
I have node_exporter running on port 9100 on my production server. I am using aws and for now my security groups are open on the relevant ports to allow my monitoring server to talk to my production server.
What configs do I need to change?
Have you installed promtail on the production server?
@@VikasJha001 no, what promtail do I need? I don’t need a promtail config do I?
@@ihenners_ you need to install promtail software on all the servers which you want to monitor.
@@VikasJha001 thanks. And I do not need promtail on the monitoring server correct?
@@ihenners_ you will need it on the monitoring server as well if you want to check logs or monitor the monitoring server as well.
If you dont want to monitor the monitoring server then just install promtail on rest of the servers which you want to monitorband visualize with Grafana.
do more videos, oki?
Okey