Grafana Loki for Beginners | Grafana Loki and Promtail | Log Aggregation and Visualization

Поделиться
HTML-код
  • Опубликовано: 9 июн 2024
  • Learn More Here: www.itpanther.com/blogs/
    Buy my grafana courses on Udemy at a special price for a limited time:
    www.itpanther.com/prometheus-...
    www.itpanther.com/grafana
    Grafana Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate, as it does not index the contents of the logs, but rather a set of labels for each log stream. Grafana Loki can be used to search, analyze, and alert on logs. It can also be used in conjunction with Grafana, a popular open-source data visualization tool, to create dashboards and visualizations of log data.
    Promtail (short for "Prometheus Log Tail") is a daemon that reads log files and sends the log data to a Loki instance. It is designed to work in conjunction with Grafana Loki to provide a log aggregation and analysis solution. Promtail runs on each node in a cluster and reads log files, extracting relevant metadata (such as labels) and sending the log data to a Loki instance. It can automatically discover new log files and can be configured to handle logs from various sources, such as Docker containers, Kubernetes pods, and system logs. This allows for a more efficient and centralized log management system.
    Timeline
    00:00 Grafana Loki Introduction
    01:50 Grafana Loki Architecture
    02:50 Grafana Loki and Promtail Installation
    05:35 Understanding Promtail Configuration File
    09:52 Configuring Loki data source in Grafana
    Buy my Udemy courses at a special price for a limited time:
    ✅ www.itpanther.com/prometheus-...
    ✅ www.itpanther.com/grafana
    ✅ www.itpanther.com/python
    ✅ www.itpanther.com/liferay
    ✅ www.itpanther.com/apachenifia...
    ✅ www.itpanther.com/apachenifi
    ✅ www.itpanther.com/redis
    🤝 For collaboration or other inquiries connect
    📧 Email: learnwithvikasjha@gmail.com
    📞 Whatsapp: +917042103414
    Connect on Social Media:
    LinkedIn: / vikasjha001
    Twitter: / vikasjha001
    Instagram: / vikasjha001
    🚀 Enjoying our tech videos? Help us raise a virtual toast! 🍻
    If you've found our tech insights, tutorials, and reviews valuable, consider supporting us by buying us a virtual beer. Your contribution helps us continue creating quality content, investing in better equipment, and exploring even more exciting tech topics.
    🍻 Your support means the world to us! Every "beer" brings us closer to creating more engaging, informative, and fun tech content for you.
    🍺 www.buymeacoffee.com/learnwit... 🍺
    Thank you for being a part of our tech community. Together, we can make technology more accessible and enjoyable for everyone!
    Stay tuned for more tech adventures! 📱💻🎮
  • НаукаНаука

Комментарии • 42

  • @VikasJha001
    @VikasJha001  Год назад

    You can connect to me on LinkedIn if you have any query: www.linkedin.com/in/vikasjha001/
    Join Grafana Group on Telegram: t.me/GrafanaGlobal

  • @legooos
    @legooos 11 месяцев назад +1

    My most precious takeaway from this guide is vim ZZ shortcut, thank you very much!

  • @architbidkar
    @architbidkar Год назад +1

    Great one Vikas! It's very helpful. Keep making more videos on Grafana !!

  • @MuhammadMahirQ8
    @MuhammadMahirQ8 11 месяцев назад +1

    Amazing insight. Thanks a Ton!

  • @carmilocabigon6233
    @carmilocabigon6233 Год назад +2

    Hi Vikas, thank you so much for this video, would like to ask if you can make another one with Promtail installed via Helm? Apparently, installation via Docker is only advisable for testing and development purposes. Thanks

  • @neelamzanvar9525
    @neelamzanvar9525 9 месяцев назад

    HI, i have a quey. when u click on the log that is returned after selecting the label there are detected fields. I am not getting anything like that the only fields i am getting is host, job and filename. how can i get extra labels?

  • @mirraneabdelhadi8785
    @mirraneabdelhadi8785 Год назад +1

    Hello, is there any tutorial on how to install promtail on multiple servers, means receive the logs for multiple machines, because on my end it works only on one machine.

  • @balakumar1906
    @balakumar1906 Год назад

    Hello Vikas, Can you please solve my issue I have install loki on local system and promtail and the application on VM. I have configured loki and promtail to scrape application log. In the same grafana dashboard the query is not returning any logs and stats. but when I run the same query in query Explorer-> live mode the query is returning logs.

  • @parikshitsharma1878
    @parikshitsharma1878 Год назад +1

    Thanks you Vikas, It helped me to understand more basics of query formation and other things as well, but will you be making details videos to make complex queries or making dashboard by using those query ?

    • @VikasJha001
      @VikasJha001  Год назад +1

      Sure, I will make other videos if there are interest from viewers.

  • @muhammadadityamadjid8024
    @muhammadadityamadjid8024 7 месяцев назад

    sir if i will to alert logs and i have the situation log of ssh? Why i have to many problem

  • @gujaratiincanada2464
    @gujaratiincanada2464 7 месяцев назад +1

    you are the best man I have performed video perfectlayy

    • @VikasJha001
      @VikasJha001  7 месяцев назад

      Great bhai, do subscribe for more.

  • @rajesh_singha7
    @rajesh_singha7 5 месяцев назад +1

    Helpfull. Thanks a lot.

    • @VikasJha001
      @VikasJha001  5 месяцев назад

      Glad it helped brother and thanks for sharing the feedback.

  • @pranjalix3
    @pranjalix3 Год назад +1

    Hi Vikas. have just started learning about Grafana and I have a query. If we need a graph or any chart which grafana doesn't offer(out of box), is there a way to write custom code for same (in angular/react) ?

    • @VikasJha001
      @VikasJha001  Год назад

      Grafana is fully opensource and you can develop as many custom component as you want.

  • @ittechsupport1993
    @ittechsupport1993 2 месяца назад

    Hi vikas, Can you make video on how to download the logs with time frame and tar file download using API with any code like golang etc!!

  • @rupakrath637
    @rupakrath637 Год назад +1

    Thank you so much...

  • @chandrusanthosh6831
    @chandrusanthosh6831 9 месяцев назад

    Hey hi, actually im using xk6 for send logs to loki, is it possible to send our own messages to loki like " This is loki test by chandru" Message

  • @AjayKumar-lm4yr
    @AjayKumar-lm4yr 8 месяцев назад

    How to store Grafana Loki logs in Azure Blob Storage

  • @ramyaranjanswain9124
    @ramyaranjanswain9124 10 месяцев назад

    Thanks you Vikas for your all videos ,I am trying to make a dashboard for windows event logs,not able to find any way to make it ,pls help me on this.

    • @VikasJha001
      @VikasJha001  10 месяцев назад

      Use Grafana Loki bro.

  • @user-kt9gr4iu9h
    @user-kt9gr4iu9h 3 месяца назад

    how to download logs from grafana-loki

  • @user-fn8up1lw4g
    @user-fn8up1lw4g 8 месяцев назад

    how to Install a Second Promtail Service?

  • @sarvagyamaithani2093
    @sarvagyamaithani2093 5 месяцев назад

    Can we change this default port 3000 to any other because I'm already using it in one of my applications

    • @VikasJha001
      @VikasJha001  5 месяцев назад

      Yes, you can change it, while running container just provide different port.

  • @manusoftar
    @manusoftar Месяц назад +1

    Absolutely useless, I followed all the steps but Grafana will not connect to Loki... it just wont and if I try to open localhost:3100 it brings back an error 404, even though /metrics brings all those metrics.

  • @ihenners_
    @ihenners_ Год назад +1

    Hi - I have this config running on my monitoring server and want to scrape the config from Mr production server. I have put the IP and port of my production server in the promtail-config
    But It looks like it is still only returning my monitoring server logs.
    I have node_exporter running on port 9100 on my production server. I am using aws and for now my security groups are open on the relevant ports to allow my monitoring server to talk to my production server.
    What configs do I need to change?

    • @VikasJha001
      @VikasJha001  Год назад +1

      Have you installed promtail on the production server?

    • @ihenners_
      @ihenners_ Год назад

      @@VikasJha001 no, what promtail do I need? I don’t need a promtail config do I?

    • @VikasJha001
      @VikasJha001  Год назад +1

      @@ihenners_ you need to install promtail software on all the servers which you want to monitor.

    • @ihenners_
      @ihenners_ Год назад

      @@VikasJha001 thanks. And I do not need promtail on the monitoring server correct?

    • @VikasJha001
      @VikasJha001  Год назад +1

      @@ihenners_ you will need it on the monitoring server as well if you want to check logs or monitor the monitoring server as well.
      If you dont want to monitor the monitoring server then just install promtail on rest of the servers which you want to monitorband visualize with Grafana.

  • @b14ckh4wk3
    @b14ckh4wk3 Год назад +1

    do more videos, oki?