Logging in Kubernetes | Fluent Bit | Observability | ADITYA JOSHI |
HTML-код
- Опубликовано: 21 окт 2024
- In this video, I talked about the logging in Kubernetes and also how to setup Fluent bit along with Elastic Search and Kibana for visualising logs
Github repo: github.com/adi...
Check out my courses on udemy:
1. The Complete Guide on Hyperledger Fabric v2.x on Kubernetes - bit.ly/hlf-k8
2. Learn to Deploy Hyperledger Fabric v2.2 on Multi-host - bit.ly/hlf-mul...
3. Master Class On Hyperledger Besu - bit.ly/besu-ma...
4. Certified Blockchain Developer Certification - 2021 - bit.ly/CBD-cer...
Follow me
LinkedIN: bit.ly/3MZYNp4
Twitter: bit.ly/36DM5vK
Instagram: bit.ly/34VZoaa
Telegram: t.me/blockchai...
![FNAF vs TF2 - Episode 2 [SFM]](http://i.ytimg.com/vi/z5b3V2-VLb0/mqdefault.jpg)
Awesome! I was like how to configure fluent bit with ELK, you nailed it in simple and superb explanation. Thank you!
Glad you liked it
Very well explained 🎉
Glad it was helpful
Woow really nice video
Just i have one question how we integrate if we have lots of tenants in kibana
Hey aditya, nice video. Crisp and clear.
Just a suggestion, may be demonstrating a practical use case, something like a injecting a fault deliberately in a spring boot app and then going through the process of identifying the root cause using log aggregation can be immensely helpful.
Cool!! I jusst created my kibana and elasticsearch, however, I can't search all my pods that I deployed such as nginx and some of deployments in the specific name space, just found fluentbit and kibana pods, what should I do to find them (my deployment) on kibana?
excellent demonstration 👍
Glad you liked it
Thanks and really appreciate your efforts bro.
Nice explanation, thanks man!
Excellent video. Thanks a lot.
Glad you enjoyed it!
Hi Mr.Joshi, can you make video for Kubernetes cluster logging hosted on Hyper-V Ubuntu 22.04 machine and output sent to Splunk, instead of kabana -elastic search. That would be much appreciated.
Absolutely Amazing Content Man
Glad you like it
Hi Aditya
really appreciate your efforts, superb explanation, without helm charts can we setup elasticsearch on K8S?
Yes you can create a simple deployment
hey Aditya , how to enrypt the logs before sending them to the elastic search or to the centralized SIEM ?
I guess you can use the encryption at LVM
Nice video, Have you ever deployed elasticsearch on K8s cluster running docker desktop using WSL2?
Nice content and very helpful for us!! Keep sharing good man!
Glad it helped
@@adityajoshi12 hello Aditya, I tried to find the docs link for installing into kubernetes 1.22 but not found it. Is the documents has been changed? and where the helm link to install kibana and es? should I add edit es repo helm first for service account etc?
hey aditya can you say for eks 1.24 and above versions.. are update in your git for the same yaml files
V1.22 should work fine
nice content really easy and well explained , i am new to this logging , i had a doubt in last step ,,, i have 3 nodes and instead of port forwarding if i use :5601 , will i still be able to connect?
If the kubernetes service is of type load balancer only then you can access it using the loadbalancer IP
I understand it has been a long time but maybe you can help. I don't seem to be getting any systemd logs and as far as I can tell from your video, you didn't either. Did you ever investigate this part and find a solution?
Nice explanation.
How can I connect to elastic search which is running in different k8s cluster?
I would like to keep logging infra out of main cluster
Expose your elastic search via ingress or IP and then you can configure its endpoint in the fluent bit configuration
can we do this using minikube locally
Yes, works with minikube as well.
Hey, can you provide the configMap and DaemonSet files which you customised in the video in the description please?🙏
added repo link in the video description
@@adityajoshi12 Thanks a lot❤️
Hi, if my application pod (php application )is writing logs to particular folder inside pod /storage/logs/larvael.log ,,,, can I use this path in fluentd instead of /var/log/container
Yes
hello Aditya, I tried to find the docs link for installing into kubernetes 1.22 but not found it. Is the documents has been changed? and where the helm link to install kibana and es? should I add edit es repo helm first for service account etc?
This is the helm chart repo github.com/elastic/helm-charts.
i'm followed all as per video but
in elastic search it given all name spaces while i need specific namespace only
You can create role in kubernetes for the specific namespace and use that service account in the elastic search container
Nice
Sinple and clear
Thanks man
Hi Aditya, great explanation, need your support in implementing the same in my project in windows. Can any one help me
Reach out mere here linktr.ee/adityajoshi12
Can you help me on how to move Kubernetes logs to s3?
There is AWS S3 plugin available that can help you to ship logs to s3. docs.fluentbit.io/manual/pipeline/outputs/s3/
@@adityajoshi12 If possible can you create a video please?
Because I am new to Kubernetes.
Woow really nice video
Just i have one question how we integrate if we have lots of tenants in kibana
Check this out github.com/wtakase/kibana-own-home