Hey aditya, nice video. Crisp and clear. Just a suggestion, may be demonstrating a practical use case, something like a injecting a fault deliberately in a spring boot app and then going through the process of identifying the root cause using log aggregation can be immensely helpful.
Cool!! I jusst created my kibana and elasticsearch, however, I can't search all my pods that I deployed such as nginx and some of deployments in the specific name space, just found fluentbit and kibana pods, what should I do to find them (my deployment) on kibana?
@@adityajoshi12 hello Aditya, I tried to find the docs link for installing into kubernetes 1.22 but not found it. Is the documents has been changed? and where the helm link to install kibana and es? should I add edit es repo helm first for service account etc?
Hi Mr.Joshi, can you make video for Kubernetes cluster logging hosted on Hyper-V Ubuntu 22.04 machine and output sent to Splunk, instead of kabana -elastic search. That would be much appreciated.
Hi, if my application pod (php application )is writing logs to particular folder inside pod /storage/logs/larvael.log ,,,, can I use this path in fluentd instead of /var/log/container
Nice explanation. How can I connect to elastic search which is running in different k8s cluster? I would like to keep logging infra out of main cluster
nice content really easy and well explained , i am new to this logging , i had a doubt in last step ,,, i have 3 nodes and instead of port forwarding if i use :5601 , will i still be able to connect?
I understand it has been a long time but maybe you can help. I don't seem to be getting any systemd logs and as far as I can tell from your video, you didn't either. Did you ever investigate this part and find a solution?
hello Aditya, I tried to find the docs link for installing into kubernetes 1.22 but not found it. Is the documents has been changed? and where the helm link to install kibana and es? should I add edit es repo helm first for service account etc?
Awesome! I was like how to configure fluent bit with ELK, you nailed it in simple and superb explanation. Thank you!
Glad you liked it
Hey aditya, nice video. Crisp and clear.
Just a suggestion, may be demonstrating a practical use case, something like a injecting a fault deliberately in a spring boot app and then going through the process of identifying the root cause using log aggregation can be immensely helpful.
Very well explained 🎉
Glad it was helpful
Absolutely Amazing Content Man
Glad you like it
Cool!! I jusst created my kibana and elasticsearch, however, I can't search all my pods that I deployed such as nginx and some of deployments in the specific name space, just found fluentbit and kibana pods, what should I do to find them (my deployment) on kibana?
excellent demonstration 👍
Glad you liked it
Nice content and very helpful for us!! Keep sharing good man!
Glad it helped
@@adityajoshi12 hello Aditya, I tried to find the docs link for installing into kubernetes 1.22 but not found it. Is the documents has been changed? and where the helm link to install kibana and es? should I add edit es repo helm first for service account etc?
Thanks and really appreciate your efforts bro.
Excellent video. Thanks a lot.
Glad you enjoyed it!
Nice explanation, thanks man!
Woow really nice video
Just i have one question how we integrate if we have lots of tenants in kibana
Nice video, Have you ever deployed elasticsearch on K8s cluster running docker desktop using WSL2?
Hi Mr.Joshi, can you make video for Kubernetes cluster logging hosted on Hyper-V Ubuntu 22.04 machine and output sent to Splunk, instead of kabana -elastic search. That would be much appreciated.
hey Aditya , how to enrypt the logs before sending them to the elastic search or to the centralized SIEM ?
I guess you can use the encryption at LVM
can we do this using minikube locally
Yes, works with minikube as well.
Hi, if my application pod (php application )is writing logs to particular folder inside pod /storage/logs/larvael.log ,,,, can I use this path in fluentd instead of /var/log/container
Yes
Hi Aditya
really appreciate your efforts, superb explanation, without helm charts can we setup elasticsearch on K8S?
Yes you can create a simple deployment
Nice explanation.
How can I connect to elastic search which is running in different k8s cluster?
I would like to keep logging infra out of main cluster
Expose your elastic search via ingress or IP and then you can configure its endpoint in the fluent bit configuration
hey aditya can you say for eks 1.24 and above versions.. are update in your git for the same yaml files
V1.22 should work fine
nice content really easy and well explained , i am new to this logging , i had a doubt in last step ,,, i have 3 nodes and instead of port forwarding if i use :5601 , will i still be able to connect?
If the kubernetes service is of type load balancer only then you can access it using the loadbalancer IP
I understand it has been a long time but maybe you can help. I don't seem to be getting any systemd logs and as far as I can tell from your video, you didn't either. Did you ever investigate this part and find a solution?
Hey, can you provide the configMap and DaemonSet files which you customised in the video in the description please?🙏
added repo link in the video description
@@adityajoshi12 Thanks a lot❤️
hello Aditya, I tried to find the docs link for installing into kubernetes 1.22 but not found it. Is the documents has been changed? and where the helm link to install kibana and es? should I add edit es repo helm first for service account etc?
This is the helm chart repo github.com/elastic/helm-charts.
i'm followed all as per video but
in elastic search it given all name spaces while i need specific namespace only
You can create role in kubernetes for the specific namespace and use that service account in the elastic search container
Sinple and clear
Thanks man
Can you help me on how to move Kubernetes logs to s3?
There is AWS S3 plugin available that can help you to ship logs to s3. docs.fluentbit.io/manual/pipeline/outputs/s3/
@@adityajoshi12 If possible can you create a video please?
Because I am new to Kubernetes.
Nice
Hi Aditya, great explanation, need your support in implementing the same in my project in windows. Can any one help me
Reach out mere here linktr.ee/adityajoshi12
Woow really nice video
Just i have one question how we integrate if we have lots of tenants in kibana
Check this out github.com/wtakase/kibana-own-home