Thank you from the heart ❤❤❤. You can't imagine how much this video helped me and explained to me what I should do. It is very clear, simple and understandable, and at the same time one comprehensive video for everything and there is nothing like it on RUclips.
I'm new to linux and elasticsearch and the issue at the end you were having helped me fix my issue. I was trying to figure it out for over a month. THANK YOU!
Wow i was literally about to do this for windows logs, i was just going to use docs and my BF who love elastic and got certfied in it for work, but this great thanks!
@@ippsec yeah, it really has. The Security model is money, although there's no great way to export and parse when looking at the Alerts page, or even when you shift over to the host view.. I'm sure you can do an API query or use Burp, but that's a little messy when you just want to export the current view.
hey man nice job please can u make a video to integrate logstash and kafka to this setup u made, also i have a question, if i have a offsite office that i need to get their logs to my datacenter is kafka best option to ingest the data of the users and servers and then send it to elasticsearch database through logstash on the edge of my network
Would be great to see a topology regarding the isolation you mentioned with the Fleet server. I want to set this up to monitor my web apps that are exposed to the internet. My plan was to set up the ELK stack on an isolated VLAN on my DMZ interface, then all my web apps with the Elastic agent sit on a different VLAN on the same DMZ. Where would you put the fleet server from a network topology view?
33:44 - Hi Ippec, thanks a lot for doing this video. I have been trying to get this setup to work and all along data was not being shipped to Elasticsearch because of the configuration ssl.verification_mode: "none". Thanks I will be doing a tutorial on this using Docker.
Like i said in this video, I just started on the newest version Elastic the day I recorded. I had used it years ago but a lot has changed. I'm not exactly sure what you mean about OSQuery for Logging. To my knowledge it would help with finding things like current processes and such on the system and not for like querying sysmon logs to get historical like I showed in the video. As to why OSQuery isn't in this video? Because I plan to do OSQuery in a separate video, I was hoping to make an elastic series showing off various features. For example, I didn't even go into configuring the rules for Endpoint Security here.
@@ippsec well, i meant it to be used as an agent. Tho it doesn't work great on windows ,it does have plugins to bridge the gap . You can schedule the queries from a fleet and diff them . (Create queries based on mitre) . You'll have a single cross platform agent . This is what i meant by logging.
Honestly, I'm too new to know what you mean here. Hopefully, I will get it right when I do the OSQuery video, still have a bit more reading and experimenting before that video.
This video is awesome, Thank you! For some reason I am getting authentication errors from Kibana right after the Nginx steps "We hit an authentication error. Please check your credentials and try again. If you still can't log in, contact your system administrator." The curl command with the same credentials for the elastic super user work just fine - any ideas?
i want to build elastic edr, but i have problem when add fleet server. there always error in self signed, after that when my vm have been rebooting, i cant log in with my credential data before. anyone can help me
im getting this error, can someone help Elastic Agent will be installed at /opt/Elastic/Agent and will run as a service. Do you want to continue? [Y/n]:y {"log.level":"info","@timestamp":"2023-06-30T12:35:40.769Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":410},"message":"Generating self-signed certificate for Fleet Server","ecs.version":"1.6.0"} {"log.level":"info","@timestamp":"2023-06-30T12:35:43.410Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":787},"message":"Fleet Server - Running on policy with Fleet Server integration: 3e5321e0-1742-11ee-9e24-6de69790d371; missing config fleet.agent.id (expected during bootstrap process)","ecs.version":"1.6.0"} {"log.level":"warn","@timestamp":"2023-06-30T12:35:43.410Z","log.logger":"tls","log.origin":{"file.name":"tlscommon/tls_config.go","file.line":104},"message":"SSL/TLS verifications disabled.","ecs.version":"1.6.0"} {"log.level":"info","@timestamp":"2023-06-30T12:35:44.401Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":478},"message":"Starting enrollment to URL: fleet:8220/","ecs.version":"1.6.0"} {"log.level":"warn","@timestamp":"2023-06-30T12:35:44.624Z","log.logger":"tls","log.origin":{"file.name":"tlscommon/tls_config.go","file.line":104},"message":"SSL/TLS verifications disabled.","ecs.version":"1.6.0"} Error: fail to enroll: fail to execute request to fleet-server: dial tcp 155.14.140.133:8220: connect: connection refused For help, please see our troubleshooting guide at www.elastic.co/guide/en/fleet/8.8/fleet-troubleshooting.html Error: enroll command failed with exit code: 1 For help, please see our troubleshooting guide at www.elastic.co/guide/en/fleet/8.8/fleet-troubleshooting.html
This is the key line: > Error: fail to enroll: fail to execute request to fleet-server: dial tcp 155.14.140.133:8220: connect: connection refused I'd make sure your box can talk to that IP on that port. Chances are a firewall is blocking you.
I adore how he goes through the process in the exact same tone and flow as he would an easy box.
Unbelievable..node to node explanation and clear understanding of ELK fleet etc. thank you so much for your help.😊 God bless
Literal lifesaver - I'm struggling to set it up in a Docker container and you walked through all the steps I got stuck on, cheers!
Thank you from the heart ❤❤❤.
You can't imagine how much this video helped me and explained to me what I should do. It is very clear, simple and understandable, and at the same time one comprehensive video for everything and there is nothing like it on RUclips.
Good video man. I appreciate the method of instruction/explanation; as if your explaining to a colleague vs a kindergartner
Great video we use Elastic daily and the power it has is not fully realized yet and the automation with little initial investment is a huge benefit
I'm new to linux and elasticsearch and the issue at the end you were having helped me fix my issue. I was trying to figure it out for over a month. THANK YOU!
Wow i was literally about to do this for windows logs, i was just going to use docs and my BF who love elastic and got certfied in it for work, but this great thanks!
Thanks @ippsec my open-source detection is up using ELK and other network and system monitoring tools .
this is what i looking for
greate video
Thanks for adding this. Very helpful. Wish you did this a year ago when I was first doing it. Lol much better than your Helk video.
I do not believe Fleet and such existed when I did that HELK Video. Maybe it did, but Elastic has come a long way since I last looked at it.
@@ippsec yeah, it really has. The Security model is money, although there's no great way to export and parse when looking at the Alerts page, or even when you shift over to the host view.. I'm sure you can do an API query or use Burp, but that's a little messy when you just want to export the current view.
You are awesom! Thank you :)
I love you so much for the insecure flag at 16:28. Took me way too long until I landed here.
Thank you for the tutorial!
Really helpful. Thanks!
Great job 🤗
Update: Endpoint and cloud integration is now called Elastic Defend
The great course
you are a life saver
hey man nice job please can u make a video to integrate logstash and kafka to this setup u made, also i have a question, if i have a offsite office that i need to get their logs to my datacenter is kafka best option to ingest the data of the users and servers and then send it to elasticsearch database through logstash on the edge of my network
Hello, did you figure this out?
How about setting up things like opencti and pushing those IOC to elastic for better detection and correlation? Might that be something we can do?
Great video. Any new video for config log from elastic agent -> logstash -> elasticsearch?
great video thanks!
Would be great to see a topology regarding the isolation you mentioned with the Fleet server. I want to set this up to monitor my web apps that are exposed to the internet. My plan was to set up the ELK stack on an isolated VLAN on my DMZ interface, then all my web apps with the Elastic agent sit on a different VLAN on the same DMZ. Where would you put the fleet server from a network topology view?
endpoint and cloud security has been replaced with "elastic defend" ?
Awesome! 👌
Where did you install this parrot or Ubuntu
33:44 - Hi Ippec, thanks a lot for doing this video. I have been trying to get this setup to work and all along data was not being shipped to Elasticsearch because of the configuration ssl.verification_mode: "none". Thanks I will be doing a tutorial on this using Docker.
Do you need to install sysmon manually on the hosts? I get the powershell logs but not the sysmon ones
Hey great video, i would like to see my asus system logs in ELK
How can you push the agents to multiple Windows boxes and servers easily?
You just need to download & execute that binary. WinRM, PSExec, InTune, any RMM Tool.
Why not use osquery for logging/visibility . It would be cross platform and then use a fleet to manage it?
Like i said in this video, I just started on the newest version Elastic the day I recorded. I had used it years ago but a lot has changed. I'm not exactly sure what you mean about OSQuery for Logging. To my knowledge it would help with finding things like current processes and such on the system and not for like querying sysmon logs to get historical like I showed in the video.
As to why OSQuery isn't in this video? Because I plan to do OSQuery in a separate video, I was hoping to make an elastic series showing off various features. For example, I didn't even go into configuring the rules for Endpoint Security here.
@@ippsec well, i meant it to be used as an agent. Tho it doesn't work great on windows ,it does have plugins to bridge the gap . You can schedule the queries from a fleet and diff them . (Create queries based on mitre) . You'll have a single cross platform agent . This is what i meant by logging.
Honestly, I'm too new to know what you mean here. Hopefully, I will get it right when I do the OSQuery video, still have a bit more reading and experimenting before that video.
@@arunkrishna1854 Maybe you should make a video to show us how its done.
This video is awesome, Thank you!
For some reason I am getting authentication errors from Kibana right after the Nginx steps "We hit an authentication error. Please check your credentials and try again. If you still can't log in, contact your system administrator."
The curl command with the same credentials for the elastic super user work just fine - any ideas?
Hey man, love the video
One question: does this Block malware automatically and log it?
Yes, but that part is not free, it is the Endgame/EDR Component. There is a free trial for it thoe.
@@ippsecthanks for the quick reply. Cant wait to try this out at my current workplace as a junior cyber sec engineer
Please show us installing in windows
Is this Endpoint and Cloud security agent free in Elastic?
i want to build elastic edr, but i have problem when add fleet server. there always error in self signed, after that when my vm have been rebooting, i cant log in with my credential data before. anyone can help me
10:41 what if we don't know how to install a SSL certificate 😅
can we do similar to thease integrations in wazuh ? , for example i had to manually install sysmon and log it ..
I don't use Wazuh, so am not positive. I like Elastic's EDR much better than what wazuh provides.
can i get your social contact?
im getting this error, can someone help
Elastic Agent will be installed at /opt/Elastic/Agent and will run as a service. Do you want to continue? [Y/n]:y
{"log.level":"info","@timestamp":"2023-06-30T12:35:40.769Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":410},"message":"Generating self-signed certificate for Fleet Server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-06-30T12:35:43.410Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":787},"message":"Fleet Server - Running on policy with Fleet Server integration: 3e5321e0-1742-11ee-9e24-6de69790d371; missing config fleet.agent.id (expected during bootstrap process)","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-06-30T12:35:43.410Z","log.logger":"tls","log.origin":{"file.name":"tlscommon/tls_config.go","file.line":104},"message":"SSL/TLS verifications disabled.","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-06-30T12:35:44.401Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":478},"message":"Starting enrollment to URL: fleet:8220/","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-06-30T12:35:44.624Z","log.logger":"tls","log.origin":{"file.name":"tlscommon/tls_config.go","file.line":104},"message":"SSL/TLS verifications disabled.","ecs.version":"1.6.0"}
Error: fail to enroll: fail to execute request to fleet-server: dial tcp 155.14.140.133:8220: connect: connection refused
For help, please see our troubleshooting guide at www.elastic.co/guide/en/fleet/8.8/fleet-troubleshooting.html
Error: enroll command failed with exit code: 1
For help, please see our troubleshooting guide at www.elastic.co/guide/en/fleet/8.8/fleet-troubleshooting.html
This is the key line:
> Error: fail to enroll: fail to execute request to fleet-server: dial tcp 155.14.140.133:8220: connect: connection refused
I'd make sure your box can talk to that IP on that port. Chances are a firewall is blocking you.
great video, thank you
Thanks a lot. Good job!