Ingest

Here’s an overview of how logs are ingested in various deployment types.

Import

Core Pipeline: Filebeat [IMPORT Node] –> ES Ingest [IMPORT Node]
Logs: Zeek, Suricata

Eval

Core Pipeline: Filebeat [EVAL Node] –> ES Ingest [EVAL Node]
Logs: Zeek, Suricata, Wazuh, Osquery/Fleet

Osquery Shipper Pipeline: Osquery [Endpoint] –> Fleet [EVAL Node] –> ES Ingest via Core Pipeline
Logs: WEL, Osquery, syslog

Standalone

Core Pipeline: Filebeat [SA Node] –> Logstash [SA Node] –> Redis [SA Node] <–> Logstash [SA Node] –> ES Ingest [SA Node]
Logs: Zeek, Suricata, Wazuh, Osquery/Fleet, syslog

WinLogbeat: Winlogbeat [Windows Endpoint]–> Logstash [SA Node] –> Redis [SA Node] <–> Logstash [SA Node] –> ES Ingest [SA Node]
Logs: WEL, Sysmon

Fleet Standalone

Pipeline: Filebeat [Fleet Node] –> Logstash [M | MS] –> ES Ingest [S | MS]
Logs: Osquery

Manager (separate search nodes)

Core Pipeline: Filebeat [Fleet | Forward] –> Logstash [Manager] –> Redis [Manager]
Logs: Zeek, Suricata, Wazuh, Osquery/Fleet, syslog

WinLogbeat: Winlogbeat [Windows Endpoint]–> Logstash [Manager] –> Redis [Manager]
Logs: WEL

Heavy

Pipeline: Filebeat [Heavy Node] –> Logstash [Heavy] –> Redis [Heavy] <–> Logstash [Heavy] –> ES Ingest [Heavy]
Logs: Zeek, Suricata, Wazuh, Osquery/Fleet, syslog

Forward

Pipeline: Filebeat [Forward] –> Logstash [M | MS] –> ES Ingest [S | MS]
Logs: Zeek, Suricata, Wazuh, syslog