Logstash

Logstash is a plugable data acquisition and processing engine. A wide range of plug-ins enables easy configuration for collecting, processing and routing data in many different architectures.

Processing takes place within one or more so-called pipelines. Each pipeline has one or more input plug-ins that receive or capture data and place it in an internal queue. By default, this is small and held in memory, but can be configured to accommodate more space and disk storage for greater reliability and resilience.