logstash

Data processor

A real-time data processing pipeline that transforms and sends data to a storage system

Logstash - transport and process your logs, events, or other data

GitHub

75 stars
179 watching
4k forks
Language: Java
last commit: 7 days ago
Linked from 5 awesome lists

etl-frameworkjavajrubyloggingreal-time-processingstreaming

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
skalogs/skaetl A real-time ETL tool for log processing and transformation designed to handle multiple input formats and output destinations such as Elasticsearch and Kafka. 68
aws/aws-cloudtrail-processing-library A Java client library to read and process CloudTrail log files in a fault-tolerant and scalable manner 87
anasoid/jmeter-logstash Parses JMeter JTL files and logs them to Elasticsearch and InfluxDB for analysis 8
pblittle/docker-logstash An image providing a configurable Logstash 1.4 environment with Elasticsearch and Kibana integration options 236
spreads/spreads A high-performance library for real-time data processing and time series manipulation 427
loosechainsaw/slack A lazy functional JavaScript library providing methods to manipulate and query data in an array-like structure. 3
mesos/logstash A Mesos framework for running Logstash on multiple agents to collect and process log data 67
elastic/beats A set of lightweight data shippers that capture operational data and send it to Elasticsearch or Logstash for visualization. 103
jondot/crunch A toolkit for extracting insights from large datasets by parsing and processing semi-structured data 214
elastic/elasticsearch-hadoop Integrates Elasticsearch search and analytics with Hadoop data processing 9
log2timeline/dftimewolf A framework for orchestrating data collection, processing, and export 296
travitch/datalog A Haskell implementation of Datalog, allowing recursive queries in a logic language. 102
logstash-plugins/logstash-output-influxdb This plugin is used to send log data from Logstash to InfluxDB 58
awslabs/logstash-output-amazon_es Provides an output plugin for Logstash to export events to Amazon Elasticsearch Service with authentication and signing support. 376
ascrus/getl A tool for automating data processing and integration from various sources into data warehouses 56