logstash
Data processor
A real-time data processing pipeline that transforms and sends data to a storage system
Logstash - transport and process your logs, events, or other data
14k stars
835 watching
4k forks
Language: Java
last commit: about 1 month ago
Linked from 5 awesome lists
etl-frameworkjavajrubyloggingreal-time-processingstreaming
Related projects:
Repository | Description | Stars |
---|---|---|
skalogs/skaetl | A real-time ETL tool for log processing and transformation designed to handle multiple input formats and output destinations such as Elasticsearch and Kafka. | 68 |
aws/aws-cloudtrail-processing-library | A Java client library to read and process CloudTrail log files in a fault-tolerant and scalable manner | 88 |
anasoid/jmeter-logstash | Parses JMeter JTL files and logs them to Elasticsearch and InfluxDB for analysis | 8 |
pblittle/docker-logstash | An image providing a configurable Logstash 1.4 environment with Elasticsearch and Kibana integration options | 236 |
spreads/spreads | A high-performance library for real-time data processing and time series manipulation | 430 |
loosechainsaw/slack | A lazy functional JavaScript library providing methods to manipulate and query data in an array-like structure. | 3 |
mesos/logstash | A Mesos framework for running Logstash on multiple agents to collect and process log data | 67 |
elastic/beats | A lightweight data shipping framework for various operational data sources | 12,214 |
jondot/crunch | A toolkit for extracting insights from large datasets by parsing and processing semi-structured data | 214 |
elastic/elasticsearch-hadoop | Integrates Elasticsearch search and analytics with Hadoop data processing | 1,930 |
log2timeline/dftimewolf | A framework for orchestrating data collection, processing, and export | 299 |
travitch/datalog | A Haskell implementation of Datalog, allowing recursive queries in a logic language. | 104 |
logstash-plugins/logstash-output-influxdb | This plugin is used to send log data from Logstash to InfluxDB | 58 |
awslabs/logstash-output-amazon_es | Provides an output plugin for Logstash to export events to Amazon Elasticsearch Service with authentication and signing support. | 375 |
ascrus/getl | A tool for automating data processing and integration from various sources into data warehouses | 56 |