tenzir

Data pipeline

A data pipeline engine designed to manage and process large volumes of security telemetry data at scale

Tenzir is the data pipeline engine for security teams.

GitHub

645 stars
35 watching
89 forks
Language: C++
last commit: 6 days ago
Linked from 3 awesome lists

dataopshacktoberfestincident-responseinvestigationnetflowpcappipelinessecdataopssecuritysiemsigmasocsuricatathreathuntingzeek

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
apache/tez A system that enables flexible data processing pipelines using a low-level engine for higher-level frameworks 479
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
giacbrd/smartpipeline A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency 23
thbar/kiba A Ruby-based framework for defining and running reliable, concise, and maintainable ETL jobs 1,754
log2timeline/dftimewolf A framework for orchestrating data collection, processing, and export 296
galaxyproject/galaxy An integrated framework for data-intensive scientific analysis and workflow management 1,410
kevin-hanselman/dud A lightweight tool for managing and versioning large data alongside source code in data pipelines 183
skner/iasi-pipe A data pipeline framework for processing Ion Torrent sequencing data 2
ypares/porcupine A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments 89
ferrysyahrinal/twifer A tool that enables the creation of low-latency, real-time data processing pipelines 0
feathr-ai/feathr A unified data and AI engineering platform for enterprise 1,986
silascutler/malpipe An ingestion and processing framework for malware and indicator data from various feeds. 103
nazar256/parapipe A non-blocking buffered pipeline library that allows concurrent processing of data while maintaining output order without locks or mutexes. 31
darky/rocket-pipes A TypeScript library that enables the creation of modular, composable, and reusable data processing pipelines 25
pdpipe/pdpipe A tool for creating and managing data pipelines with pandas DataFrames 716