tenzir

Data pipeline

A data pipeline engine designed to manage and process large volumes of security telemetry data at scale

Tenzir is the data pipeline engine for security teams.

GitHub

651 stars
35 watching
89 forks
Language: C++
last commit: about 2 months ago
Linked from 3 awesome lists

dataopshacktoberfestincident-responseinvestigationnetflowpcappipelinessecdataopssecuritysiemsigmasocsuricatathreathuntingzeek

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
apache/tez A system that enables flexible data processing pipelines using a low-level engine for higher-level frameworks 482
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
giacbrd/smartpipeline A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency 25
thbar/kiba A Ruby-based framework for defining and running reliable, concise, and maintainable ETL jobs 1,752
log2timeline/dftimewolf A framework for orchestrating data collection, processing, and export 299
galaxyproject/galaxy A platform for data-intensive scientific analysis and workflow management 1,431
kevin-hanselman/dud A lightweight tool for managing and versioning large data alongside source code in data pipelines 184
skner/iasi-pipe A data pipeline framework for processing Ion Torrent sequencing data 2
ypares/porcupine A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments 89
ferrysyahrinal/twifer A tool that enables the creation of low-latency, real-time data processing pipelines 0
feathr-ai/feathr A unified data and AI engineering platform for enterprise 1,985
silascutler/malpipe An ingestion and processing framework for malware and indicator data from various feeds. 104
nazar256/parapipe A library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications. 33
darky/rocket-pipes A TypeScript library that enables the creation of modular, composable, and reusable data processing pipelines 25
pdpipe/pdpipe Provides a set of pre-defined data processing pipelines for pandas DataFrames. 718