twifer
Data pipeline creator
A tool that enables the creation of low-latency, real-time data processing pipelines
0 stars
1 watching
1 forks
last commit: 11 months ago
Linked from 1 awesome list
Related projects:
Repository | Description | Stars |
---|---|---|
jhorey/ferry | A tool for setting up and managing big data applications on various platforms using Docker | 252 |
ypares/porcupine | A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
skner/iasi-pipe | A data pipeline framework for processing Ion Torrent sequencing data | 2 |
datasalt/pangool | A Java framework that simplifies Hadoop's MapReduce API to build efficient data processing pipelines | 57 |
manaphy91/nettee | A utility program that pipes output over a network connection | 2 |
moby/datakit | A tool to orchestrate applications using a version-controlled dataflow | 1,082 |
darky/rocket-pipes | A TypeScript library that enables the creation of modular, composable, and reusable data processing pipelines | 25 |
sindresorhus/p-pipe | Creates a reusable pipeline of promise-returning functions to compose and chain together multiple asynchronous operations. | 122 |
amphi-ai/amphi-etl | A Python-based ETL tool for data transformation and pipeline development with low-code interface and native code generation. | 904 |
kevin-hanselman/dud | A lightweight tool for managing and versioning large data alongside source code in data pipelines | 183 |
streamsets/datacollector-oss | A continuous big data ingestion platform that enables easy creation of data pipelines for various data sources and destinations. | 90 |
druths/xp | A tool for creating flexible and self-documenting data science pipelines | 56 |
tenzir/tenzir | A data pipeline engine designed to manage and process large volumes of security telemetry data at scale | 645 |
max-mapper/data-plumber | A Node.js-based command-line data processing tool and workshop | 35 |
giacbrd/smartpipeline | A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency | 23 |