pipelines
Pipeline compiler
A language and runtime for crafting massively parallel data pipelines
An experimental programming language for data flow
374 stars
14 watching
9 forks
Language: Nim
last commit: about 5 years ago
Linked from 1 awesome list
compilerlanguagenimparallelpipelinepipelinespython
pditommaso/awesome-pipelineRelated projects:
| Repository | Description | Stars |
|---|---|---|
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 nim-lang/nim | A compiler and runtime environment for a statically typed, compiled systems programming language. | 16,593 |
 pwwang/pipen | A Python-based workflow automation framework that enables easy creation of data processing pipelines | 103 |
 hadrieng/pipelines | A collection of reusable computational pipelines for bioinformatics tasks. | 2 |
 cosmictoast/pipe | A library providing a reusable and flexible pipe operator for Nim programming language. | 60 |
 kevin-hanselman/dud | A lightweight tool for managing and versioning large data alongside source code in data pipelines | 183 |
 renkun-ken/piper | Provides functions and methods to chain operations in R, enhancing readability and maintainability of data pipelines. | 169 |
 druths/xp | A tool for creating flexible and self-documenting data science pipelines | 56 |
 nazar256/parapipe | A non-blocking buffered pipeline library that allows concurrent processing of data while maintaining output order without locks or mutexes. | 31 |
 picanumber/yapp | Parallel pipeline library for stream processing | 61 |
 joboccara/pipes | A header-only C++14 library for building expressive data pipelines using a chainable interface. | 803 |
 biocorecrg/bionextflow | A collection of reusable modules and sub-workflows for Nextflow pipelines in bioinformatics | 26 |
 natcap/taskgraph | A Python library for managing and optimizing computational workflows with parallel processing and data reuse. | 21 |
 vincentclaes/datajob | Automates end-to-end machine learning pipeline deployment with AWS services | 110 |
 johnsonc/lambdo | A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines | 1 |