parapipe
Pipeline library
A library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications.
Paralleling pipeline
33 stars
1 watching
3 forks
Language: Go
last commit: about 1 month ago
Linked from 2 awesome lists
avelino/awesome-go
xwjdsh/awesome-go-extraRelated projects:
| Repository | Description | Stars |
|---|---|---|
 thephpleague/pipeline | Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. | 965 |
 olirice/flupy | A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory | 193 |
 picanumber/yapp | Parallel pipeline library for stream processing | 62 |
 silascutler/malpipe | An ingestion and processing framework for malware and indicator data from various feeds. | 104 |
 raine/ramda-cli | A tool for composing functions into data-processing pipelines to produce desired output. | 573 |
 kenavolic/pipet | A lightweight C++ library for building compile-time processing pipelines with customizable filters and branches. | 67 |
 substantic/rain | A framework for processing large-scale task-based pipelines in a distributed manner | 749 |
 calebwin/pipelines | A language and runtime for crafting massively parallel data pipelines | 375 |
 basho/riak_pipe | Enables parallel processing of data by dividing tasks into independent queues managed by Riak Core's vnode architecture. | 162 |
 natcap/taskgraph | A Python library for managing and optimizing computational workflows with parallel processing and data reuse. | 22 |
 ypares/porcupine | A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
 seantanly/elixir-paratize | An Elixir library providing parallel processing facilities with customizable worker size and timeout options. | 28 |
 it4innovations/hyperloom | A platform for defining and executing scientific pipelines in distributed environments using C++ and Python. | 16 |
 julienpalard/pipe | A Python library providing a simple and flexible way to process sequences of data using infix notation. | 1,965 |
 bjpop/rubra | A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. | 38 |