parapipe
Pipeline processor
A non-blocking buffered pipeline library that allows concurrent processing of data while maintaining output order without locks or mutexes.
Paralleling pipeline
31 stars
1 watching
3 forks
Language: Go
last commit: over 3 years ago
Linked from 2 awesome lists
avelino/awesome-go
xwjdsh/awesome-go-extraRelated projects:
| Repository | Description | Stars |
|---|---|---|
 thephpleague/pipeline | Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. | 960 |
 olirice/flupy | A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory | 193 |
 picanumber/yapp | Parallel pipeline library for stream processing | 61 |
 silascutler/malpipe | An ingestion and processing framework for malware and indicator data from various feeds. | 103 |
 raine/ramda-cli | A tool for composing functions into data-processing pipelines to produce desired output. | 573 |
 kenavolic/pipet | A lightweight C++ library for building compile-time processing pipelines with customizable filters and branches. | 67 |
 substantic/rain | A framework for processing large-scale task-based pipelines in a distributed manner | 748 |
 calebwin/pipelines | A language and runtime for crafting massively parallel data pipelines | 374 |
 basho/riak_pipe | Enables parallel processing of data by dividing tasks into independent queues managed by Riak Core's vnode architecture. | 162 |
 natcap/taskgraph | A Python library for managing and optimizing computational workflows with parallel processing and data reuse. | 21 |
 ypares/porcupine | A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
 seantanly/elixir-paratize | An Elixir library providing parallel processing facilities with customizable worker size and timeout options. | 28 |
 it4innovations/hyperloom | A platform for defining and executing scientific pipelines in distributed environments using C++ and Python. | 16 |
 julienpalard/pipe | A Python library providing a simple and flexible way to process sequences of data using infix notation. | 1,954 |
 bjpop/rubra | A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. | 38 |