riak_pipe

Pipeline processor

Enables parallel processing of data by dividing tasks into independent queues managed by Riak Core's vnode architecture.

Riak Pipelines

GitHub

162 stars
85 watching
60 forks
Language: Erlang
last commit: over 1 year ago

Related projects:

Repository Description Stars
basho/riak A distributed, decentralized data storage system for storing and retrieving large amounts of data 3,960
renkun-ken/piper Provides functions and methods to chain operations in R, enhancing readability and maintainability of data pipelines. 169
nerevu/riko A Python library for analyzing and processing streams of structured data 1,604
raine/ramda-cli A tool for composing functions into data-processing pipelines to produce desired output. 573
nazar256/parapipe A non-blocking buffered pipeline library that allows concurrent processing of data while maintaining output order without locks or mutexes. 31
thephpleague/pipeline Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. 960
skner/iasi-pipe A data pipeline framework for processing Ion Torrent sequencing data 2
destel/rill A toolkit for building concurrent programs by composing simple, reusable parts into clean pipelines. 510
substantic/rain A framework for processing large-scale task-based pipelines in a distributed manner 748
sizovs/pipelinr A command processing pipeline framework for handling requests and responses in Java applications 426
pathikrit/better-files A Scala wrapper around Java NIO for simple and safe I/O operations, providing a pragmatic solution for tasks like file processing and compression. 1,474
calebwin/pipelines A language and runtime for crafting massively parallel data pipelines 374
p12ngh/pipelinedsl A Haskell-based DSL for describing hardware pipelines 1
bakins/lua-resty-riak A Lua client driver for the Riak distributed database 25
priestjim/gen_rpc A scalable RPC library for Erlang-based languages 222