rain
by substantic
Framework for large distributed pipelines
AI summary
Pipeline processor
A framework for processing large-scale task-based pipelines in a distributed manner
- stars
- 749
- forks
- 54
- watching
- 44
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Pipeline processor
A tool for composing functions into data-processing pipelines to produce desired output.
Pipeline processor
Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner.
Stream processor
A distributed stream processing framework for real-time data reactions
Pipeline runner
A workflow management system designed to efficiently run pipelines in various environments.
Pipeline library
A library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications.
Stream processor
Enables real-time computation on live streams of data using Python
bytewax/bytewax1.6K
Stream processor
A Python framework for stateful stream and event processing with built-in connectors and flexible dataflow capabilities.
Process runner
A library for managing subprocesses in Python.
pwwang/pipen105
Pipeline tool
A Python-based workflow automation framework that enables easy creation of data processing pipelines
Data pipeline processor
A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory
Task pipeline
A decentralized task pipeline on Golem.network using Python.
Pipeline builder
A tool for creating flexible and self-documenting data science pipelines
Pipeline manager
A Python library for managing and optimizing computational workflows with parallel processing and data reuse.
Pipeline manager
A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster.
Workflow automator
Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions rain.
