pipen
Pipeline tool
A Python-based workflow automation framework that enables easy creation of data processing pipelines
A pipeline framework for python
105 stars
11 watching
15 forks
Language: Python
last commit: about 2 years agoLinked from 1 awesome list
dotjinja2pipelinepipeline-frameworkpythonworkflowworkflow-engine
pditommaso/awesome-pipelineRelated projects:
| Repository | Description | Stars |
|---|---|---|
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 pipefunc/pipefunc | Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows. | 230 |
 pdpipe/pdpipe | Provides a set of pre-defined data processing pipelines for pandas DataFrames. | 718 |
 python-mario/mario | Tools for executing Python code and building data pipelines in a Unix shell | 507 |
 natcap/taskgraph | A Python library for managing and optimizing computational workflows with parallel processing and data reuse. | 22 |
 calebwin/pipelines | A language and runtime for crafting massively parallel data pipelines | 375 |
 druths/xp | A tool for creating flexible and self-documenting data science pipelines | 56 |
 ypares/porcupine | A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
 johnsonc/lambdo | A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines | 1 |
 rookout/piper | Automates the creation of Kubernetes workflows from Git branches | 38 |
 pypyr/pypyr | A tool to automate repetitive tasks in software development pipelines | 613 |
 quickube/piper | Automates creation of Kubernetes workflows based on Git branch changes | 22 |
 thephpleague/pipeline | Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. | 965 |
 picanumber/yapp | Parallel pipeline library for stream processing | 62 |
 substantic/rain | A framework for processing large-scale task-based pipelines in a distributed manner | 749 |