xp
Pipeline builder
A tool for creating flexible and self-documenting data science pipelines
A framework (comand line tool + libraries) for creating flexible compute pipelines
56 stars
5 watching
8 forks
Language: Python
last commit: almost 4 years ago
Linked from 1 awesome list
data-sciencenotebookpipelineresearch-toolworkflow
Related projects:
Repository | Description | Stars |
---|---|---|
ropensci/targets | A tool for creating reproducible data science pipelines in R. | 944 |
minyus/pipelinex | A Python package to build and experiment with machine learning pipelines using Kedro, MLflow, and other tools | 225 |
amphi-ai/amphi-etl | A tool that enables data analysts to create and manage data pipelines with an intuitive interface, generating Python code for deployment anywhere. | 920 |
databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 900 |
prodmodel/prodmodel | A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance. | 59 |
ypares/porcupine | A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
rosineygp/mkdkr | A framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines. | 369 |
py-universe/django-rest-cli | A tool that speeds up the development of Django Rest APIs by automating repetitive tasks. | 118 |
zorbash/opus | A framework for building pluggable business logic pipelines with a focus on modular and composable components. | 361 |
kevin-hanselman/dud | A lightweight tool for managing and versioning large data alongside source code in data pipelines | 183 |
pwwang/pipen | A Python-based workflow automation framework that enables easy creation of data processing pipelines | 103 |
d6t/d6tflow | A Python library to build and manage complex data science workflows efficiently | 952 |
kirillseva/ruigi | A tool for designing and managing data processing pipelines in R. | 42 |
giacbrd/smartpipeline | A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency | 23 |
mehd-io/pypi-duck-flow | A project to build data pipelines and visualizations for analyzing Python package download data from PyPi. | 150 |