xp
Pipeline builder
A tool for creating flexible and self-documenting data science pipelines
A framework (comand line tool + libraries) for creating flexible compute pipelines
56 stars
5 watching
8 forks
Language: Python
last commit: over 5 years agoLinked from 1 awesome list
data-sciencenotebookpipelineresearch-toolworkflow
pditommaso/awesome-pipelineRelated projects:
| Repository | Description | Stars |
|---|---|---|
 ropensci/targets | A tool for creating reproducible data science pipelines in R. | 949 |
 minyus/pipelinex | A Python package to build and experiment with machine learning pipelines using Kedro, MLflow, and other tools | 226 |
 amphi-ai/amphi-etl | A tool that enables data analysts to create and manage data pipelines with an intuitive interface, generating Python code for deployment anywhere. | 933 |
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 prodmodel/prodmodel | A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance. | 58 |
 ypares/porcupine | A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
 rosineygp/mkdkr | A framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines. | 370 |
 py-universe/django-rest-cli | A tool that speeds up the development of Django Rest APIs by automating repetitive tasks. | 118 |
 zorbash/opus | A framework for building pluggable business logic pipelines with a focus on modular and composable components. | 362 |
 kevin-hanselman/dud | A lightweight tool for managing and versioning large data alongside source code in data pipelines | 184 |
 pwwang/pipen | A Python-based workflow automation framework that enables easy creation of data processing pipelines | 105 |
 d6t/d6tflow | A Python library to build and manage complex data science workflows efficiently | 953 |
 kirillseva/ruigi | A tool for designing and managing data processing pipelines in R. | 42 |
 giacbrd/smartpipeline | A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency | 25 |
 mehd-io/pypi-duck-flow | A data engineering project that extracts insights from Python projects using DuckDB and MotherDuck. | 173 |