xp

Pipeline builder

A tool for creating flexible and self-documenting data science pipelines

A framework (comand line tool + libraries) for creating flexible compute pipelines

GitHub

56 stars
5 watching
8 forks
Language: Python
last commit: almost 4 years ago
Linked from 1 awesome list

data-sciencenotebookpipelineresearch-toolworkflow

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
ropensci/targets A tool for creating reproducible data science pipelines in R. 940
minyus/pipelinex A Python package to build and experiment with machine learning pipelines using Kedro, MLflow, and other tools 224
amphi-ai/amphi-etl A Python-based ETL tool for data transformation and pipeline development with low-code interface and native code generation. 904
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
prodmodel/prodmodel A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance. 59
ypares/porcupine A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments 89
rosineygp/mkdkr A framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines. 369
py-universe/django-rest-cli A tool that speeds up the development of Django Rest APIs by automating repetitive tasks. 117
zorbash/opus A framework for building pluggable business logic pipelines with a focus on modular and composable components. 361
kevin-hanselman/dud A lightweight tool for managing and versioning large data alongside source code in data pipelines 183
pwwang/pipen A Python-based workflow automation framework that enables easy creation of data processing pipelines 103
d6t/d6tflow A Python library to build and manage complex data science workflows efficiently 952
kirillseva/ruigi A tool for designing and managing data processing pipelines in R. 42
giacbrd/smartpipeline A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency 23
mehd-io/pypi-duck-flow A project to build data pipelines and visualizations for analyzing Python package download data from PyPi. 148