d6tflow

Data workflow builder

A Python library to build and manage complex data science workflows efficiently

Python library for building highly effective data science workflows

GitHub

953 stars
24 watching
77 forks
Language: Python
last commit: about 3 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
danielgerlag/liteflowA Python library for running workflows with pluggable persistence and concurrency providers.62
deqitang/pymatflowAutomates preparation and submission of DFT calculations for materials science simulations6
gwforg/gwfA tool for building and running large scientific workflows using Python 3.7+31
druths/xpA tool for creating flexible and self-documenting data science pipelines56
dataoneorg/d1_pythonA collection of Python libraries and tools for interacting with DataONE repositories17
pveber/bistroA library to build and execute complex, distributed workflows in a declarative manner48
whitaker-io/machineA library for creating data workflows that can be simple or complex, with features like recursion and memoization.159
databiosphere/toilA workflow management system designed to efficiently run pipelines in various environments.901
astrazeneca/runnableA Python framework for defining and executing data science workflows with modular components40
pydoit/doitAn automation tool that enables efficient task management and execution of complex workflows1,893
nvidia/earth2studioA Python-based framework for building and deploying AI-driven weather and climate workflows116
baffelli/pyperatorA Python library for building asynchronous workflows with a directed acyclic graph structure60
d3xterjs/pydexterA Python wrapper for rendering charts in the browser with simple syntax31
log2timeline/dftimewolfA framework for orchestrating data collection, processing, and export299
nipype/pydraA lightweight Python dataflow engine for building and executing directed acyclic graphs (DAGs) in a scalable manner.123