covalent

Workflow manager

A Python library for orchestrating machine-learning and high-performance computing workflows in heterogeneous environments

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

GitHub

785 stars
24 watching
96 forks
Language: Python
last commit: almost 2 years ago
Linked from 3 awesome lists

covalentdata-pipelinedata-sciencedeep-learninghacktoberfesthpchpc-applicationsmachine-learningmachinelearningmachinelearning-pythonorchestrationparallelizationpipelinespythonquantumquantum-computingquantum-machine-learningworkflowworkflow-automationworkflow-management

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
scm-nv/qmflowsAutomates tasks in computational chemistry simulations45
jvalegre/aqmeAutomated workflows for quantum mechanical environments using Python.100
geekq/workflowAn API for modeling and interacting with workflow states and transitions in a state-machine-inspired way1,764
pytask-dev/pytaskA workflow management system that facilitates reproducible data analyses115
couler-proj/coulerProvides a unified interface for constructing and managing workflows across different workflow engines.919
scm-nv/plamsA toolkit for automating molecular simulation workflows and post-processing computational chemistry calculations.67
deqitang/pymatflowAutomates preparation and submission of DFT calculations for materials science simulations6
illumina/pyflowA tool to manage tasks in the context of a task dependency graph using Python code.146
nipy/nipypeA framework that simplifies workflow design and interaction between neuroimaging packages750
natcap/taskgraphA Python library for managing and optimizing computational workflows with parallel processing and data reuse.22
it4innovations/hyperqueueA tool that automates the execution of complex workflows on HPC clusters by dynamically allocating resources and load-balancing tasks.292
tauffer-consulting/dominoA platform that allows users to create and monitor complex workflows using a graphical interface and reusable Python code units155
gc3pie/gc3pieA suite of Python classes and tools for managing computational workflows on diverse Grids and clusters44
kenza-ai/sagifySimplifies machine learning workflows on AWS SageMaker by providing a unified interface to leverage large language models436
quantum-accelerators/quaccA platform for running computational materials science and quantum chemistry workflows on various computing resources.190