covalent

Workflow manager

A Python library for orchestrating machine-learning and high-performance computing workflows in heterogeneous environments

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

GitHub

782 stars
24 watching
96 forks
Language: Python
last commit: 8 days ago
Linked from 3 awesome lists

covalentdata-pipelinedata-sciencedeep-learninghacktoberfesthpchpc-applicationsmachine-learningmachinelearningmachinelearning-pythonorchestrationparallelizationpipelinespythonquantumquantum-computingquantum-machine-learningworkflowworkflow-automationworkflow-management

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
scm-nv/qmflows Automates tasks in computational chemistry simulations 45
jvalegre/aqme Automated workflows for quantum mechanical environments using Python. 99
geekq/workflow An API for modeling and interacting with workflow states and transitions in a state-machine-inspired way 1,762
pytask-dev/pytask A workflow management system that facilitates reproducible data analyses 114
couler-proj/couler Provides a unified interface for constructing and managing workflows across different workflow engines. 916
scm-nv/plams A toolkit for automating molecular simulation workflows and post-processing computational chemistry calculations. 67
deqitang/pymatflow Automates preparation and submission of DFT calculations for materials science simulations 6
illumina/pyflow A tool to manage tasks in the context of a task dependency graph using Python code. 146
nipy/nipype A framework that simplifies workflow design and interaction between neuroimaging packages 751
natcap/taskgraph A Python library for managing and optimizing computational workflows with parallel processing and data reuse. 21
it4innovations/hyperqueue A tool that automates the execution of complex workflows on HPC clusters by dynamically allocating resources and load-balancing tasks. 283
tauffer-consulting/domino A platform that allows users to create and monitor complex workflows using a graphical interface and reusable Python code units 152
gc3pie/gc3pie A suite of Python classes and tools for managing computational workflows on diverse Grids and clusters 44
kenza-ai/sagify Simplifies machine learning workflows on AWS SageMaker by providing a unified interface to leverage large language models 434
quantum-accelerators/quacc A platform for running computational materials science and quantum chemistry workflows on various computing resources. 183