ensembl-hive
Pipeline manager
A system for creating and running pipelines on distributed compute resources using a workflow management system.
EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource
53 stars
16 watching
28 forks
Language: Perl
last commit: 3 months ago
Linked from 1 awesome list
dockerehiveensemblhigh-performance-computingmysqlperlpipelinepostgresqlpythonslurmsqliteworkflow-management-system
pditommaso/awesome-pipelineRelated projects:
| Repository | Description | Stars |
|---|---|---|
 montilab/pipeliner | A framework for defining and automating bioinformatics pipelines using Nextflow. | 44 |
 hyfather/pipeline | A package implementing pipelines using goroutines to manage concurrency in Go applications. | 56 |
 ssadedin/bpipe | A tool for running and managing bioinformatics pipelines by abstracting away low-level details and providing features such as dependency tracking, transactional management, and parallelism. | 233 |
 natcap/taskgraph | A Python library for managing and optimizing computational workflows with parallel processing and data reuse. | 22 |
 bjpop/rubra | A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. | 38 |
 hentioe/honeycomb | An Elixir library for managing background tasks with concurrency control and persistent results | 18 |
 enkessler/childprocess | A Ruby library for managing child processes and controlling external programs. | 578 |
 ploomber/soopervisor | Tools for exporting and managing workflow pipelines across multiple platforms. | 45 |
 prodmodel/prodmodel | A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance. | 58 |
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 themill/wiz | A framework for managing deterministic environments for running commands in software development | 45 |
 fluidattacks/makes | A framework for building and managing CI/CD pipelines and application environments with cryptographic signed dependencies. | 461 |
 broadinstitute/cromwell | A workflow management system designed for bioinformatics that simplifies the transition between small and large-scale environments. | 1,004 |
 agnostiqhq/covalent | A Python library for orchestrating machine-learning and high-performance computing workflows in heterogeneous environments | 785 |
 stacker/stacker-cli | A tool for defining and managing application environments using Docker and Docker Compose | 67 |