bpipe

Pipeline manager

A tool for running and managing bioinformatics pipelines by abstracting away low-level details and providing features such as dependency tracking, transactional management, and parallelism.

Bpipe - a tool for running and managing bioinformatics pipelines

GitHub

230 stars
18 watching
57 forks
Language: Groovy
last commit: 23 days ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
bjpop/rubra A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. 38
prodmodel/prodmodel A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance. 59
linkedin/brooklin A distributed system for streaming data between heterogeneous systems with high reliability and throughput at scale 920
natcap/taskgraph A Python library for managing and optimizing computational workflows with parallel processing and data reuse. 21
montilab/pipeliner A framework for defining and automating bioinformatics pipelines using Nextflow. 44
kevin-hanselman/dud A lightweight tool for managing and versioning large data alongside source code in data pipelines 183
hyfather/pipeline A package implementing pipelines using goroutines to manage concurrency in Go applications. 58
galaxyproject/galaxy An integrated framework for data-intensive scientific analysis and workflow management 1,410
booboo-at-gluga-de/bp-addon A tool that aggregates check results from Nagios/Icinga to model business processes and simulate outages. 1
ensembl/ensembl-hive A system for creating and running pipelines on distributed compute resources using a workflow management system. 52
alexanderrichtertd/plex A comprehensive pipeline management system for VFX, animation, and game production workflows 245
samapriya/planet-gee-pipeline-cli A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. 42
fluidattacks/makes A framework for building and managing CI/CD pipelines and application environments with cryptographic signed dependencies. 453
bndtools/bnd A comprehensive toolset for managing OSGi bundles and dependencies 532
seldonio/tempo An MLOps Python library that enables data scientists to deploy and orchestrate machine learning pipelines for production-ready inference. 116