bpipe

Pipeline manager

A tool for running and managing bioinformatics pipelines by abstracting away low-level details and providing features such as dependency tracking, transactional management, and parallelism.

Bpipe - a tool for running and managing bioinformatics pipelines

GitHub

233 stars
18 watching
57 forks
Language: Groovy
last commit: about 1 month ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
bjpop/rubra A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. 38
prodmodel/prodmodel A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance. 58
linkedin/brooklin A distributed system for streaming data between heterogeneous systems with high reliability and throughput at scale 931
natcap/taskgraph A Python library for managing and optimizing computational workflows with parallel processing and data reuse. 22
montilab/pipeliner A framework for defining and automating bioinformatics pipelines using Nextflow. 44
kevin-hanselman/dud A lightweight tool for managing and versioning large data alongside source code in data pipelines 184
hyfather/pipeline A package implementing pipelines using goroutines to manage concurrency in Go applications. 56
galaxyproject/galaxy A platform for data-intensive scientific analysis and workflow management 1,431
booboo-at-gluga-de/bp-addon A tool for monitoring and managing complex IT infrastructures by aggregating check results from Nagios/Icinga and creating hierarchical business processes. 1
ensembl/ensembl-hive A system for creating and running pipelines on distributed compute resources using a workflow management system. 53
alexanderrichtertd/plex A comprehensive pipeline management system for VFX, animation, and game production workflows 249
samapriya/planet-gee-pipeline-cli A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. 42
fluidattacks/makes A framework for building and managing CI/CD pipelines and application environments with cryptographic signed dependencies. 461
bndtools/bnd A comprehensive toolset for managing OSGi bundles and dependencies 533
seldonio/tempo An MLOps Python library that enables data scientists to deploy and orchestrate machine learning pipelines for production-ready inference. 117