tibanna
Pipeline runner
A tool for running genomic pipelines on Amazon cloud using portable workflows in CWL/WDL/Snakemake formats
Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.
70 stars
15 watching
28 forks
Language: Python
last commit: about 2 months ago
Linked from 1 awesome list
awsaws-lambdaaws-step-functionbioinformaticscondacwlcwl-workflowdockerpipelinessnakemakesnakemake-workflowwdlwdl-workflow
pditommaso/awesome-pipelineRelated projects:
| Repository | Description | Stars |
|---|---|---|
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 vincentclaes/datajob | Automates end-to-end machine learning pipeline deployment with AWS services | 111 |
 johnsonc/lambdo | A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines | 1 |
 nficano/python-lambda | A toolset for bundling and deploying Python code in AWS Lambda | 1,501 |
 calebwin/pipelines | A language and runtime for crafting massively parallel data pipelines | 375 |
 awslabs/aws-codepipeline-jenkins-aws-codedeploy_linux | A sample AWS CodePipeline pipeline demonstrating a four-stage workflow with Jenkins and AWS Codedeploy | 50 |
 bjpop/rubra | A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. | 38 |
 doonny/pipecnn | A tool for accelerating convolutional neural networks on Field-Programmable Gate Arrays (FPGAs) using OpenCL-based hardware design | 1,264 |
 kakaobrain/torchgpipe | A PyTorch-based library for efficient training of large neural networks using pipeline parallelism and automatic recomputation of gradients. | 820 |
 pwwang/pipen | A Python-based workflow automation framework that enables easy creation of data processing pipelines | 105 |
 robdmc/consecution | A simple pipeline abstraction for building data processing workflows with Python | 169 |
 fstrozzi/bioruby-pipengine | An ultra light YAML-based pipeline execution engine for biological data analysis pipelines | 20 |
 linkedin/brooklin | A distributed system for streaming data between heterogeneous systems with high reliability and throughput at scale | 931 |
 combust/mleap | Enables deployment of machine learning pipelines from Spark and Scikit-Learn to production | 1,506 |
 gabriella439/pipes | A lightweight stream processing library that builds and connects reusable streaming components using Haskell | 489 |