scipipe

Workflow engine

A flexible and efficient way to write and run complex workflows using Go programming language

Robust, flexible and resource-efficient pipelines using Go and the commandline

GitHub

1k stars
38 watching
71 forks
Language: Go
last commit: 5 months ago
Linked from 1 awesome list

bioinformaticsbioinformatics-pipelinecheminformaticsdataflowfbpgogolangpipelinescientific-workflowsscipipeworkflowworkflow-engine

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
shenwei356/rush A command-line tool for executing jobs in parallel with customizable features and support for multiple platforms. 890
pharmbio/sciluigi A lightweight wrapper around Spotify's Luigi workflow library to simplify writing scientific workflows 335
whitaker-io/machine A library for creating data workflows that can be simple or complex, with features like recursion and memoization. 159
temporalio/sdk-go A framework for building and executing long-running business logic in a scalable and resilient way. 550
deanishe/awgo A Go library for building fast and efficient workflows in Alfred 3 and 4 872
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
runabol/tork A distributed workflow engine for automating complex tasks and workflows. 616
galaxyproject/galaxy A platform for data-intensive scientific analysis and workflow management 1,431
pipefunc/pipefunc Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows. 230
quickube/piper Automates creation of Kubernetes workflows based on Git branch changes 22
analysiscenter/batchflow A framework for defining and executing data processing and machine learning workflows with support for batch processing, lazy execution, and model training. 202
insitro/redun A workflow engine that allows complex data flows to be defined and executed in a flexible and efficient manner 537
danielgerlag/liteflow A Python library for running workflows with pluggable persistence and concurrency providers. 62
rookout/piper Automates the creation of Kubernetes workflows from Git branches 38