scipipe

Workflow engine

A flexible and efficient way to write and run complex workflows using Go programming language

Robust, flexible and resource-efficient pipelines using Go and the commandline

GitHub

1k stars
38 watching
71 forks
Language: Go
last commit: 3 months ago
Linked from 1 awesome list

bioinformaticsbioinformatics-pipelinecheminformaticsdataflowfbpgogolangpipelinescientific-workflowsscipipeworkflowworkflow-engine

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
shenwei356/rush A command-line tool for executing jobs in parallel with customizable features and support for multiple platforms. 882
pharmbio/sciluigi A lightweight wrapper around Spotify's Luigi workflow library to simplify writing scientific workflows 334
whitaker-io/machine A library for creating data workflows that can be simple or complex, with features like recursion and memoization. 158
temporalio/sdk-go A framework for building and executing long-running business logic in a scalable and resilient way. 539
deanishe/awgo A Go library for building fast and efficient workflows in Alfred 3 and 4 869
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
runabol/tork A distributed workflow engine for automating complex tasks and workflows. 599
galaxyproject/galaxy An integrated framework for data-intensive scientific analysis and workflow management 1,410
pipefunc/pipefunc Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows. 215
uber-go/cadence-client A framework for executing long-running business logic in a scalable and resilient way using the Cadence orchestration engine 349
quickube/piper Automates creation of Kubernetes workflows based on Git branch changes 21
analysiscenter/batchflow A framework for defining and executing data processing and machine learning workflows with support for batch processing, lazy execution, and model training. 201
insitro/redun A workflow engine that allows complex data flows to be defined and executed in a flexible and efficient manner 522
danielgerlag/liteflow A Python library for running workflows with pluggable persistence and concurrency providers. 61
rookout/piper Automates the creation of Kubernetes workflows from Git branches 38