machine

Data workflow library

A library for creating data workflows that can be simple or complex, with features like recursion and memoization.

Machine is a workflow/pipeline library for processing data

GitHub

159 stars
7 watching
12 forks
Language: Go
last commit: about 1 month ago
Linked from 2 awesome lists

codespacesgithub-actionsgolanggolang-librarygolang-packagegolangci-lintmit-licensepipelinepipeline-frameworkstream-processingstreaming-dataworkflowworkflow-engine

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
scipipe/scipipe A flexible and efficient way to write and run complex workflows using Go programming language 1,081
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
shenwei356/rush A command-line tool for executing jobs in parallel with customizable features and support for multiple platforms. 890
temporalio/sdk-go A framework for building and executing long-running business logic in a scalable and resilient way. 550
ryan-allen/workflow A Ruby state machine library that models and interacts with workflows in a finite-state-machine-inspired API. 233
fieldryand/goflow A lightweight, single-binary DAG scheduler and dashboard for orchestrating workflows with tasks and operators 396
insitro/redun A workflow engine that allows complex data flows to be defined and executed in a flexible and efficient manner 537
analysiscenter/batchflow A framework for defining and executing data processing and machine learning workflows with support for batch processing, lazy execution, and model training. 202
danielgerlag/jworkflow A lightweight workflow library for Java with pluggable persistence and concurrency support 104
danielgerlag/liteflow A Python library for running workflows with pluggable persistence and concurrency providers. 62
geekq/workflow An API for modeling and interacting with workflow states and transitions in a state-machine-inspired way 1,764
rbarrois/xworkflows A Python module that enables the creation and management of workflows or state machines. 188
runabol/tork A distributed workflow engine for automating complex tasks and workflows. 616
d6t/d6tflow A Python library to build and manage complex data science workflows efficiently 953