machine

Data workflow library

A library for creating data workflows that can be simple or complex, with features like recursion and memoization.

Machine is a workflow/pipeline library for processing data

GitHub

158 stars
7 watching
12 forks
Language: Go
last commit: 13 days ago
Linked from 2 awesome lists

codespacesgithub-actionsgolanggolang-librarygolang-packagegolangci-lintmit-licensepipelinepipeline-frameworkstream-processingstreaming-dataworkflowworkflow-engine

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
scipipe/scipipe A flexible and efficient way to write and run complex workflows using Go programming language 1,075
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
shenwei356/rush A command-line tool for executing jobs in parallel with customizable features and support for multiple platforms. 882
temporalio/sdk-go A framework for building and executing long-running business logic in a scalable and resilient way. 539
ryan-allen/workflow A Ruby state machine library that models and interacts with workflows in a finite-state-machine-inspired API. 233
fieldryand/goflow A lightweight, single-binary DAG scheduler and dashboard for orchestrating workflows with tasks and operators 386
insitro/redun A workflow engine that allows complex data flows to be defined and executed in a flexible and efficient manner 522
analysiscenter/batchflow A framework for defining and executing data processing and machine learning workflows with support for batch processing, lazy execution, and model training. 201
danielgerlag/jworkflow A lightweight workflow library for Java with pluggable persistence and concurrency support 101
danielgerlag/liteflow A Python library for running workflows with pluggable persistence and concurrency providers. 61
geekq/workflow An API for modeling and interacting with workflow states and transitions in a state-machine-inspired way 1,763
uber-go/cadence-client A framework for executing long-running business logic in a scalable and resilient way using the Cadence orchestration engine 349
rbarrois/xworkflows A Python module that enables the creation and management of workflows or state machines. 188
runabol/tork A distributed workflow engine for automating complex tasks and workflows. 599
d6t/d6tflow A Python library to build and manage complex data science workflows efficiently 952