machine

Data workflow library

A library for creating data workflows that can be simple or complex, with features like recursion and memoization.

Machine is a workflow/pipeline library for processing data

GitHub

159 stars
7 watching
12 forks
Language: Go
last commit: almost 2 years ago
Linked from 2 awesome lists

codespacesgithub-actionsgolanggolang-librarygolang-packagegolangci-lintmit-licensepipelinepipeline-frameworkstream-processingstreaming-dataworkflowworkflow-engine

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
scipipe/scipipeA flexible and efficient way to write and run complex workflows using Go programming language1,081
databiosphere/toilA workflow management system designed to efficiently run pipelines in various environments.901
shenwei356/rushA command-line tool for executing jobs in parallel with customizable features and support for multiple platforms.890
temporalio/sdk-goA framework for building and executing long-running business logic in a scalable and resilient way.550
ryan-allen/workflowA Ruby state machine library that models and interacts with workflows in a finite-state-machine-inspired API.233
fieldryand/goflowA lightweight, single-binary DAG scheduler and dashboard for orchestrating workflows with tasks and operators396
insitro/redunA workflow engine that allows complex data flows to be defined and executed in a flexible and efficient manner537
analysiscenter/batchflowA framework for defining and executing data processing and machine learning workflows with support for batch processing, lazy execution, and model training.202
danielgerlag/jworkflowA lightweight workflow library for Java with pluggable persistence and concurrency support104
danielgerlag/liteflowA Python library for running workflows with pluggable persistence and concurrency providers.62
geekq/workflowAn API for modeling and interacting with workflow states and transitions in a state-machine-inspired way1,764
rbarrois/xworkflowsA Python module that enables the creation and management of workflows or state machines.188
runabol/torkA distributed workflow engine for automating complex tasks and workflows.616
d6t/d6tflowA Python library to build and manage complex data science workflows efficiently953