ograph

Pipeline framework

A framework for building data pipelines with concurrent execution and dependency management

【Go DAG Schedule Framework】A simple way to build a pipeline with Go.

GitHub

32 stars
1 watching
3 forks
Language: Go
last commit: about 1 month ago
cgraphdagframeworkgolanggraphparallel-computingpipelinetaskflowworkflow-engine

Related projects:

Repository Description Stars
rhosocial/go-dag A framework for managing and executing workflows described by directed acyclic graphs. 21
chunelfeng/cgraph A C++ framework for building directed acyclic graph-based parallel computations with dependency and scheduling management 1,779
pipefunc/pipefunc Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows. 215
m3dev/gokart A framework that solves common problems in machine learning pipeline development and provides an environment for reproducibility and team collaboration. 318
acdemiralp/fg An abstracted rendering pipeline framework describing frames as directed acyclic graphs of render tasks and resources. 544
giacbrd/smartpipeline A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency 23
noneback/go-taskflow A taskflow-like framework for parallel programming in Go with integrated visualization and profiling tools. 124
tochemey/goakt A distributed actor framework for building reactive and scalable systems in Golang using protocol buffers. 189
destel/rill A toolkit for building concurrent programs by composing simple, reusable parts into clean pipelines. 510
dagworks-inc/hamilton Helps define and manage data transformations with a modular, self-documenting, and portable framework for directed acyclic graphs (DAGs) of data transformations. 1,861
hhio618/golem-ci A decentralized task pipeline on Golem.network using Python. 5
paysure/orinoco A functional composable pipeline framework for Python that separates business logic from implementation. 11
hmdsefi/gograph A Go library for creating and manipulating graphs of various types 67
fieldryand/goflow A lightweight, single-binary DAG scheduler and dashboard for orchestrating workflows with tasks and operators 386
componego/componego A framework for building modular applications by separating code into interchangeable components 26