datakit
by moby
Connect processes into powerful data pipelines with a simple git-like filesystem interface
AI summary
Pipeline orchestrator
A tool to orchestrate applications using a version-controlled dataflow
- stars
- 1.1K
- forks
- 153
- watching
- 44
Similar projects
Found by comparing what the projects do, not just their names.
dagster-io/dagster12.1K
Data pipeline orchestrator
An orchestration platform for data pipelines and assets, providing a declarative programming model and integrated lineage and observability.
Pipeline orchestrator
A platform for defining and executing scientific pipelines in distributed environments using C++ and Python.
Pipeline orchestrator
An agile pipeline framework for data engineering teams to track and orchestrate their data processes.
Workflow automator
Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows.
UI toolkit
A toolset for building and testing UI applications using Angular
apache/airflow37.6K
Workflow orchestrator
A platform to programmatically author, schedule and monitor complex workflows
Data pipeline tool
A continuous big data ingestion platform that enables easy creation of data pipelines for various data sources and destinations.
Workflow orchestrator
A tool to orchestrate computational workflows in high-performance computing environments.
DevOps orchestrator
An orchestration platform for automating DevOps workflows by combining tools and services into a single, GUI-based solution
Data pipeline framework
Provides a set of pre-defined data processing pipelines for pandas DataFrames.
Data pipeline manager
A lightweight tool for managing and versioning large data alongside source code in data pipelines
Workflow orchestrator
A Python-based workflow orchestration system built on top of AWS tools and services.
Pipeline manager
A package implementing pipelines using goroutines to manage concurrency in Go applications.
Data pipeline engine
A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines
Container assembler
Enables and accelerates software containerization by providing a modular framework for assembling custom systems
