dagster
by dagster-io
An orchestration platform for the development, production, and observation of data assets.
AI summary
Data pipeline orchestrator
An orchestration platform for data pipelines and assets, providing a declarative programming model and integrated lineage and observability.
- stars
- 12.1K
- forks
- 1.5K
- watching
- 124
- awesome lists
- 10
Similar projects
Found by comparing what the projects do, not just their names.
moby/datakit1.1K
Pipeline orchestrator
A tool to orchestrate applications using a version-controlled dataflow
Pipeline orchestrator
An agile pipeline framework for data engineering teams to track and orchestrate their data processes.
Workflow automator
Automates and simplifies the creation of function pipelines for efficient execution of scientific workflows.
Pipeline orchestrator
A platform for defining and executing scientific pipelines in distributed environments using C++ and Python.
Data pipeline tool
A continuous big data ingestion platform that enables easy creation of data pipelines for various data sources and destinations.
apache/airflow37.6K
Workflow orchestrator
A platform to programmatically author, schedule and monitor complex workflows
DevOps orchestrator
An orchestration platform for automating DevOps workflows by combining tools and services into a single, GUI-based solution
Dataflow framework
Helps define and manage data transformations with a modular, self-documenting, and portable framework for directed acyclic graphs (DAGs) of data transformations.
Stream processor
A utility and developer library for data streams catching and aggregation
Workflow orchestrator
A distributed workflow management system that coordinates services and scripts into complex workflows.
Analysis tool
A platform for data-intensive scientific analysis and workflow management
Application orchestrator
A Mesos scheduler that enables deployment and management of long-running applications with high availability and scalability.
Data pipeline manager
A lightweight tool for managing and versioning large data alongside source code in data pipelines
Workflow orchestrator
Provides a unified interface for constructing and managing workflows across different workflow engines.
Data pipeline manager
A toolbox for industrial data analytics and stream processing
Featured in 10 awesome lists
Each link jumps to the spot where the list mentions dagster.
