mdf
Data-flow programming engine
A toolkit for expressing programs as directed acyclic graphs and wiring together computations over time-series data.
Data-flow programming toolkit for Python
169 stars
29 watching
53 forks
Language: Python
last commit: almost 8 years ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 nipype/pydra | A lightweight Python dataflow engine for building and executing directed acyclic graphs (DAGs) in a scalable manner. | 120 |
 dagworks-inc/hamilton | Helps define and manage data transformations with a modular, self-documenting, and portable framework for directed acyclic graphs (DAGs) of data transformations. | 1,861 |
 mhkit-software/mhkit-python | Provides tools and functionality for data processing and visualization in marine renewable energy applications. | 51 |
 mroberge/hydrofunctions | A suite of convenience functions for exploring and visualizing hydrology data | 66 |
 mehd-io/pypi-duck-flow | A project to build data pipelines and visualizations for analyzing Python package download data from PyPi. | 148 |
 eclipse-zenoh-flow/zenoh-flow | A framework for declarative data flow programming and edge computing | 91 |
 johnsonc/lambdo | A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines | 1 |
 usepa/fedelemflowlist | Generates and provides standardized elementary flow lists for life cycle assessment data conversion | 34 |
 d6t/d6tflow | A Python library to build and manage complex data science workflows efficiently | 952 |
 deqitang/pymatflow | Automates preparation and submission of DFT calculations for materials science simulations | 5 |
 giacbrd/smartpipeline | A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency | 23 |
 log2timeline/dftimewolf | A framework for orchestrating data collection, processing, and export | 296 |
 secure-software-engineering/flowdroid | Analyzes data flows in software to identify potential security vulnerabilities and weaknesses. | 1,064 |
 streamlet-dev/tributary | A Python library for constructing dataflow graphs with support for reactive and lazy evaluation. | 442 |
 huggingface/datatrove | A platform-agnostic data processing framework for large-scale text data pipelines | 2,043 |