prodmodel
Pipeline manager
A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance.
Build, test, deploy, iterate - Dev and prod tool for data science pipelines
58 stars
3 watching
3 forks
Language: Python
last commit: over 2 years ago
Linked from 4 awesome lists
build-automationbuild-systembuild-tooldatadata-sciencedataengdataengineeringdatascienceproductionproductivity
Related projects:
Repository | Description | Stars |
---|---|---|
| A lightweight tool for managing and versioning large data alongside source code in data pipelines | 184 |
| A tool for running and managing bioinformatics pipelines by abstracting away low-level details and providing features such as dependency tracking, transactional management, and parallelism. | 233 |
| A tool for creating flexible and self-documenting data science pipelines | 56 |
| A bioinformatics pipeline system that supports running workflow stages on a distributed compute cluster. | 38 |
| A distributed framework for building and managing complex machine learning pipelines with a user-friendly interface. | 188 |
| A platform for data-intensive scientific analysis and workflow management | 1,431 |
| A Python library for managing and optimizing computational workflows with parallel processing and data reuse. | 22 |
| A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. | 42 |
| A distributed system for streaming data between heterogeneous systems with high reliability and throughput at scale | 931 |
| A framework for building and managing CI/CD pipelines and application environments with cryptographic signed dependencies. | 461 |
| A package implementing pipelines using goroutines to manage concurrency in Go applications. | 56 |
| A comprehensive pipeline management system for VFX, animation, and game production workflows | 249 |
| A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments | 89 |
| A framework for defining and automating bioinformatics pipelines using Nextflow. | 44 |
| A workflow management system designed to efficiently run pipelines in various environments. | 901 |