pipeline
Machine Learning Pipeline Framework
A comprehensive workflow automation framework for machine learning pipelines, integrating various tools and technologies such as Kubernetes, Kafka, and TensorFlow.
PipelineAI
4k stars
344 watching
974 forks
Language: Jsonnet
last commit: 7 months ago
Linked from 2 awesome lists
airflowartificial-intelligencecassandradockergpukafkakeraskubeflowkubernetesmachine-learningneural-networkpipelineaipytorchredisscikit-learnsparktensorflowtfx
ahundt/awesome-robotics
anant/awesome-cassandraRelated projects:
| Repository | Description | Stars |
|---|---|---|
 qubvel/segmentation_models | A Python library providing pre-trained neural networks for image segmentation using Keras and TensorFlow frameworks. | 4,762 |
 alpacahq/pipeline-live | Provides an extension for live trading pipelines using online API data sources. | 205 |
 thephpleague/pipeline | Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. | 960 |
 quickube/piper | Automates creation of Kubernetes workflows based on Git branch changes | 21 |
 gabriella439/pipes | A lightweight stream processing library that builds and connects reusable streaming components using Haskell | 489 |
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 pwwang/pipen | A Python-based workflow automation framework that enables easy creation of data processing pipelines | 103 |
 instill-ai/instill-core | A comprehensive AI infrastructure tool that streamlines data, model, and pipeline orchestration | 2,147 |
 samapriya/planet-gee-pipeline-cli | A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. | 42 |
 praetorian-inc/gato | An enumeration and attack tool for identifying vulnerabilities in GitHub pipelines. | 570 |
 kirillseva/ruigi | A tool for designing and managing data processing pipelines in R. | 42 |
 mara/mara-pipelines | A lightweight ETL framework providing a simple way to define and execute data transformation pipelines using declarative Python code. | 2,081 |
 hhio618/golem-ci | A decentralized task pipeline on Golem.network using Python. | 5 |
 nazar256/parapipe | A non-blocking buffered pipeline library that allows concurrent processing of data while maintaining output order without locks or mutexes. | 31 |
 rosineygp/mkdkr | A framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines. | 369 |