pipeline
Machine Learning Pipeline Framework
A comprehensive workflow automation framework for machine learning pipelines, integrating various tools and technologies such as Kubernetes, Kafka, and TensorFlow.
PipelineAI
4k stars
344 watching
974 forks
Language: Jsonnet
last commit: 10 months ago
Linked from 2 awesome lists
airflowartificial-intelligencecassandradockergpukafkakeraskubeflowkubernetesmachine-learningneural-networkpipelineaipytorchredisscikit-learnsparktensorflowtfx
Related projects:
Repository | Description | Stars |
---|---|---|
qubvel/segmentation_models | A Python library providing pre-trained neural networks for image segmentation using Keras and TensorFlow frameworks. | 4,779 |
alpacahq/pipeline-live | Provides an extension for live trading pipelines using online API data sources. | 204 |
thephpleague/pipeline | Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. | 965 |
quickube/piper | Automates creation of Kubernetes workflows based on Git branch changes | 22 |
gabriella439/pipes | A lightweight stream processing library that builds and connects reusable streaming components using Haskell | 489 |
databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
pwwang/pipen | A Python-based workflow automation framework that enables easy creation of data processing pipelines | 105 |
instill-ai/instill-core | An end-to-end AI platform for data, pipeline and model orchestration, streamlining the building of versatile AI applications. | 2,181 |
samapriya/planet-gee-pipeline-cli | A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. | 42 |
praetorian-inc/gato | An enumeration and attack tool for identifying vulnerabilities in GitHub pipelines. | 573 |
kirillseva/ruigi | A tool for designing and managing data processing pipelines in R. | 42 |
mara/mara-pipelines | A lightweight ETL framework providing a simple way to define and execute data transformation pipelines using declarative Python code. | 2,082 |
hhio618/golem-ci | A decentralized task pipeline on Golem.network using Python. | 5 |
nazar256/parapipe | A library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications. | 33 |
rosineygp/mkdkr | A framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines. | 370 |