pipeline

Machine Learning Pipeline Framework

A comprehensive workflow automation framework for machine learning pipelines, integrating various tools and technologies such as Kubernetes, Kafka, and TensorFlow.

PipelineAI

GitHub

4k stars
344 watching
974 forks
Language: Jsonnet
last commit: 10 months ago
Linked from 2 awesome lists

airflowartificial-intelligencecassandradockergpukafkakeraskubeflowkubernetesmachine-learningneural-networkpipelineaipytorchredisscikit-learnsparktensorflowtfx

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
qubvel/segmentation_models A Python library providing pre-trained neural networks for image segmentation using Keras and TensorFlow frameworks. 4,779
alpacahq/pipeline-live Provides an extension for live trading pipelines using online API data sources. 204
thephpleague/pipeline Provides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner. 965
quickube/piper Automates creation of Kubernetes workflows based on Git branch changes 22
gabriella439/pipes A lightweight stream processing library that builds and connects reusable streaming components using Haskell 489
databiosphere/toil A workflow management system designed to efficiently run pipelines in various environments. 901
pwwang/pipen A Python-based workflow automation framework that enables easy creation of data processing pipelines 105
instill-ai/instill-core An end-to-end AI platform for data, pipeline and model orchestration, streamlining the building of versatile AI applications. 2,181
samapriya/planet-gee-pipeline-cli A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. 42
praetorian-inc/gato An enumeration and attack tool for identifying vulnerabilities in GitHub pipelines. 573
kirillseva/ruigi A tool for designing and managing data processing pipelines in R. 42
mara/mara-pipelines A lightweight ETL framework providing a simple way to define and execute data transformation pipelines using declarative Python code. 2,082
hhio618/golem-ci A decentralized task pipeline on Golem.network using Python. 5
nazar256/parapipe A library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications. 33
rosineygp/mkdkr A framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines. 370