pipeline

Machine Learning Pipeline Framework

A comprehensive workflow automation framework for machine learning pipelines, integrating various tools and technologies such as Kubernetes, Kafka, and TensorFlow.

PipelineAI

GitHub

4k stars
344 watching
974 forks
Language: Jsonnet
last commit: over 2 years ago
Linked from 2 awesome lists

airflowartificial-intelligencecassandradockergpukafkakeraskubeflowkubernetesmachine-learningneural-networkpipelineaipytorchredisscikit-learnsparktensorflowtfx

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
qubvel/segmentation_modelsA Python library providing pre-trained neural networks for image segmentation using Keras and TensorFlow frameworks.4,779
alpacahq/pipeline-liveProvides an extension for live trading pipelines using online API data sources.204
thephpleague/pipelineProvides a flexible pipeline pattern implementation to compose sequential stages and process payloads in a composable manner.965
quickube/piperAutomates creation of Kubernetes workflows based on Git branch changes22
gabriella439/pipesA lightweight stream processing library that builds and connects reusable streaming components using Haskell489
databiosphere/toilA workflow management system designed to efficiently run pipelines in various environments.901
pwwang/pipenA Python-based workflow automation framework that enables easy creation of data processing pipelines105
instill-ai/instill-coreAn end-to-end AI platform for data, pipeline and model orchestration, streamlining the building of versatile AI applications.2,181
samapriya/planet-gee-pipeline-cliA command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine.42
praetorian-inc/gatoAn enumeration and attack tool for identifying vulnerabilities in GitHub pipelines.573
kirillseva/ruigiA tool for designing and managing data processing pipelines in R.42
mara/mara-pipelinesA lightweight ETL framework providing a simple way to define and execute data transformation pipelines using declarative Python code.2,082
hhio618/golem-ciA decentralized task pipeline on Golem.network using Python.5
nazar256/parapipeA library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications.33
rosineygp/mkdkrA framework that allows developers to build and run CI/CD pipelines using a Makefile and Docker, with support for various pipeline engines.370