kserve
ML server
A platform for serving machine learning models on Kubernetes with support for scalability, performance, and integration with various frameworks.
Standardized Serverless ML Inference Platform on Kubernetes
4k stars
64 watching
1k forks
Language: Python
last commit: 6 days ago
Linked from 3 awesome lists
artificial-intelligencegenaihacktoberfestistiok8sknativekservekubeflowkubernetesllm-inferencemachine-learningmlopsmodel-interpretabilitymodel-servingpytorchservice-meshsklearntensorflowxgboost
ethicalml/awesome-production-machine-learning
kelvins/awesome-mlops
rootsongjc/awesome-cloud-nativeRelated projects:
| Repository | Description | Stars |
|---|---|---|
 deploykf/deploykf | Builds machine learning platforms on Kubernetes by combining popular tools and services | 376 |
 kubeflow/pipelines | A tool for building and managing machine learning workflows on Kubernetes. | 3,614 |
 tensorflow/serving | A high-performance serving system for machine learning models in production environments. | 6,185 |
| kubeflow/kubeflow | An ecosystem of Kubernetes-based components for each stage in the AI/ML lifecycle | 14,386 |
 knative/serving | A Kubernetes-based platform for deploying and serving scalable applications as serverless containers | 5,573 |
| kubeflow/katib | Automated machine learning on Kubernetes using a framework-agnostic approach | 1,509 |
 seldonio/mlserver | An inference server for machine learning models with support for multiple frameworks and scalable deployment options. | 720 |
 mlflow/mlflow | A platform to manage the entire machine learning lifecycle, from experiment tracking to model deployment. | 18,781 |
 aws-samples/machine-learning-using-k8s | Demystifies deploying machine learning models on Kubernetes | 163 |
 kubernetes/kube-state-metrics | Generates metrics about the state of Kubernetes objects without modifying the API | 5,432 |
 sarus-tech/tf2-published-models | Implementations of classical machine learning models using TensorFlow 2 and Keras API. | 38 |
| kubernetes/kubernetes | A system for managing containerized applications across multiple hosts | 111,105 |
| kubernetes/kops | Automates creation, upgrade, and management of production-grade Kubernetes clusters on multiple cloud providers. | 15,968 |
 kaiwaehner/ksql-udf-deep-learning-mqtt-iot | Develops UDFs for anomaly detection in IoT sensor data using deep learning and KSQL streaming analytics. | 289 |