MLServer
by SeldonIO
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
AI summary
Inference server
An inference server for machine learning models with support for multiple frameworks and scalable deployment options.
- stars
- 737
- forks
- 184
- watching
- 28
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
ML deployment platform
A platform for deploying machine learning models into production on-premise or in the cloud using Kubernetes and various machine learning frameworks.
ML deployment platform
Platform to deploy machine learning models on Kubernetes at scale
Triton client libraries
Client libraries and examples for communicating with Triton using various programming languages
MLOps framework
An MLOps framework for packaging, deploying, and managing machine learning models on Kubernetes at scale
ML pipeline manager
An MLOps Python library that enables data scientists to deploy and orchestrate machine learning pipelines for production-ready inference.
Model deployment hub
A platform for deploying and fine-tuning computer vision models in production-ready environments.
Prediction server
A system for serving machine learning predictions in real-time and integrating with Spark and KeystoneML.
Model benchmarking suite
Measures the performance of deep learning models in various deployment scenarios.
model server
A high-performance ML model serving framework
ML server framework
A FastAPI-based framework for serving machine learning models in production-ready applications
aria42/infer176
ML library
A Clojure-based library for building machine learning and statistical models in a flexible and composable way.
ebhy/budgetml1.3K
Model deployer
Simplifies deployment of machine learning models to production-ready endpoints with minimal configuration and cost.
utensor/utensor1.7K
ML inference library
A lightweight machine learning inference framework built on Tensorflow optimized for Arm targets.
Model serving platform
A MLOps platform for deploying and versioning machine learning models in production.
Cheminformatics toolkit
Automated machine learning protocols for cheminformatics using Python
Featured in 1 awesome list
Each link jumps to the spot where the list mentions MLServer.
