model_deployment
Model deployment framework
Provides tools and frameworks for deploying machine learning models in production environments
A collection of model deployment library and technique.
73 stars
3 watching
9 forks
last commit: over 4 years ago
Linked from 1 awesome list
awsazurecaffedata-sciencedeep-learningkerasmachine-learningmodelmodel-deploymentmodel-servermodel-servingmxnetneural-networkpytorchservingserving-pytorch-modelsserving-recommendationserving-tensorstensorflow
Related projects:
| Repository | Description | Stars |
|---|---|---|
 aws-samples/machine-learning-using-k8s | Demystifies deploying machine learning models on Kubernetes | 163 |
 roboflow/inference | A platform for deploying and fine-tuning computer vision models in production-ready environments. | 1,401 |
 deploykf/deploykf | Builds machine learning platforms on Kubernetes by combining popular tools and services | 381 |
 caraml-dev/merlin | A platform for deploying and serving machine learning models in a scalable, cost-efficient, and easy-to-use manner | 168 |
 ebhy/budgetml | Simplifies deployment of machine learning models to production-ready endpoints with minimal configuration and cost. | 1,341 |
 tensorflow/tflite-support | A toolkit to deploy machine learning models on mobile devices using the TensorFlow Lite framework | 381 |
 combust/mleap | Enables deployment of machine learning pipelines from Spark and Scikit-Learn to production | 1,506 |
 ankane/trove | A tool that allows developers to deploy and manage machine learning models in Ruby applications | 67 |
 run-llama/llama_deploy | An async-first framework for deploying and scaling agentic multi-service systems | 1,876 |
 nndeploy/nndeploy | An end-to-end model deployment framework providing cross-platform simplicity and high performance | 662 |
 microsoft/0xdeca10b | A framework for hosting and training machine learning models on a blockchain, enabling secure sharing and prediction without requiring users to pay for data or model updates. | 559 |
 mosecorg/mosec | A high-performance ML model serving framework | 802 |
 deepset-ai/farm | An open-source framework for adapting representation models to various tasks and industries | 1,743 |
 mlcommons/inference | Measures the performance of deep learning models in various deployment scenarios. | 1,256 |
 techytushar/techytushar | Building and deploying Machine Learning models for production use | 56 |