mosec
model server
A high-performance ML model serving framework
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
802 stars
13 watching
61 forks
Language: Python
last commit: 4 months ago
Linked from 1 awesome list
cvdeep-learninggpuhacktoberfestjaxllmllm-servingmachine-learningmachine-learning-platformmlopsmodel-servingmxnetnerual-networkpythonpytorchrusttensorflowtts
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 eightbec/fastapi-ml-skeleton | A FastAPI-based framework for serving machine learning models in production-ready applications | 412 |
 microsoft/0xdeca10b | A framework for hosting and training machine learning models on a blockchain, enabling secure sharing and prediction without requiring users to pay for data or model updates. | 559 |
 mlcommons/inference | Measures the performance of deep learning models in various deployment scenarios. | 1,256 |
 openbmb/bmlist | A curated list of large machine learning models tracked over time | 341 |
 amplab/velox-modelserver | A system for serving machine learning predictions in real-time and integrating with Spark and KeystoneML. | 110 |
 dask/dask-ml | A Python library for scalable machine learning using Dask alongside popular ML libraries | 907 |
 hydrospheredata/hydro-serving | A MLOps platform for deploying and versioning machine learning models in production. | 271 |
 tensorflow/tfjs | An open-source JavaScript library for training and deploying machine learning models using WebGL acceleration. | 18,533 |
 fuxiaoliu/mmc | Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models. | 87 |
 balavenkatesh3322/model_deployment | Provides tools and frameworks for deploying machine learning models in production environments | 73 |
 oxid15/cascade | A lightweight MLOps library for small teams and individuals to manage machine learning model development lifecycle | 22 |
 mpc-msri/ezpc | A software framework for secure machine learning that provides efficient and scalable computation protocols for collaborative data analysis | 406 |
 polyaxon/polyaxon | A platform for managing and orchestrating the machine learning lifecycle | 3,581 |
 jvalegre/robert | Automated machine learning protocols for cheminformatics using Python | 39 |
 seldonio/mlserver | An inference server for machine learning models with support for multiple frameworks and scalable deployment options. | 737 |