mosec
model server
A high-performance ML model serving framework
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
802 stars
13 watching
61 forks
Language: Python
last commit: about 1 month ago
Linked from 1 awesome list
cvdeep-learninggpuhacktoberfestjaxllmllm-servingmachine-learningmachine-learning-platformmlopsmodel-servingmxnetnerual-networkpythonpytorchrusttensorflowtts
Related projects:
Repository | Description | Stars |
---|---|---|
eightbec/fastapi-ml-skeleton | A FastAPI-based framework for serving machine learning models in production-ready applications | 412 |
microsoft/0xdeca10b | A framework for hosting and training machine learning models on a blockchain, enabling secure sharing and prediction without requiring users to pay for data or model updates. | 559 |
mlcommons/inference | Measures the performance of deep learning models in various deployment scenarios. | 1,256 |
openbmb/bmlist | A curated list of large machine learning models tracked over time | 341 |
amplab/velox-modelserver | A system for serving machine learning predictions in real-time and integrating with Spark and KeystoneML. | 110 |
dask/dask-ml | A Python library for scalable machine learning using Dask alongside popular ML libraries | 907 |
hydrospheredata/hydro-serving | A MLOps platform for deploying and versioning machine learning models in production. | 271 |
tensorflow/tfjs | An open-source JavaScript library for training and deploying machine learning models using WebGL acceleration. | 18,533 |
fuxiaoliu/mmc | Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models. | 87 |
balavenkatesh3322/model_deployment | Provides tools and frameworks for deploying machine learning models in production environments | 73 |
oxid15/cascade | A lightweight MLOps library for small teams and individuals to manage machine learning model development lifecycle | 22 |
mpc-msri/ezpc | A software framework for secure machine learning that provides efficient and scalable computation protocols for collaborative data analysis | 406 |
polyaxon/polyaxon | A platform for managing and orchestrating the machine learning lifecycle | 3,581 |
jvalegre/robert | Automated machine learning protocols for cheminformatics using Python | 39 |
seldonio/mlserver | An inference server for machine learning models with support for multiple frameworks and scalable deployment options. | 737 |