mosec

model server

A high-performance ML model serving framework

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

GitHub

802 stars
13 watching
61 forks
Language: Python
last commit: about 1 month ago
Linked from 1 awesome list

cvdeep-learninggpuhacktoberfestjaxllmllm-servingmachine-learningmachine-learning-platformmlopsmodel-servingmxnetnerual-networkpythonpytorchrusttensorflowtts

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
eightbec/fastapi-ml-skeleton A FastAPI-based framework for serving machine learning models in production-ready applications 412
microsoft/0xdeca10b A framework for hosting and training machine learning models on a blockchain, enabling secure sharing and prediction without requiring users to pay for data or model updates. 559
mlcommons/inference Measures the performance of deep learning models in various deployment scenarios. 1,256
openbmb/bmlist A curated list of large machine learning models tracked over time 341
amplab/velox-modelserver A system for serving machine learning predictions in real-time and integrating with Spark and KeystoneML. 110
dask/dask-ml A Python library for scalable machine learning using Dask alongside popular ML libraries 907
hydrospheredata/hydro-serving A MLOps platform for deploying and versioning machine learning models in production. 271
tensorflow/tfjs An open-source JavaScript library for training and deploying machine learning models using WebGL acceleration. 18,533
fuxiaoliu/mmc Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models. 87
balavenkatesh3322/model_deployment Provides tools and frameworks for deploying machine learning models in production environments 73
oxid15/cascade A lightweight MLOps library for small teams and individuals to manage machine learning model development lifecycle 22
mpc-msri/ezpc A software framework for secure machine learning that provides efficient and scalable computation protocols for collaborative data analysis 406
polyaxon/polyaxon A platform for managing and orchestrating the machine learning lifecycle 3,581
jvalegre/robert Automated machine learning protocols for cheminformatics using Python 39
seldonio/mlserver An inference server for machine learning models with support for multiple frameworks and scalable deployment options. 737