FastDeploy
Model deployer
A toolkit for easy and high-performance deployment of deep learning models on various hardware platforms
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
3k stars
55 watching
465 forks
Language: C++
last commit: 2 months ago androidgraphcoreinteljetsonkunlunobject-detectiononnxonnxruntimeopenvinopicodetrockchipservingstable-diffusiontensorrtuieyolov5yolov8
Related projects:
| Repository | Description | Stars |
|---|---|---|
| paddlepaddle/paddle | A high-performance deep learning framework designed for industrial-scale training and deployment of neural networks. | 22,340 |
 open-mmlab/mmdeploy | A toolset for deploying deep learning models on various devices and platforms | 2,797 |
| paddlepaddle/paddlegan | A comprehensive library for building and training generative adversarial networks (GANs) and other deep learning models. | 7,935 |
 ultralytics/yolov5 | A comprehensive framework for object detection and image analysis using deep learning models | 51,418 |
| ultralytics/yolov3 | A deep learning framework providing object detection capabilities through a neural network architecture | 10,260 |
 luodian/otter | A multi-modal AI model developed for improved instruction-following and in-context learning, utilizing large-scale architectures and various training datasets. | 3,570 |
 microsoft/deepspeed | A deep learning optimization library that simplifies distributed training and inference on modern computing hardware. | 35,863 |
 thu-mig/yolov10 | Real-time object detection using a neural network architecture | 10,116 |
 roboflow/inference | A platform for deploying and fine-tuning computer vision models in production-ready environments. | 1,401 |
 sgl-project/sglang | A fast serving framework for large language models and vision language models. | 6,551 |
 rangilyu/nanodet | A lightweight object detection model designed for efficient inference on mobile devices and edge AI applications. | 5,796 |
 jolibrain/deepdetect | A machine learning API and server written in C++ that supports multiple deep learning libraries and provides a flexible interface for building and deploying machine learning models. | 2,520 |
| paddlepaddle/parl | A high-performance distributed training framework for Reinforcement Learning | 3,296 |
| ultralytics/ultralytics | A deep learning framework providing models and tools for object detection, image classification, segmentation, and tracking using YOLO. | 33,951 |
 flagai-open/flagai | An open-source toolkit for training and deploying large-scale AI models on various downstream tasks with multi-modality | 3,840 |