FastDeploy
Model deployer
A toolkit for easy and high-performance deployment of deep learning models on various hardware platforms
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
3k stars
54 watching
465 forks
Language: C++
last commit: 6 days ago androidgraphcoreinteljetsonkunlunobject-detectiononnxonnxruntimeopenvinopicodetrockchipservingstable-diffusiontensorrtuieyolov5yolov8
Related projects:
| Repository | Description | Stars |
|---|---|---|
| paddlepaddle/paddle | A high-performance deep learning framework designed for industrial-scale training and deployment of neural networks. | 22,278 |
 open-mmlab/mmdeploy | A toolset for deploying deep learning models on various devices and platforms | 2,774 |
| paddlepaddle/paddlegan | A comprehensive library for building and training generative adversarial networks (GANs) and other deep learning models. | 7,902 |
 ultralytics/yolov5 | A comprehensive framework for object detection and image analysis using deep learning models | 51,015 |
| ultralytics/yolov3 | A deep learning framework providing object detection capabilities through a neural network architecture | 10,236 |
 luodian/otter | A multi-modal AI model developed for improved instruction-following and in-context learning, utilizing large-scale architectures and various training datasets. | 3,563 |
 microsoft/deepspeed | A deep learning optimization library that makes distributed training and inference easy, efficient, and effective. | 35,545 |
 thu-mig/yolov10 | Real-time object detection using a neural network architecture | 9,987 |
 roboflow/inference | A platform for deploying and fine-tuning computer vision models in production-ready environments. | 1,371 |
 sgl-project/sglang | A framework for serving large language models and vision models with efficient runtime and flexible interface. | 6,082 |
 rangilyu/nanodet | A lightweight object detection model designed for efficient inference on mobile devices and edge AI applications. | 5,769 |
 jolibrain/deepdetect | A machine learning API and server written in C++ that supports multiple deep learning libraries and provides a flexible interface for building and deploying machine learning models. | 2,519 |
| paddlepaddle/parl | A high-performance distributed training framework for Reinforcement Learning | 3,273 |
| ultralytics/ultralytics | A deep learning framework for object detection and tracking tasks using the YOLO model architecture. | 32,910 |
 flagai-open/flagai | An open-source toolkit for training and deploying large-scale AI models on various downstream tasks with multi-modality | 3,830 |