nndeploy
Model deployer
An end-to-end model deployment framework providing cross-platform simplicity and high performance
nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。
662 stars
24 watching
102 forks
Language: C++
last commit: 1 day ago ascendeasy-to-usehpcmnnmodel-deploymentmulti-inferenceopenvinoout-of-box-modelparallelrknntensorrtyolo
Related projects:
| Repository | Description | Stars |
|---|---|---|
 ebhy/budgetml | Simplifies deployment of machine learning models to production-ready endpoints with minimal configuration and cost. | 1,341 |
 balavenkatesh3322/model_deployment | Provides tools and frameworks for deploying machine learning models in production environments | 73 |
 pcaversaccio/xdeployer | A tool to deploy smart contracts across multiple EVM chains with the same deterministic address | 440 |
 riga/tfdeploy | Deploying TensorFlow graphs for efficient evaluation in non-TensorFlow environments | 353 |
 tensorchord/modelz-chatglm | Provides code for deploying a large-scale pre-trained language model on Modelz. | 15 |
 ramblingcookiemonster/psdeploy | A module to automate deployments using PowerShell scripts | 348 |
 roboflow/inference | A platform for deploying and fine-tuning computer vision models in production-ready environments. | 1,401 |
 tensorflow/tflite-support | A toolkit to deploy machine learning models on mobile devices using the TensorFlow Lite framework | 381 |
 ankane/trove | A tool that allows developers to deploy and manage machine learning models in Ruby applications | 67 |
 serokell/deploy-rs | A tool for deploying and managing multi-profile Nix configurations | 1,429 |
 newrelic/centurion | A tool for automating the deployment of Docker containers to a fleet of hosts | 1,756 |
 b1n4he/movementdeploy | Automated deployment of smart contracts for movement automation and M1 testing network | 51 |
 rebelinblue/deployer | A tool that automates the deployment of PHP applications to multiple servers via SSH. | 915 |
 talkdai/dialog | An application framework to simplify the deployment and testing of large language models (LLMs) for natural language processing tasks. | 380 |
 ttiny/deploy | A tool for automating the deployment of Docker containers from Git repositories | 56 |