onnxruntime-inference-examples
Inference framework
Repository providing examples for using ONNX Runtime (ORT) to perform machine learning inferencing.
Examples for using ONNX Runtime for machine learning inferencing.
1k stars
38 watching
337 forks
Language: C++
last commit: 17 days ago Related projects:
| Repository | Description | Stars |
|---|---|---|
| microsoft/onnxruntime-training-examples | Accelerates training of large transformer models by providing optimized kernels and memory optimizations. | 312 |
| microsoft/onnxruntime | An open source software framework for high-performance machine learning inference and training acceleration | 14,697 |
 mlcommons/inference | Measures the performance of deep learning models in various deployment scenarios. | 1,236 |
 xboot/libonnx | A lightweight onnx inference engine for embedded devices with hardware acceleration support | 583 |
 alrevuelta/connxr | An embedded device-friendly C ONNX runtime with zero dependencies | 193 |
 triton-inference-server/client | Client libraries and examples for communicating with Triton using various programming languages | 567 |
 tpoisonooo/llama.onnx | A project providing onnx models and tools for inference with LLaMa transformer model on various devices | 352 |
 kraiskil/onnx2c | Generates C code from ONNX files for efficient neural network inference on microcontrollers | 223 |
 emergentorder/onnx-scala | An API and backend for running ONNX models in Scala 3 using typeful, functional deep learning and classical machine learning. | 138 |
 sassoftware/enlighten-apply | Provides code and materials to apply SAS machine learning techniques in software development | 126 |
 nilseuropa/ros_ncnn | A ROS wrapper for NCNN, allowing developers to integrate high-performance neural network inference into ROS projects | 63 |
 oramasearch/onnx-go | A Go package that allows developers to import pre-trained neural network models without being tied to a framework or library. | 715 |
 roboflow/inference | A platform for deploying and fine-tuning computer vision models in production-ready environments. | 1,363 |
| microsoft/0xdeca10b | A framework for hosting and training machine learning models on a blockchain, enabling secure sharing and prediction without requiring users to pay for data or model updates. | 556 |