libonnx
by xboot
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
AI summary
Inference engine
An onnx inference engine for embedded devices with hardware acceleration support
- stars
- 589
- forks
- 108
- watching
- 28
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
xilinx/finn770
FPGA accelerator
Fast and scalable neural network inference framework for FPGAs.
Inference engine
A machine learning inference engine designed to be portable and efficient for embedded systems with minimal dependencies.
ONNX runtime
An embedded device-friendly C ONNX runtime with zero dependencies
LLaMa inference toolset
A project providing onnx models and tools for inference with LLaMa transformer model on various devices
Inference framework
Repository providing examples for using ONNX Runtime (ORT) to perform machine learning inferencing.
Inferencing Engine
Provides a lightweight neural network inferencing engine for real-time systems
Inference accelerator
A Python library designed to accelerate model inference with high-throughput and low latency capabilities
ONNX compiler
Generates C code from ONNX files for efficient neural network inference on microcontrollers
Deep Learning Engine
An API and backend for running ONNX models in Scala 3 using typeful, functional deep learning and classical machine learning.
Neural FPGA design
Designs and deploys neural networks integrated with Xilinx FPGAs for high-throughput applications
utensor/utensor1.7K
ML inference library
A lightweight machine learning inference framework built on Tensorflow optimized for Arm targets.
xmartlabs/bender1.8K
Neural network runner
An abstraction layer for building and running neural networks on iOS using MetalPerformanceShaders and pre-trained models.
Hardware-aware NAS
Direct neural architecture search on target task and hardware for efficient model deployment
Inference optimizer
A deep learning method for optimizing convolutional neural networks by reducing computational cost while improving regularization and inference efficiency.
Analysis toolkit
A toolbox to help understand neural networks' predictions by providing different analysis methods and a common interface.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions libonnx.
