TNN
by Tencent
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
AI summary
NLP/inference framework
A high-performance neural network inference framework supporting various deep learning frameworks and hardware platforms.
- stars
- 4.4K
- forks
- 769
- watching
- 91
Similar projects
Found by comparing what the projects do, not just their names.
Mobile DL framework
An optimized framework for deploying deep learning models on mobile devices.
alibaba/mnn8.8K
Deep learning framework
A lightweight deep learning framework developed by Alibaba for efficient inference and training of neural networks on-device.
Transformer model
A PyTorch model definition and inference/sampling code repository for a powerful diffusion transformer with fine-grained Chinese understanding
Model compressor
A framework that automatically compresses and accelerates deep learning models to make them suitable for mobile devices with limited computational resources.
tflearn/tflearn9.6K
Deep Learning Library
A high-level API for deep learning that builds upon TensorFlow
Object detector framework
A framework for object detection and instance recognition with high-performance training capabilities
Mobile Face Detection Framework
A project that builds and integrates the ncnn framework for mobile face detection on Windows and Android platforms.
NN Library
A high-level inference Neural Network library specifically designed for microcontrollers.
LLM inference engine
An efficient Large Language Model inference engine leveraging consumer-grade GPUs on PCs
Style Transfer Demo
An Android project demonstrating style transfer using the NCNN neural network library
microsoft/cntk17.5K
Deep network builder
A unified deep learning toolkit that describes neural networks as a series of computational steps via a directed graph.
Language Model
This project makes a large language model accessible for research and development
xilinx/finn770
FPGA accelerator
Fast and scalable neural network inference framework for FPGAs.
Model converter
A toolset to convert and manage deep learning models across multiple frameworks.
Neural Network Diagrammer
A tool that generates publication-ready diagrams of neural network architectures using parametric methods and popular JavaScript libraries.
