TensorRT
Inference platform
A high-performance deep learning inference platform on NVIDIA GPUs
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
11k stars
157 watching
2k forks
Language: C++
last commit: 16 days ago
Linked from 3 awesome lists
deep-learninggpu-accelerationinferencenvidiatensorrt
ethicalml/awesome-production-machine-learning
ly0n/awesome-robotic-tooling
caerind/awesomecppgamedevRelated projects:
| Repository | Description | Stars |
|---|---|---|
 tensorlayer/tensorlayer | A deep learning and reinforcement learning library that provides an extensive collection of customizable neural layers to build advanced AI models quickly. | 7,334 |
 tensorspace-team/tensorspace | A JavaScript framework for building interactive and intuitive 3D visualizations of neural networks in browsers. | 5,071 |
| nvidia/fastertransformer | A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks. | 5,886 |
 tensortrade-org/tensortrade | A framework for building and deploying robust trading agents using reinforcement learning | 4,562 |
 tflearn/tflearn | A high-level API for deep learning that builds upon TensorFlow | 9,619 |
 pkmital/tensorflow_tutorials | A collection of examples and tutorials illustrating various applications and use cases of TensorFlow in Python | 5,642 |
 nvidiagameworks/kaolin | A PyTorch library for accelerating 3D deep learning research with various GPU-optimized operations and tools. | 4,497 |
 tensorpack/tensorpack | A high-performance neural network training interface for TensorFlow that focuses on speed and flexibility. | 6,303 |
 tensorflow/serving | A high-performance serving system for machine learning models in production environments. | 6,185 |
| nvidia/minkowskiengine | An auto-differentiation library for sparse tensors used in computer vision and deep learning applications. | 2,485 |
 tensorforce/tensorforce | A modular and flexible framework for applied reinforcement learning using TensorFlow | 3,296 |
| nvidia/tensorflow | An optimized version of TensorFlow to support newer hardware and libraries for NVIDIA GPU users | 996 |
 nlintz/tensorflow-tutorials | A collection of tutorials teaching deep learning with TensorFlow using Jupyter Notebooks | 6,006 |
| nvidia/digits | A web-based platform for training deep learning models on GPUs using Caffe, Torch, and other frameworks. | 4,121 |
 triton-inference-server/server | Provides an optimized cloud and edge inferencing solution for AI models | 8,342 |