TensorRT
Deep learning accelerator
Provides a set of tools and libraries for optimizing deep learning inference on NVIDIA GPUs.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
11k stars
156 watching
2k forks
Language: C++
last commit: 4 days ago
Linked from 3 awesome lists
deep-learninggpu-accelerationinferencenvidiatensorrt
ethicalml/awesome-production-machine-learning
ly0n/awesome-robotic-tooling
caerind/awesomecppgamedevRelated projects:
| Repository | Description | Stars |
|---|---|---|
 tensorlayer/tensorlayer | A deep learning and reinforcement learning library that provides an extensive collection of customizable neural layers to build advanced AI models quickly. | 7,337 |
 tensorspace-team/tensorspace | A JavaScript framework for building interactive and intuitive 3D visualizations of neural networks in browsers. | 5,077 |
| nvidia/fastertransformer | A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks. | 5,937 |
 tensortrade-org/tensortrade | A framework for building and deploying robust trading agents using reinforcement learning | 4,592 |
 tflearn/tflearn | A high-level API for deep learning that builds upon TensorFlow | 9,621 |
 pkmital/tensorflow_tutorials | A collection of examples and tutorials illustrating various applications and use cases of TensorFlow in Python | 5,636 |
 nvidiagameworks/kaolin | A PyTorch library for accelerating 3D deep learning research with various GPU-optimized operations and tools. | 4,550 |
 tensorpack/tensorpack | A high-performance neural network training interface for TensorFlow that focuses on speed and flexibility. | 6,303 |
 tensorflow/serving | A high-performance serving system for machine learning models in production environments. | 6,195 |
| nvidia/minkowskiengine | An auto-differentiation library for sparse tensors used in computer vision and deep learning applications. | 2,513 |
 tensorforce/tensorforce | A modular and flexible framework for applied reinforcement learning using TensorFlow | 3,299 |
| nvidia/tensorflow | An optimized version of TensorFlow to support newer hardware and libraries for NVIDIA GPU users | 1,017 |
 nlintz/tensorflow-tutorials | A collection of tutorials teaching deep learning with TensorFlow using Jupyter Notebooks | 6,003 |
| nvidia/digits | A web-based platform for training deep learning models on GPU accelerators. | 4,126 |
 triton-inference-server/server | An open-source software that enables deployment of AI models from multiple deep learning and machine learning frameworks on various devices | 8,460 |