AITemplate
Pythonpushed almost 2 years ago
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
AI summary
Neural network optimizer
A framework that transforms deep neural networks into high-performance GPU-optimized C++ code for efficient inference serving.
- stars
- 4.6K
- forks
- 372
- watching
- 82