apex

Training toolkit

Tools for streamlined mixed precision and distributed training in PyTorch

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

GitHub

8k stars
100 watching
1k forks
Language: Python
last commit: 3 days ago
Linked from 2 awesome lists


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
huggingface/accelerate A tool to simplify training and deployment of PyTorch models on various devices and configurations 7,947
facebookresearch/fairscale A PyTorch extension library that provides high-performance and large-scale training techniques. 3,199
pytorch/pytorch A Python library providing tensors and dynamic neural networks with strong GPU acceleration 84,371
pytorch/torchtitan A native PyTorch library for large-scale language model training with distributed training capabilities 2,615
pytorch/ignite A high-level library to help with training and evaluating neural networks in PyTorch 4,531
pytorch/examples A collection of curated examples showcasing various PyTorch applications in computer vision, natural language processing, and reinforcement learning. 22,428
nvidia/flownet2-pytorch A deep learning framework implementing an optical flow estimation model using PyTorch. 3,147
pytorch/audio A PyTorch module providing tools and functions for audio signal processing 2,545
tobiascz/mnist_pytorch_python_and_capi An example project demonstrating how to train and deploy a neural network in Python and C++ using PyTorch 1.0 96
szagoruyko/pytorchviz A tool to visualize PyTorch execution graphs and traces 3,228
kwea123/nerf_pl An implementation of NeRF in PyTorch-Lightning for 3D reconstruction and view synthesis 2,734
bytedance/byteps A high-performance distributed deep learning framework supporting multiple frameworks and networks 3,630
cadene/pretrained-models.pytorch Provides pre-trained PyTorch models for various computer vision tasks and datasets. 9,036
kakaobrain/torchgpipe A PyTorch-based library for efficient training of large neural networks using pipeline parallelism and automatic recomputation of gradients. 817
nvidia/tacotron2 This PyTorch implementation provides a toolkit for speech synthesis using a deep neural network architecture. 5,110