pytorch-sync-batchnorm-example

PyTorch batchnorm example

An example project demonstrating how to use synchronized batchnorm in PyTorch with multiple GPUs

How to use Cross Replica / Synchronized Batchnorm in Pytorch

GitHub

249 stars
5 watching
25 forks
last commit: over 5 years ago
batchnormdataparalleldistributed-trainingpytorch

Related projects:

Repository Description Stars
yukkyo/pytorch-filterresponsenormalizationlayer An implementation of Filter Response Normalization Layer in PyTorch to improve the training of deep neural networks by eliminating batch dependence. 85
prlz77/resnext.pytorch Reproduces ResNet-V3 with PyTorch for computer vision tasks 508
yjxiong/tsn-pytorch A PyTorch implementation of Temporal Segment Networks (TSN) for action recognition and video understanding. 1,066
chenxi116/pnasnet.pytorch PyTorch implementation of PNASNet-5 architecture 317
napsternxg/pytorch-practice A collection of scripts demonstrating PyTorch's capabilities in natural language processing and machine learning tasks 197
zhanghang1989/pytorch-encoding A Python framework for building deep learning models with optimized encoding layers and batch normalization. 2,041
dragen1860/learningtocompare-pytorch An implementation of the Learning to Compare paper in PyTorch 251
theeluwin/pytorch-sgns An implementation of Word2Vec's SkipGramNegativeSampling in PyTorch with support for word frequency distribution and subsampling. 302
dasguptar/treelstm.pytorch An implementation of Tree-LSTM networks in PyTorch for semantic similarity tasks using tree structures 550
oyam/pytorch-dpns PyTorch implementation of a deep learning model for image segmentation 90
fanglanting/skip-gram-pytorch A PyTorch implementation of the skip-gram model for learning word embeddings. 188
randl/shufflenetv2-pytorch An implementation of a lightweight convolutional neural network architecture for mobile devices 191
tramac/fast-scnn-pytorch A PyTorch implementation of a deep learning model for semantic segmentation tasks in computer vision. 381
nearai/torchfold A PyTorch module for dynamic batching and optimized computation on deep neural networks 221
orobix/prototypical-networks-for-few-shot-learning-pytorch An implementation of Prototypical Networks for Few Shot Learning in PyTorch 989