dpwa

Async neural network trainer

A distributed learning framework that enables peer-to-peer parameter averaging and asynchronous training of deep neural networks

Distributed Learning by Pair-Wise Averaging

GitHub

53 stars
5 watching
6 forks
Language: Python
last commit: about 7 years ago
asynchronous-learningdeep-learningdistributed-systemsgossipingneural-networkspythonpytorchsgd

Related projects:

Repository Description Stars
learning-at-home/hivemind A PyTorch library for decentralized deep learning across the Internet. 2,078
kimhc6028/forward-thinking-pytorch An implementation of a novel neural network training method that builds and trains networks one layer at a time. 66
neuralhydrology/neuralhydrology A Python library for training neural networks with focus on hydrological applications using PyTorch. 372
soumith/imagenet-multigpu.torch A toolkit for training neural networks on the ImageNet dataset using multiple GPUs. 402
eth-sri/diffai Trains neural networks to be provably robust against adversarial examples using abstract interpretation techniques. 219
intelligent-machine-learning/dlrover Automates large-scale deep learning training on distributed clusters, providing fault tolerance and fast recovery from failures. 1,302
loudinthecloud/pytorch-ntm An implementation of Neural Turing Machines in PyTorch 592
achaiah/pywick A PyTorch-based neural network training framework with advanced features and utilities 398
wyy-123-xyy/ra-fed A Python implementation of a distributed machine learning framework for training neural networks on multiple GPUs 6
madrylab/robustness A library for training and evaluating neural networks with a focus on adversarial robustness. 921
graal-research/poutyne A PyTorch framework simplifying neural network training with automated boilerplate code and callback utilities 572
microsoft/archai Automates the search for optimal neural network configurations in deep learning applications 468
erotemic/netharn A PyTorch framework for managing and automating deep learning training loops with features like hyperparameter tracking and single-file deployments. 40
ramon-oliveira/aorun A deep learning framework on top of PyTorch for building neural networks. 61
ahmedfgad/neuralgenetic Trains artificial neural networks using the genetic algorithm 241