dpwa

Async neural network trainer

A distributed learning framework that enables peer-to-peer parameter averaging and asynchronous training of deep neural networks

Distributed Learning by Pair-Wise Averaging

GitHub

53 stars
5 watching
6 forks
Language: Python
last commit: about 7 years ago
asynchronous-learningdeep-learningdistributed-systemsgossipingneural-networkspythonpytorchsgd

Related projects:

Repository Description Stars
learning-at-home/hivemind A PyTorch library for decentralized deep learning across the Internet. 2,051
kimhc6028/forward-thinking-pytorch An implementation of a novel neural network training method that builds and trains networks one layer at a time. 65
neuralhydrology/neuralhydrology A Python library for training neural networks with focus on hydrological applications using PyTorch. 364
soumith/imagenet-multigpu.torch A toolkit for training neural networks on the ImageNet dataset using multiple GPUs. 402
eth-sri/diffai Trains neural networks to be provably robust against adversarial examples using abstract interpretation techniques. 218
intelligent-machine-learning/dlrover An automatic distributed deep learning system that simplifies the training of large AI models 1,270
loudinthecloud/pytorch-ntm An implementation of Neural Turing Machines in PyTorch 590
achaiah/pywick A PyTorch-based neural network training framework with advanced features and utilities 398
wyy-123-xyy/ra-fed A Python implementation of a distributed machine learning framework for training neural networks on multiple GPUs 6
madrylab/robustness A library for training and evaluating neural networks with a focus on adversarial robustness. 918
graal-research/poutyne A PyTorch framework simplifying neural network training with automated boilerplate code and callback utilities 569
microsoft/archai Automates the search for optimal neural network configurations in deep learning applications 467
erotemic/netharn A PyTorch framework for managing and automating deep learning training loops with features like hyperparameter tracking and single-file deployments. 39
ramon-oliveira/aorun A deep learning framework on top of PyTorch for building neural networks. 61
ahmedfgad/neuralgenetic Tools and techniques for training neural networks using genetic algorithms 240