AdaBound

Optimizer

An optimizer that combines the benefits of Adam and SGD algorithms

An optimizer that trains as fast as Adam and as good as SGD.

GitHub

3k stars
71 watching
330 forks
Language: Python
last commit: over 1 year ago

Related projects:

Repository Description Stars
tensorflow/adanet An automated machine learning framework that learns to ensemble sub-networks to improve model quality 3,470
optimalscale/lmflow A toolkit for fine-tuning and inferring large machine learning models 8,312
devsisters/dqn-tensorflow An implementation of a deep reinforcement learning algorithm for human-level control in game environments using TensorFlow. 2,491
microsoft/lightgbm A high-performance gradient boosting framework for machine learning tasks 16,769
huggingface/optimum A toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms. 2,618
lightning-ai/pytorch-lightning A framework for building and training AI models on multiple GPUs or TPUs with minimal code changes. 28,636
pytorch/pytorch A Python library providing tensors and dynamic neural networks with strong GPU acceleration 84,978
openvinotoolkit/openvino A toolkit for optimizing and deploying artificial intelligence models in various applications 7,439
ikostrikov/pytorch-a2c-ppo-acktr-gail An open-source implementation of several reinforcement learning algorithms in PyTorch 3,644
plasma-umass/scalene A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions. 12,274
rtqichen/torchdiffeq A PyTorch implementation of differentiable ODE solvers with GPU support and efficient backpropagation 5,655
nvlabs/stylegan2-ada-pytorch An official PyTorch implementation of the StyleGAN2-ADA algorithm for generating images with a focus on stability and performance. 4,144
autogluon/autogluon Automates machine learning tasks to train accurate models in just a few lines of code 8,167
pytorch/botorch A PyTorch-based library for Bayesian optimization, providing a modular interface for composing and optimizing probabilistic models. 3,126
labmlai/annotated_deep_learning_paper_implementations Implementations of various deep learning algorithms and techniques with accompanying documentation 57,177