AdaBound

Optimizer

An optimizer that combines the benefits of Adam and SGD algorithms

An optimizer that trains as fast as Adam and as good as SGD.

GitHub

3k stars
72 watching
331 forks
Language: Python
last commit: over 1 year ago

Related projects:

Repository Description Stars
tensorflow/adanet An automated machine learning framework that learns to ensemble sub-networks to improve model quality 3,468
optimalscale/lmflow A toolkit for finetuning large language models and providing efficient inference capabilities 8,273
devsisters/dqn-tensorflow An implementation of a deep reinforcement learning algorithm for human-level control in game environments using TensorFlow. 2,480
microsoft/lightgbm A high-performance gradient boosting framework for machine learning tasks 16,694
huggingface/optimum A toolkit providing optimization tools and hardware acceleration for training and inference of machine learning models 2,572
lightning-ai/pytorch-lightning A framework for building and training AI models on multiple GPUs or TPUs with minimal code changes. 28,402
pytorch/pytorch A Python library providing tensors and dynamic neural networks with strong GPU acceleration 83,959
openvinotoolkit/openvino A toolkit for optimizing and deploying artificial intelligence models in various applications 7,279
ikostrikov/pytorch-a2c-ppo-acktr-gail An open-source implementation of several reinforcement learning algorithms in PyTorch 3,605
plasma-umass/scalene A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions. 12,186
rtqichen/torchdiffeq A PyTorch implementation of differentiable ODE solvers with GPU support and efficient backpropagation 5,588
nvlabs/stylegan2-ada-pytorch An official PyTorch implementation of the StyleGAN2-ADA algorithm for generating images with a focus on stability and performance. 4,126
autogluon/autogluon An automated machine learning framework that simplifies the process of building accurate predictive models from raw data, using minimal code and configuration. 8,039
pytorch/botorch A PyTorch-based library for Bayesian optimization, providing a modular interface for composing and optimizing probabilistic models. 3,102
labmlai/annotated_deep_learning_paper_implementations Implementations of various deep learning algorithms and techniques with accompanying documentation 56,215