AdaBound

Optimizer

An optimizer that combines the benefits of Adam and SGD algorithms

An optimizer that trains as fast as Adam and as good as SGD.

GitHub

3k stars
71 watching
330 forks
Language: Python
last commit: about 3 years ago

Related projects:

RepositoryDescriptionStars
tensorflow/adanetAn automated machine learning framework that learns to ensemble sub-networks to improve model quality3,470
optimalscale/lmflowA toolkit for fine-tuning and inferring large machine learning models8,312
devsisters/dqn-tensorflowAn implementation of a deep reinforcement learning algorithm for human-level control in game environments using TensorFlow.2,491
microsoft/lightgbmA high-performance gradient boosting framework for machine learning tasks16,769
huggingface/optimumA toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms.2,618
lightning-ai/pytorch-lightningA framework for building and training AI models on multiple GPUs or TPUs with minimal code changes.28,636
pytorch/pytorchA Python library providing tensors and dynamic neural networks with strong GPU acceleration84,978
openvinotoolkit/openvinoA toolkit for optimizing and deploying artificial intelligence models in various applications7,439
ikostrikov/pytorch-a2c-ppo-acktr-gailAn open-source implementation of several reinforcement learning algorithms in PyTorch3,644
plasma-umass/scaleneA high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions.12,274
rtqichen/torchdiffeqA PyTorch implementation of differentiable ODE solvers with GPU support and efficient backpropagation5,655
nvlabs/stylegan2-ada-pytorchAn official PyTorch implementation of the StyleGAN2-ADA algorithm for generating images with a focus on stability and performance.4,144
autogluon/autogluonAutomates machine learning tasks to train accurate models in just a few lines of code8,167
pytorch/botorchA PyTorch-based library for Bayesian optimization, providing a modular interface for composing and optimizing probabilistic models.3,126
labmlai/annotated_deep_learning_paper_implementationsImplementations of various deep learning algorithms and techniques with accompanying documentation57,177