optimize-net

Memory Optimizer

An optimization library for reducing memory usage in PyTorch neural networks

OptNet - Reducing memory usage in torch neural nets

GitHub

282 stars
23 watching
45 forks
Language: Lua
last commit: over 7 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
mapillary/inplace_abn An optimization technique to reduce memory usage in deep neural networks during training 1,321
dmlc/mxnet-memonger A tool for optimizing deep learning models to reduce memory usage without sacrificing performance 308
anjiecheng/mnasnet-pytorch An implementation of a neural network architecture search algorithm optimized for mobile devices. 271
mc-nya/fednest An implementation of a federated optimization algorithm for distributed machine learning 6
rentruewang/koila A lightweight wrapper around PyTorch to prevent CUDA out-of-memory errors and optimize model execution 1,821
gpleiss/efficient_densenet_pytorch An implementation of DenseNets optimized to save GPU memory by using checkpointing 1,521
atgambardella/pytorch-es An implementation of an optimization algorithm for training neural networks in machine learning environments. 350
dylanmuir/fmin_adam An implementation of the Adam optimisation algorithm for stochastic gradient descent problems in Matlab. 55
davisyoshida/lorax A JAX transform that simplifies the training of large language models by reducing memory usage through low-rank adaptation. 132
cma-es/pycma An optimization algorithm implementation in Python 1,109
typemonkey/turtle A programming language designed to optimize memory usage through long-term storage of data 5
locuslab/optnet A PyTorch module that adds differentiable optimization as a layer to neural networks 513
mengomarlene/opti4abq An optimisation method that minimises the difference between FEA output and data in Abaqus models 16
neuralmagic/sparseml Enables the creation of smaller neural network models through efficient pruning and quantization techniques 2,071
andreaferretti/memo A package that provides functions to memoize (cache) and optimize Nim functions. 78