koila
Memory optimizer for deep learning models
A lightweight wrapper around PyTorch to prevent CUDA out-of-memory errors and optimize model execution
Prevent PyTorch's CUDA error: out of memory in just 1 line of code.
2k stars
12 watching
63 forks
Language: Python
last commit: 18 days ago deep-learninggradient-accumulationlazy-evaluationmachine-learningmemory-managementneural-networkout-of-memorypythonpytorch
Related projects:
| Repository | Description | Stars |
|---|---|---|
 zhanghang1989/pytorch-encoding | A Python framework for building deep learning models with optimized encoding layers and batch normalization. | 2,041 |
 kefirski/pytorch_rvae | A deep learning implementation of a recurrent variational autoencoder for generating sequential data. | 357 |
 tristandeleu/pytorch-maml-rl | Replication of Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks in PyTorch for reinforcement learning tasks | 827 |
 4uiiurz1/pytorch-res2net | Implementations of deep learning architectures using PyTorch for image classification tasks on various datasets. | 112 |
 ikostrikov/pytorch-meta-optimizer | A PyTorch implementation of meta-learning using gradient descent to adapt to new tasks. | 312 |
 davisyoshida/lorax | A JAX transform that simplifies the training of large language models by reducing memory usage through low-rank adaptation. | 132 |
 kaiyangzhou/dassl.pytorch | A PyTorch toolbox for supporting research and development of domain adaptation, generalization, and semi-supervised learning methods in computer vision. | 1,217 |
| ikostrikov/pytorch-trpo | A PyTorch implementation of an optimization algorithm for continuous control and reinforcement learning tasks | 433 |
 hughperkins/pytorch | Provides Python wrappers for PyTorch and Lua, enabling developers to use PyTorch's deep learning capabilities from both languages. | 432 |
 koz4k/dni-pytorch | Decoupled Neural Interfaces using Synthetic Gradients for PyTorch | 236 |
 atgambardella/pytorch-es | An implementation of an optimization algorithm for training neural networks in machine learning environments. | 350 |
 baguasys/bagua | A framework for accelerating PyTorch deep learning training | 877 |
 nearai/torchfold | A PyTorch module for dynamic batching and optimized computation on deep neural networks | 221 |
 jacobgil/pytorch-pruning | This project provides a PyTorch implementation of pruning techniques to reduce the computational resources required for neural network inference. | 875 |
 graal-research/poutyne | A PyTorch framework simplifying neural network training with automated boilerplate code and callback utilities | 569 |