lorax
by davisyoshida
LoRA for arbitrary JAX models and functions
AI summary
Memory optimizer
A JAX transform that simplifies the training of large language models by reducing memory usage through low-rank adaptation.
- stars
- 134
- forks
- 5
- watching
- 4
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Memory optimizer for deep learning models
A lightweight wrapper around PyTorch to prevent CUDA out-of-memory errors and optimize model execution
Deep learning optimizer
An open-source project providing hardware accelerated, batchable and differentiable optimizers in JAX for deep learning.
Model optimizer
Automates model building and deployment process by optimizing hyperparameters and compressing models for edge computing.
Federated learner optimizer
A tool for training federated learning models with adaptive gradient balancing to handle class imbalance in multi-client scenarios.
Optimization algorithm
An optimizer that automatically tunes momentum and learning rate using local quadratic approximation.
Memory optimizer
A programming language designed to optimize memory usage through long-term storage of data
Memory optimizer
A tool for optimizing deep learning models to reduce memory usage without sacrificing performance
Memory optimizer
An optimization technique to reduce memory usage in deep neural networks during training
Region-of-Interest Training
Training and deploying large language models on computer vision tasks using region-of-interest inputs
Language model optimizer
An optimization technique for large language models allowing them to run on limited hardware resources without significant performance loss.
Model optimizer
This project presents an optimization technique for large-scale image models to reduce computational requirements while maintaining performance.
LLM optimizer
A flexible framework for LLM inference optimizations with support for multiple models and architectures
Gradient optimizer library
A gradient processing and optimization library designed to facilitate research and productivity in machine learning by providing building blocks for custom optimizers and gradient processing components.
Decentralized optimizer
A modular JAX implementation of federated learning via posterior averaging for decentralized optimization
Capacity optimizer
A Julia framework for creating large-scale linear optimization models of energy system capacity expansion with multiple periods
Featured in 1 awesome list
Each link jumps to the spot where the list mentions lorax.
