AQLM
by Vahe1994
Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852
AI summary
Model compressor
An implementation of a method to compress large language models using additive quantization and fine-tuning.
- stars
- 1.2K
- forks
- 180
- watching
- 19
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Quantizer
A PyTorch quantization backend for models.
Model optimizer
Tools and techniques for optimizing large language models on various frameworks and hardware platforms.
Data analyzer
A Python library for analyzing and visualizing data from various aerosol sizing instruments
Quantization tool
A software framework for accurately quantizing large language models using a novel technique
Quantizer
An implementation of post-training quantization algorithm for transformer models to reduce memory usage and improve inference speed
QP optimizer
A solver for optimizing quadratic programs in deep learning and other fields.
Workflows
Automated workflows for quantum mechanical environments using Python.
State vector simulator
A PyTorch-based simulator for quantum machine learning
RVAE
A deep learning implementation of a recurrent variational autoencoder for generating sequential data.
Quantum decoder
A software library for decoding quantum error-correcting codes using a minimum-weight perfect matching algorithm
Quantum circuit simulator
Automated design and analysis of quantum microwave circuits
Flow library
A PyTorch implementation of volume-preserving flows for variational autoencoders.
Autoencoder density estimator
An implementation of a masked autoencoder density estimation model in PyTorch
Quantum toolkit
A Python library providing numerical tools for studying quantum information objects
Quantum visualizer
A Python library providing visualization tools and workflows for quantum computing
Featured in 1 awesome list
Each link jumps to the spot where the list mentions AQLM.
