gptq
by IST-DASLab
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
AI summary
Quantizer
An implementation of post-training quantization algorithm for transformer models to reduce memory usage and improve inference speed
- stars
- 2K
- forks
- 156
- watching
- 29
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Transformer trainer
Research tool for training large transformer language models at scale
Transformer trainer
A collection of tools and scripts for training large transformer language models at scale
GPT transformer
A Rust implementation of a minimal Generative Pretrained Transformer architecture.
vahe1994/aqlm1.2K
Model compressor
An implementation of a method to compress large language models using additive quantization and fine-tuning.
Quantization tool
A software framework for accurately quantizing large language models using a novel technique
Text processor
A generative transformer model designed to process and generate text in various vertical domains, including computer science, finance, and more.
State vector simulator
A PyTorch-based simulator for quantum machine learning
Object Detector
Improving Object Detection from Scratch via Gated Feature Reuse
Model optimizer
Tools and techniques for optimizing large language models on various frameworks and hardware platforms.
Transformer models
An implementation of deep learning transformer models in MATLAB
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
Region-of-Interest Training
Training and deploying large language models on computer vision tasks using region-of-interest inputs
GA trainer
Trains PyTorch models using a genetic algorithm
Sequence transformer
An attention-based sequence-to-sequence learning framework
Quantization library
A deep learning library that provides an easy-to-use interface for quantizing neural networks and accelerating their inference on various hardware platforms.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions gptq.
