Awesome Lists

OmniQuant

by OpenGVLab

Pythonpushed almost 2 years ago

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

AI summary

Quantization tool

A software framework for accurately quantizing large language models using a novel technique

stars
739
forks
56
watching
16

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.