neural-compressor
by intel
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
AI summary
Model optimizer
Tools and techniques for optimizing large language models on various frameworks and hardware platforms.
- stars
- 2.3K
- forks
- 257
- watching
- 33
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Model optimizer
Enables the creation of smaller neural network models through efficient pruning and quantization techniques
Network tuner
Automates the search for optimal neural network configurations in deep learning applications
Model optimizer
Automates model building and deployment process by optimizing hyperparameters and compressing models for edge computing.
vahe1994/aqlm1.2K
Model compressor
An implementation of a method to compress large language models using additive quantization and fine-tuning.
Efficient LLM
A large language model with improved efficiency and performance compared to similar models
Model optimizer
This project presents an optimization technique for large-scale image models to reduce computational requirements while maintaining performance.
LLM optimizer
A tool for optimizing large language models by collecting feedback and metrics to improve their performance over time
Language model optimizer
An optimization technique for large language models allowing them to run on limited hardware resources without significant performance loss.
Machine reading model
An implementation of Google's QANet for machine reading comprehension using TensorFlow.
Image model compressor
A framework that enables efficient training of text-to-image models by compressing the computationally expensive stage into a latent space
AutoML pipeline tool
Automated machine learning tool for tabular data pipelines
Neural network optimization notebooks
A collection of notebooks demonstrating various techniques for optimizing and quantizing neural networks using TensorFlow Lite
Segmentation model
Deep learning models for semantic segmentation of images
Quantizer
A PyTorch quantization backend for models.
KFAC optimizer
Library providing an implementation of the K-FAC optimizer and curvature estimator for second-order optimization in neural networks.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions neural-compressor.
