optimum
Model optimizer
A toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms.
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
3k stars
57 watching
484 forks
Language: Python
last commit: about 1 month ago
Linked from 1 awesome list
graphcorehabanainferenceintelonnxonnxruntimeoptimizationpytorchquantizationtflitetrainingtransformers
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
| huggingface/optimum-benchmark | A tool for comparing and optimizing the performance of various machine learning frameworks and models on different hardware platforms. | 274 |
| huggingface/accelerate | A tool to simplify training and deployment of PyTorch models on various devices and configurations | 8,056 |
| huggingface/peft | An efficient method for fine-tuning large pre-trained models by adapting only a small fraction of their parameters | 16,699 |
| huggingface/optimum-quanto | A PyTorch quantization backend for models. | 847 |
 facebookresearch/metaseq | A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms. | 6,519 |
| huggingface/transformers | A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. | 136,357 |
| huggingface/trl | A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods. | 10,308 |
 luolc/adabound | An optimizer that combines the benefits of Adam and SGD algorithms | 2,908 |
 nebuly-ai/optimate | A collection of libraries to optimize AI model performances. | 8,375 |
| huggingface/transformers.js | An open-source JavaScript library for running machine learning models in the browser without a server. | 12,363 |
| huggingface/diffusers | A PyTorch-based library for training and using state-of-the-art diffusion models to generate images, audio, and 3D structures | 26,676 |
 plasma-umass/scalene | A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions. | 12,274 |
| huggingface/autotrain-advanced | A no-code solution for training state-of-the-art machine learning models quickly and easily. | 4,151 |
 hyperopt/hyperopt | A Python library for optimizing parameters of objective functions in distributed and parallel settings. | 7,295 |
 optimalscale/lmflow | A toolkit for fine-tuning and inferring large machine learning models | 8,312 |