optimum
ML model optimizer
A toolkit providing optimization tools and hardware acceleration for training and inference of machine learning models
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
3k stars
58 watching
470 forks
Language: Python
last commit: 8 days ago
Linked from 1 awesome list
graphcorehabanainferenceintelonnxonnxruntimeoptimizationpytorchquantizationtflitetrainingtransformers
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
| huggingface/optimum-benchmark | A tool for comparing and optimizing the performance of various machine learning frameworks and models on different hardware platforms. | 251 |
| huggingface/accelerate | A tool to simplify training and deployment of PyTorch models on various devices and configurations | 7,947 |
| huggingface/peft | An efficient method for fine-tuning large pre-trained models by adapting only a small fraction of their parameters | 16,505 |
| huggingface/optimum-quanto | A PyTorch quantization backend for models. | 822 |
 facebookresearch/metaseq | A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms. | 6,517 |
| huggingface/transformers | A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. | 135,022 |
| huggingface/trl | A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods. | 10,133 |
 luolc/adabound | An optimizer that combines the benefits of Adam and SGD algorithms | 2,907 |
 nebuly-ai/optimate | A collection of libraries to optimize AI model performances. | 8,375 |
| huggingface/transformers.js | An API for using pre-trained machine learning models in web browsers without the need for a server | 12,085 |
| huggingface/diffusers | A PyTorch-based library for training and using state-of-the-art diffusion models to generate images, audio, and 3D structures | 26,223 |
 plasma-umass/scalene | A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions. | 12,186 |
| huggingface/autotrain-advanced | A tool for automating machine learning model training and deployment | 4,023 |
 hyperopt/hyperopt | A Python library for optimizing parameters of objective functions in distributed and parallel settings. | 7,258 |
 optimalscale/lmflow | A toolkit for finetuning large language models and providing efficient inference capabilities | 8,273 |