peft
Parameter adaptation
An efficient method for fine-tuning large pre-trained models by adapting only a small fraction of their parameters
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
16k stars
111 watching
2k forks
Language: Python
last commit: 9 days ago
Linked from 2 awesome lists
adapterdiffusionllmloraparameter-efficient-learningpythonpytorchtransformers
ethicalml/awesome-production-machine-learning
amrzv/awesome-colab-notebooksRelated projects:
| Repository | Description | Stars |
|---|---|---|
| huggingface/trl | A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods. | 10,053 |
| huggingface/transformers | A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. | 135,022 |
 modelscope/ms-swift | A framework for fine-tuning and deploying large language models | 4,270 |
| huggingface/diffusion-models-class | A comprehensive course teaching the theory and hands-on implementation of diffusion models in image and audio generation using PyTorch. | 3,662 |
| huggingface/optimum | A toolkit providing optimization tools and hardware acceleration for training and inference of machine learning models | 2,572 |
 optimalscale/lmflow | A toolkit for finetuning large language models and providing efficient inference capabilities | 8,273 |
| huggingface/diffusers | A PyTorch-based library for training and using state-of-the-art diffusion models to generate images, audio, and 3D structures | 26,223 |
 microsoft/lora | A method to adapt large language models by reducing their parameter count using low-rank adaptation matrices | 10,752 |
| huggingface/lerobot | A platform providing pre-trained models, datasets, and tools for robotics with focus on imitation learning and reinforcement learning. | 7,518 |
 facebookresearch/metaseq | A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms. | 6,515 |
| huggingface/alignment-handbook | Provides training recipes and resources to align language models with human preferences | 4,677 |
| huggingface/autotrain-advanced | A tool for automating machine learning model training and deployment | 4,023 |
 eleutherai/gpt-neox | Provides a framework for training large-scale language models on GPUs with advanced features and optimizations. | 6,941 |
| huggingface/accelerate | A tool to simplify training and deployment of PyTorch models on various devices and configurations | 7,947 |
 tloen/alpaca-lora | Tuning a large language model on consumer hardware using low-rank adaptation | 18,651 |