LoRA
by microsoft
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
AI summary
Parameter reduction
A method to adapt large language models by reducing their parameter count using low-rank adaptation matrices
- stars
- 11K
- forks
- 695
- watching
- 70
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
tloen/alpaca-lora18.7K
Language model tuning
Tuning a large language model on consumer hardware using low-rank adaptation
LLM fine-tuner
Provides a unified interface for fine-tuning large language models with parameter-efficient methods and instruction collection data
huggingface/peft16.7K
Parameter adaptation
An efficient method for fine-tuning large pre-trained models by adapting only a small fraction of their parameters
Robotics toolkit
A platform providing pre-trained models, datasets, and tools for robotics with focus on imitation learning and reinforcement learning.
Chatbot fine-tuning
Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset.
Transfer learning library
A unified library for parameter-efficient and modular transfer learning in NLP tasks
LM fine-tuner
A codebase for fine-tuning the ChatGLM-6b language model using low-rank adaptation (LoRA) and providing finetuned weights.
meta-llama/codellama16.1K
Code generator
Provides inference code and tools for fine-tuning large language models, specifically designed for code generation tasks
Machine learning automator
Automates machine learning workflows and optimizes model performance using large language models and efficient algorithms
LLM toolkit
A toolkit for fine-tuning and inferring large machine learning models
Polish LLM
Trains a language model using a RoBERTa architecture on high-quality Polish text data
GPT model development
Developing and pretraining a GPT-like Large Language Model from scratch
LoRa controller
A MicroPython library for controlling Semtech SX127x LoRa modules over SPI.
LLM tutorial
A practical course teaching large language models and their applications through hands-on projects using OpenAI API and Hugging Face library.
Language Model
Trains a large-scale PyTorch language model on the 1-Billion Word dataset
Featured in 1 awesome list
Each link jumps to the spot where the list mentions LoRA.
