LLaMA-Factory
LLaMA Tuner
A tool for efficiently fine-tuning large language models across multiple architectures and methods.
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
36k stars
215 watching
4k forks
Language: Python
last commit: 2 months ago agentaichatglmfine-tuninggptinstruction-tuninglanguage-modellarge-language-modelsllamallama3llmloramistralmoepeftqloraquantizationqwenrlhftransformers
Related projects:
| Repository | Description | Stars |
|---|---|---|
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,775 |
 haotian-liu/llava | A system that uses large language and vision models to generate and process visual instructions | 20,683 |
 lightning-ai/lit-llama | An implementation of a large language model using the nanoGPT architecture | 6,013 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,732 |
 meta-llama/llama-stack | Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design. | 5,164 |
| meta-llama/codellama | Provides inference code and tools for fine-tuning large language models, specifically designed for code generation tasks | 16,097 |
 tloen/alpaca-lora | Tuning a large language model on consumer hardware using low-rank adaptation | 18,710 |
 scisharp/llamasharp | An efficient C#/.NET library for running Large Language Models (LLMs) on local devices | 2,750 |
 facico/chinese-vicuna | An instruction-following Chinese LLaMA-based model project aimed at training and fine-tuning models on specific hardware configurations for efficient deployment. | 4,152 |
 ggerganov/llama.cpp | Enables LLM inference with minimal setup and high performance on various hardware platforms | 69,185 |
| meta-llama/llama-recipes | Provides tools and examples for fine-tuning the Meta Llama model and building applications with it | 15,578 |
| meta-llama/llama3 | Provides pre-trained and instruction-tuned Llama 3 language models and tools for loading and running inference | 27,527 |
 linksoul-ai/chinese-llama-2-7b | A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data | 2,235 |
 phoebussi/alpaca-cot | Provides a unified interface for fine-tuning large language models with parameter-efficient methods and instruction collection data | 2,640 |
| meta-llama/llama | A collection of tools and utilities for deploying, fine-tuning, and utilizing large language models. | 56,832 |