llama-recipes
LLM toolkit
Provides tools and examples for fine-tuning the Meta Llama model and building applications with it
Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.
15k stars
194 watching
2k forks
Language: Jupyter Notebook
last commit: 3 days ago aifinetuninglangchainllamallama2llmmachine-learningpythonpytorchvllm
Related projects:
| Repository | Description | Stars |
|---|---|---|
| meta-llama/llama | A collection of tools and utilities for deploying, fine-tuning, and utilizing large language models. | 56,437 |
| meta-llama/llama3 | Provides pre-trained and instruction-tuned Llama 3 language models and tools for loading and running inference | 27,138 |
 ggerganov/llama.cpp | Enables efficient inference of large language models using optimized C/C++ implementations and various backend frameworks | 68,190 |
| meta-llama/llama-stack | Provides a set of standardized APIs and tools to build generative AI applications | 4,591 |
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,754 |
| meta-llama/codellama | Provides inference code and tools for fine-tuning large language models, specifically designed for code generation tasks | 16,039 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,722 |
 scisharp/llamasharp | A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices | 2,703 |
 lightning-ai/lit-llama | An implementation of a large language model using the nanoGPT architecture | 5,993 |
 hiyouga/llama-factory | A unified platform for fine-tuning multiple large language models with various training approaches and methods | 34,436 |
 karpathy/llama2.c | A minimalistic C implementation of the Llama 2 language model inference engine. | 17,471 |
 run-llama/llama_index | A data framework for augmenting Large Language Models (LLMs) with private data | 36,899 |
 tloen/alpaca-lora | Tuning a large language model on consumer hardware using low-rank adaptation | 18,651 |
 haotian-liu/llava | A system that uses large language and vision models to generate and process visual instructions | 20,359 |
| run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,960 |