lit-llama
by Lightning-AI
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
AI summary
Language Model
An implementation of a large language model using the nanoGPT architecture
- stars
- 6K
- forks
- 517
- watching
- 71
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Instruction-following model tuner
An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy
AI toolkit
Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design.
LLaMA Tuner
A tool for efficiently fine-tuning large language models across multiple architectures and methods.
ggerganov/llama.cpp69.2K
LLM inference software
Enables LLM inference with minimal setup and high performance on various hardware platforms
meta-llama/llama327.5K
Language model library
Provides pre-trained and instruction-tuned Llama 3 language models and tools for loading and running inference
LLAMA framework
A collection of tools and utilities for deploying, fine-tuning, and utilizing large language models.
LLM toolkit
Provides tools and examples for fine-tuning the Meta Llama model and building applications with it
Language Model Runtime
An efficient C#/.NET library for running Large Language Models (LLMs) on local devices
Code generator
Provides inference code and tools for fine-tuning large language models, specifically designed for code generation tasks
tloen/alpaca-lora18.7K
Language model tuning
Tuning a large language model on consumer hardware using low-rank adaptation
AI safety toolkit
A set of tools to help developers build responsibly with open generative AI models.
Data augmentation tool
A data framework for augmenting Large Language Models (LLMs) with private data
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
LLM framework
A framework for training and serving large language models using JAX/Flax
nomic-ai/gpt4all71.2K
LLM client
An open-source Python client for running Large Language Models (LLMs) locally on any device.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions lit-llama.
