alpaca.cpp

Chat model

A locally run Instruction-Tuned Chat-Style LLM project that combines foundation models and fine-tuning to create a chat interface.

Locally run an Instruction-Tuned Chat-Style LLM

GitHub

10k stars
101 watching
907 forks
Language: C
last commit: over 1 year ago

Related projects:

Repository Description Stars
tloen/alpaca-lora Tuning a large language model on consumer hardware using low-rank adaptation 18,651
phoebussi/alpaca-cot Provides a unified interface for fine-tuning large language models with parameter-efficient methods and instruction collection data 2,619
vincelwt/chatgpt-mac A toolkit to embed ChatGPT in a macOS menubar application 6,371
tatsu-lab/stanford_alpaca Develops an instruction-following LLaMA model for research use only, with the goal of fine-tuning and releasing it under specific licenses and restrictions. 29,554
facico/chinese-vicuna An instruction-following Chinese LLaMA-based model project aimed at training and fine-tuning models on specific hardware configurations for efficient deployment. 4,142
janhq/jan An offline AI assistant framework supporting multiple LLMs and GPU acceleration. 23,555
lyogavin/airllm A Python library that optimizes inference memory usage for large language models on limited GPU resources. 5,259
leetcode-mafia/cheetah An AI-powered macOS app designed to assist users during remote software engineering interviews 4,083
ggerganov/llama.cpp Enables efficient inference of large language models using optimized C/C++ implementations and various backend frameworks 68,190
bin-huang/chatbox A desktop application for interacting with AI models and language learning platforms 21,747
serge-chat/serge A fully dockerized web interface for chatting with Alpaca through llama.cpp 5,681
rasbt/llms-from-scratch Developing and pretraining a GPT-like Large Language Model from scratch 32,908
lightning-ai/lit-llama An implementation of a large language model using the nanoGPT architecture 5,993
kent0n-li/chatdoctor An AI chat model designed to simulate medical conversations with patients and doctors 3,482
lc1332/chinese-alpaca-lora Develops and maintains a Chinese language model finetuned on LLaMA, used for text generation and summarization tasks. 711