gpt4all

LLM client

An open-source Python client for running Large Language Models (LLMs) locally on any device.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

GitHub

71k stars

644 watching

8k forks

Language: C++

last commit: 6 days ago

Linked from 5 awesome lists

ai-chatllm-inference

nomic.ai/gpt4all

Backlinks from these awesome lists:

Related projects:

Repository	Description	Stars
llm-workflow-engine/llm-workflow-engine	A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4.	3,659
promtengineer/localgpt	Conversational AI system allowing secure local interactions with documents using various open-source models and frameworks	20,085
ggerganov/llama.cpp	Enables efficient inference of large language models using optimized C/C++ implementations and various backend frameworks	67,866
alpha-vllm/llama2-accessory	An open-source toolkit for pretraining and fine-tuning large language models	2,720
opengvlab/llama-adapter	An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy	5,754
kurama622/llm.nvim	An extension for Neovim that integrates with large language models to provide tools for text translation, code explanation and optimization.	47
rasbt/llms-from-scratch	Developing and pretraining a GPT-like Large Language Model from scratch	32,908
lightning-ai/lit-llama	An implementation of a large language model using the nanoGPT architecture	5,993
vllm-project/vllm	A high-performance inference and serving engine for large language models.	30,303
lyogavin/airllm	A Python library that optimizes inference memory usage for large language models on limited GPU resources.	5,259
modeltc/lightllm	An LLM inference and serving framework providing a lightweight design, scalability, and high-speed performance for large language models.	2,609
zilliztech/gptcache	A semantic cache designed to reduce the cost and improve the speed of LLM API calls by storing responses.	7,232
llmware-ai/llmware	A framework for building enterprise LLM-based applications using small, specialized models	6,651
huynle/ogpt.nvim	A plugin for Neovim that provides an interface to various Large Language Models (LLMs) for natural language generation and interaction.	172
ther1d/shell_gpt	A command-line tool using AI-powered language models to generate shell commands and code snippets	9,672