jan
AI assistant framework
An offline AI assistant framework supporting multiple LLMs and GPU acceleration.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
24k stars
134 watching
1k forks
Language: TypeScript
last commit: 4 days ago
Linked from 1 awesome list
electrongptllama2llamacpplocalaiself-hosted
pluja/awesome-privacyRelated projects:
| Repository | Description | Stars |
|---|---|---|
 lencx/chatgpt | A desktop application built with Rust and Tauri, providing a chat interface using the GPT-3 AI model | 52,952 |
 bin-huang/chatbox | A desktop application for interacting with AI models and language learning platforms | 21,747 |
 antimatter15/alpaca.cpp | A locally run Instruction-Tuned Chat-Style LLM project that combines foundation models and fine-tuning to create a chat interface. | 10,250 |
 vincelwt/chatgpt-mac | A toolkit to embed ChatGPT in a macOS menubar application | 6,371 |
 ai-shifu/chatall | A platform that enables concurrent interaction with multiple AI chatbots to find the best answers. | 15,241 |
 jackmort/chatgpt.nvim | A plugin for Neovim that integrates with the ChatGPT API to generate natural language responses and assist with coding tasks. | 3,779 |
 ztjhz/betterchatgpt | A tool providing an enhanced chatbot experience using OpenAI's ChatGPT API | 8,162 |
 jina-ai/serve | A framework for building and deploying AI services that can be scaled from local development to production | 21,129 |
 sugarforever/chat-ollama | An open-source chatbot platform using large language models and vector databases | 2,651 |
 lyogavin/airllm | A Python library that optimizes inference memory usage for large language models on limited GPU resources. | 5,259 |
 mintplex-labs/anything-llm | A full-stack application that enables users to turn any document into context for chatting with various Large Language Models (LLMs) and vector databases | 27,283 |
 prefecthq/marvin | An AI toolkit for building natural language interfaces and generating multimedia content | 5,296 |
 skypilot-org/skypilot | A framework for running AI and batch workloads on any infrastructure, offering unified execution, cost savings, and high GPU availability. | 6,801 |
 exo-explore/exo | Allows developers to run AI models on personal devices with diverse hardware configurations. | 14,829 |
 swift-ai/swift-ai | A high-performance deep learning library written in Swift for Apple platforms. | 6,029 |