serge
Chat platform
A fully dockerized web interface for chatting with Alpaca through llama.cpp
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
6k stars
47 watching
407 forks
Language: Svelte
last commit: 3 days ago
Linked from 2 awesome lists
alpacadockerfastapillamallamacppnginxpythonsveltesveltekittailwindcssweb
hannibal046/awesome-llm
nichtdax/awesome-totally-open-chatgptRelated projects:
| Repository | Description | Stars |
|---|---|---|
 soulteary/docker-llama2-chat | An implementation of LLaMA2 in Docker, allowing users to quickly deploy and run the model on their local machine. | 536 |
 scisharp/llamasharp | A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices | 2,673 |
 run-llama/llama_index | A data framework for augmenting Large Language Models (LLMs) with private data | 36,776 |
 ggerganov/llama.cpp | Enables efficient inference of large language models using optimized C/C++ implementations and various backend frameworks | 67,866 |
 zilliztech/gptcache | A semantic cache designed to reduce the cost and improve the speed of LLM API calls by storing responses. | 7,232 |
 rawandahmad698/pychatgpt | A Python client for interacting with the ChatGPT API, providing features such as conversation tracking and proxy support. | 4,228 |
 maximilian-winter/llama-cpp-agent | A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. | 493 |
 apache/camel | An integration framework for connecting and integrating various systems and data sources | 5,569 |
 wechaty/wechaty | A conversational RPA SDK that simplifies the process of building chatbots across multiple messaging platforms. | 20,391 |
 doriandarko/claude-engineer | A command-line interface tool that uses large language models to assist with software development tasks | 9,583 |
 sugarforever/chat-ollama | An open-source chatbot platform using large language models and vector databases | 2,651 |
 kent0n-li/chatdoctor | An AI chat model designed to simulate medical conversations with patients and doctors | 3,482 |
 noizu-labs-ml/ex_llama | Provides Elixir bindings for interacting with a machine learning chat model using C++ | 8 |
 meta-llama/llama-stack | Provides a set of standardized APIs and tools to build generative AI applications | 4,591 |
 lm-sys/fastchat | An open platform for training, serving, and evaluating large language models used in chatbots. | 36,975 |