serge
Chat platform
A fully dockerized web interface for chatting with Alpaca through llama.cpp
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
6k stars
47 watching
405 forks
Language: Svelte
last commit: about 1 month ago
Linked from 2 awesome lists
alpacadockerfastapillamallamacppnginxpythonsveltesveltekittailwindcssweb
hannibal046/awesome-llm
nichtdax/awesome-totally-open-chatgptRelated projects:
| Repository | Description | Stars |
|---|---|---|
 soulteary/docker-llama2-chat | An implementation of LLaMA2 in Docker, allowing users to quickly deploy and run the model on their local machine. | 537 |
 scisharp/llamasharp | An efficient C#/.NET library for running Large Language Models (LLMs) on local devices | 2,750 |
 run-llama/llama_index | A data framework for augmenting Large Language Models (LLMs) with private data | 37,371 |
 ggerganov/llama.cpp | Enables LLM inference with minimal setup and high performance on various hardware platforms | 69,185 |
 zilliztech/gptcache | A semantic cache designed to reduce the cost and improve the speed of LLM API calls by storing responses. | 7,293 |
 rawandahmad698/pychatgpt | A Python client for interacting with the ChatGPT API, providing features such as conversation tracking and proxy support. | 4,230 |
 maximilian-winter/llama-cpp-agent | A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. | 505 |
 apache/camel | An integration framework for connecting and integrating various systems and data sources | 5,603 |
 wechaty/wechaty | A conversational RPA SDK that simplifies the process of building chatbots across multiple messaging platforms. | 20,593 |
 doriandarko/claude-engineer | An AI-powered framework for creating and managing tools to expand its own capabilities through conversation | 10,266 |
 sugarforever/chat-ollama | An open-source chatbot platform using large language models and vector databases | 2,707 |
 kent0n-li/chatdoctor | An AI chat model designed to simulate medical conversations with patients and doctors | 3,495 |
 noizu-labs-ml/ex_llama | Provides Elixir bindings for interacting with a machine learning chat model using C++ | 10 |
 meta-llama/llama-stack | Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design. | 5,164 |
 lm-sys/fastchat | An open platform for training, serving, and evaluating large language models used in chatbots. | 37,269 |