docker-llama2-chat
by soulteary
Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)
AI summary
LLaMA deployment tool
An implementation of LLaMA2 in Docker, allowing users to quickly deploy and run the model on their local machine.
- stars
- 537
- forks
- 83
- watching
- 6
Similar projects
Found by comparing what the projects do, not just their names.
LLM integrator
A data framework for integrating large language models into applications with custom data
Chatbot fine-tuning
Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset.
Llama model
A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data
Deployment framework
An async-first framework for deploying and scaling agentic multi-service systems
LLM interface
An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities.
IRC bot
An IRC bot that interacts with language models to provide answers and has customizable syntax highlighting.
LLM library
A Common Lisp port of a Large Language Model (LLM) implementation
LLM toolset
A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures.
LLaMA chatbot library
An open source implementation of LLaMA-based chatbots using reinforcement learning from human feedback for faster training and inference
LLM interface
A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output.
Chat demo
An example Unity project demonstrating integration of the LLAMASharp library for text generation and chat applications
LLM deployer
An application framework to simplify the deployment and testing of large language models (LLMs) for natural language processing tasks.
Chinese chatbot
An open-source implementation of a Chinese-language LLaMa2 chat model for seamless multiround conversations
LLM server
Provides an HTTP API server for integrating Large Language Models into applications
LLM toolkit
A comprehensive toolset for building Large Language Model (LLM) based applications
