docker-llama2-chat
LLaMA deployment tool
An implementation of LLaMA2 in Docker, allowing users to quickly deploy and run the model on their local machine.
Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)
536 stars
6 watching
83 forks
Language: Python
last commit: over 1 year ago llamallama2llama2-dockerllama2-playgroundllm
Related projects:
| Repository | Description | Stars |
|---|---|---|
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,937 |
 git-cloner/llama2-lora-fine-tuning | Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset. | 167 |
 linksoul-ai/chinese-llama-2-7b | A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data | 2,228 |
| run-llama/llama_deploy | An async-first framework for deploying and scaling agentic multi-service systems | 1,832 |
 jpmcb/nvim-llama | An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. | 259 |
 terminaldweller/milla | An IRC bot that interacts with language models to provide answers and has customizable syntax highlighting. | 5 |
 snunez1/llama.cl | A Common Lisp port of a Large Language Model (LLM) implementation | 35 |
 dicklesworthstone/swiss_army_llama | A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures. | 941 |
 juncongmoo/chatllama | An open source implementation of LLaMA-based chatbots using reinforcement learning from human feedback for faster training and inference | 1,207 |
 maximilian-winter/llama-cpp-agent | A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. | 493 |
 eublefar/llamasharpunitydemo | An example Unity project demonstrating integration of the LLAMASharp library for text generation and chat applications | 60 |
 talkdai/dialog | An application framework to simplify the deployment and testing of large language models (LLMs) for natural language processing tasks. | 377 |
 crazyboym/llama2-chinese-chat | An open-source implementation of a Chinese-language LLaMa2 chat model for seamless multiround conversations | 89 |
 sangyuxiaowu/llamaworker | Provides an HTTP API server for integrating Large Language Models into applications | 48 |
 melih-unsal/demogpt | A comprehensive toolset for building Large Language Model (LLM) based applications | 1,710 |