GPTCache
by zilliztech
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
AI summary
LLM Cache
A semantic cache designed to reduce the cost and improve the speed of LLM API calls by storing responses.
- stars
- 7.3K
- forks
- 511
- watching
- 58
- awesome lists
- 4
Similar projects
Found by comparing what the projects do, not just their names.
LLM Client
A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4.
modeltc/lightllm2.7K
LLM server
A Python-based framework for serving large language models with low latency and high scalability.
tmc/langchaingo5.2K
LLM generator
Provides a Go implementation of LangChain for generating text based on large language models.
LLM guide
A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP
mlabonne/llm-course40.1K
LLM tutorial
A comprehensive course and resource package on building and deploying Large Language Models (LLMs)
AI app templates
Provides pre-built AI application templates to integrate Large Language Models (LLMs) with various data sources for scalable RAG and enterprise search.
Reasoning platform
A framework for building context-aware reasoning applications using language models and composability
LLM application builder
A framework for developing applications powered by large language models.
Chat Bot
A chatbot that leverages LangChain and LangGraph to generate real-time answers to user queries from a vector store of pre-loaded documentation.
nomic-ai/gpt4all71.2K
LLM client
An open-source Python client for running Large Language Models (LLMs) locally on any device.
LLM toolset
A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures.
Instruction framework
Large pre-trained language models trained to follow complex instructions using an evolutionary instruction framework
GPT model development
Developing and pretraining a GPT-like Large Language Model from scratch
LLM integrator
A unified Java API for integrating Large Language Models (LLMs) and vector stores into Java applications
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
Featured in 4 awesome lists
Each link jumps to the spot where the list mentions GPTCache.
