langcorn
LLM server
A framework for serving large language models with a robust and efficient API
⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
906 stars
9 watching
68 forks
Language: Python
last commit: 4 months ago
Linked from 1 awesome list
apifastapilangchainlangchain-pythonlarge-language-modelsllmllmopsopenai-apirest-apivercelvercel-serverless-functions
kyrolabs/awesome-langchainRelated projects:
| Repository | Description | Stars |
|---|---|---|
 victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 508 |
 phellonchen/x-llm | A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. | 306 |
 damo-nlp-mt/polylm | A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. | 76 |
 pors/langchain-chat-websockets | An open-source chat application using LangChain and FastAPI that enables real-time conversations with an LLM | 89 |
 pleisto/yuren-baichuan-7b | A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks | 72 |
 deeplangai/lingowhale-8b | An open bilingual LLM developed using the LingoWhale model, trained on a large dataset of high-quality middle English text, and fine-tuned for specific tasks such as conversation generation. | 134 |
 ajndkr/lanarky | A Python web framework specifically designed to build LLM microservices with built-in support for FastAPI and streaming capabilities. | 976 |
 r2d4/openlm | Library that provides a unified API to interact with various Large Language Models (LLMs) | 366 |
 dicklesworthstone/swiss_army_llama | A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures. | 941 |
 langchain-ai/langserve | Provides a REST API for deploying and managing LangChain runnables and chains | 1,944 |
 snunez1/llama.cl | A Common Lisp port of a Large Language Model (LLM) implementation | 35 |
 sangyuxiaowu/llamaworker | Provides an HTTP API server for integrating Large Language Models into applications | 48 |
 maximilian-winter/llama-cpp-agent | A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. | 493 |
 damo-nlp-sg/m3exam | A benchmark for evaluating large language models in multiple languages and formats | 92 |