dialog

LLM deployer

An application framework to simplify the deployment and testing of large language models (LLMs) for natural language processing tasks.

RAG LLM Ops App for easy deployment and testing

GitHub

380 stars
6 watching
50 forks
Language: Python
last commit: 2 months ago
Linked from 1 awesome list

chatgptlangchainllmnlpnltk

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
langchain-ai/langserve Provides a REST API for deploying and managing LangChain runnables and chains 1,970
melih-unsal/demogpt A comprehensive toolset for building Large Language Model (LLM) based applications 1,733
llm-ui-kit/llm-ui A React library designed to work with Large Language Models (LLMs) by providing features such as syntax removal, custom component addition, and rendering at a native frame rate. 425
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
damo-nlp-mt/polylm A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. 77
run-llama/llama_deploy An async-first framework for deploying and scaling agentic multi-service systems 1,876
msoedov/langcorn A framework for serving large language models with a robust and efficient API 909
agenta-ai/agenta An end-to-end platform for building and deploying large language model applications 1,624
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 256
wgryc/phasellm A framework for managing and testing large language models to evaluate their performance and optimize user experiences. 451
youssefhosni/hands-on-langchain-for-llm-applications-development A collection of hands-on tutorials and guides for developing applications using LangChain and its integration with LLMs (Large Language Models) 138
damo-nlp-sg/m3exam A benchmark for evaluating large language models in multiple languages and formats 93
li2109/langtorch Builds composable LLM applications with Java 295
jackmpcollins/magentic A tool to integrate Large Language Models into Python code seamlessly 2,104
aiplanethub/beyondllm An open-source toolkit for building and evaluating large language models 267