dialog

LLM deployer

An application framework to simplify the deployment and testing of large language models (LLMs) for natural language processing tasks.

RAG LLM Ops App for easy deployment and testing

GitHub

377 stars
6 watching
49 forks
Language: Python
last commit: 22 days ago
Linked from 1 awesome list

chatgptlangchainllmnlpnltk

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
langchain-ai/langserve Provides a REST API for deploying and managing LangChain runnables and chains 1,944
melih-unsal/demogpt A comprehensive toolset for building Large Language Model (LLM) based applications 1,710
llm-ui-kit/llm-ui A React library designed to work with Large Language Models (LLMs) by providing features such as syntax removal, custom component addition, and rendering at a native frame rate. 403
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
damo-nlp-mt/polylm A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. 76
run-llama/llama_deploy An async-first framework for deploying and scaling agentic multi-service systems 1,832
msoedov/langcorn A framework for serving large language models with a robust and efficient API 906
agenta-ai/agenta A developer platform for building and deploying large language models 1,275
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 253
wgryc/phasellm A framework for managing and testing large language models to evaluate their performance and optimize user experiences. 448
youssefhosni/hands-on-langchain-for-llm-applications-development A collection of hands-on tutorials and guides for developing applications using LangChain and its integration with LLMs (Large Language Models) 134
damo-nlp-sg/m3exam A benchmark for evaluating large language models in multiple languages and formats 92
li2109/langtorch Builds composable LLM applications with Java 294
jackmpcollins/magentic A Python library that integrates Large Language Models into Python code by allowing developers to easily call LLMs as functions. 2,048
aiplanethub/beyondllm An open-source toolkit for building and evaluating large language models 261