litellm
LLM gateway
Provides a unified API to interact with 100+ Large Language Models (LLMs) offered by various providers
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
15k stars
81 watching
2k forks
Language: Python
last commit: almost 2 years agoai-gatewayanthropicazure-openaibedrockgatewaylangchainllmllm-gatewayllmopsopenaiopenai-proxyvertex-ai
Related projects:
| Repository | Description | Stars |
|---|---|---|
 llm-workflow-engine/llm-workflow-engine | A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4. | 3,674 |
 langfuse/langfuse | An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools. | 7,123 |
 modeltc/lightllm | A Python-based framework for serving large language models with low latency and high scalability. | 2,691 |
 microsoft/semantic-kernel | An SDK that integrates LLMs with conventional programming languages to create AI-powered applications. | 22,277 |
 r2d4/openlm | Library that provides a unified API to interact with various Large Language Models (LLMs) | 367 |
 betalgo/openai | A .NET library providing access to the OpenAI service API. | 2,912 |
 instructor-ai/instructor | A Python library that simplifies working with structured outputs from large language models | 8,551 |
 wandb/openui | A tool that lets you describe UI components using imagination and see them rendered live, with support for various LLM services. | 19,506 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |
 bricks-cloud/bricksllm | An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring | 938 |
 shroominic/codeinterpreter-api | An API for executing and analyzing code in sandboxed environments | 3,803 |
 openai/openai-python | A Python library providing convenient access to the OpenAI API for various tasks such as chat completion and image processing. | 23,471 |
 langroid/langroid | A Python framework to build LLM-powered applications by setting up agents with optional components and having them collaboratively solve problems through message exchange | 2,795 |
 ericlbuehler/mistral.rs | A high-performance LLM inference framework written in Rust | 4,677 |
 tmc/langchaingo | Provides a Go implementation of LangChain for generating text based on large language models. | 5,155 |