litellm
LLM gateway
Provides a unified API to interact with 100+ Large Language Models (LLMs) offered by various providers
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
14k stars
75 watching
2k forks
Language: Python
last commit: 6 days ago ai-gatewayanthropicazure-openaibedrockgatewaylangchainllmllm-gatewayllmopsopenaiopenai-proxyvertex-ai
Related projects:
| Repository | Description | Stars |
|---|---|---|
 llm-workflow-engine/llm-workflow-engine | A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4. | 3,659 |
 langfuse/langfuse | An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools. | 6,537 |
 modeltc/lightllm | An LLM inference and serving framework providing a lightweight design, scalability, and high-speed performance for large language models. | 2,609 |
 microsoft/semantic-kernel | An SDK that integrates LLMs with conventional programming languages to create AI-powered applications. | 21,946 |
 r2d4/openlm | Library that provides a unified API to interact with various Large Language Models (LLMs) | 366 |
 betalgo/openai | A .NET library providing access to the OpenAI service API. | 2,900 |
 instructor-ai/instructor | A Python library that provides structured outputs from large language models (LLMs) and facilitates seamless integration with various LLM providers. | 8,163 |
 wandb/openui | A tool that lets you describe UI components using imagination and see them rendered live, with support for various LLM services. | 19,286 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 6,651 |
 bricks-cloud/bricksllm | An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring | 921 |
 shroominic/codeinterpreter-api | An API for executing and analyzing code in sandboxed environments | 3,794 |
 openai/openai-python | A Python library providing convenient access to the OpenAI API for various tasks such as chat completion and image processing. | 23,015 |
 langroid/langroid | A Python framework to build LLM-powered applications by setting up agents with optional components and having them collaboratively solve problems through message exchange | 2,654 |
 ericlbuehler/mistral.rs | A fast and flexible LLM inference platform supporting various models and devices | 4,466 |
 tmc/langchaingo | Provides a Go implementation of LangChain for generating text based on large language models. | 4,635 |