litellm
by BerriAI
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
AI summary
LLM gateway
Provides a unified API to interact with 100+ Large Language Models (LLMs) offered by various providers
- stars
- 15.1K
- forks
- 1.8K
- watching
- 81
Similar projects
Found by comparing what the projects do, not just their names.
LLM Client
A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4.
LLM toolkit
An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools.
modeltc/lightllm2.7K
LLM server
A Python-based framework for serving large language models with low latency and high scalability.
LLM integration platform
An SDK that integrates LLMs with conventional programming languages to create AI-powered applications.
r2d4/openlm367
LLM client
Library that provides a unified API to interact with various Large Language Models (LLMs)
betalgo/openai2.9K
API wrapper
A .NET library providing access to the OpenAI service API.
LLM handler
A Python library that simplifies working with structured outputs from large language models
wandb/openui19.5K
UI renderer
A tool that lets you describe UI components using imagination and see them rendered live, with support for various LLM services.
LLM app builder
A framework for building enterprise LLM-based applications using small, specialized models
LLM Gateway
An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring
Code Executor
An API for executing and analyzing code in sandboxed environments
openai/openai-python23.5K
API Client Library
A Python library providing convenient access to the OpenAI API for various tasks such as chat completion and image processing.
Agent framework
A Python framework to build LLM-powered applications by setting up agents with optional components and having them collaboratively solve problems through message exchange
LLM inference framework
A high-performance LLM inference framework written in Rust
tmc/langchaingo5.2K
LLM generator
Provides a Go implementation of LangChain for generating text based on large language models.
