gateway
LLM router
A fast and secure routing service for integrating with large language models
A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
7k stars
39 watching
477 forks
Language: TypeScript
last commit: 1 day ago
Linked from 2 awesome lists
ai-gatewaygatewaygenerative-aihacktoberfestlangchainllama-indexllmopsllmsopenaiprompt-engineeringrouter
hannibal046/awesome-llm
kyrolabs/awesome-langchainRelated projects:
| Repository | Description | Stars |
|---|---|---|
 kong/kong | A platform that provides a centralized layer for managing and orchestrating API traffic and microservices | 39,568 |
 significant-gravitas/autogpt | A platform for building and deploying autonomous AI agents to automate complex workflows | 169,186 |
 microsoft/autogen | A framework for building AI agent systems that enables the creation of autonomous applications with multiple large language models and advanced design patterns. | 35,795 |
 josh-xt/agixt | An AI platform that orchestrates instruction management and complex task execution across multiple AI providers | 2,674 |
 meta-llama/llama-stack | Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design. | 5,164 |
 superagent-ai/superagent | An open-source AI framework and API for building intelligent applications | 5,391 |
 livekit/agents | An open-source framework for building real-time, multimodal AI applications with flexible integrations and a focus on voice agents and conversational flow. | 4,210 |
 mervinpraison/praisonai | A low-code framework for building and managing multi-agent LLM systems, focusing on simplicity, customization, and efficient human-agent collaboration. | 2,346 |
 transformeroptimus/superagi | An open-source framework enabling developers to build and run autonomous AI agents quickly and reliably | 15,596 |
 vercel/ai | A toolkit for building AI-powered applications with various frameworks and model providers | 10,554 |
 prefecthq/marvin | An AI toolkit for building natural language interfaces and generating multimedia content | 5,362 |
 flagai-open/flagai | An open-source toolkit for training and deploying large-scale AI models on various downstream tasks with multi-modality | 3,840 |
 ai-shifu/chatall | A platform that enables concurrent interaction with multiple AI chatbots to find the best answers. | 15,332 |
 exo-explore/exo | An experimental software framework to run AI models on diverse devices without requiring expensive GPUs. | 17,369 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |