BricksLLM
LLM Gateway
An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
921 stars
7 watching
64 forks
Language: Go
last commit: 12 days ago
Linked from 1 awesome list
aianthropicapiartificial-intelligenceazuredockergenerative-aigolanggptllmopen-sourceopenaipostgresqlprivacyrest-apisecurityself-hostedvllmycombinator
rootsongjc/awesome-cloud-nativeRelated projects:
| Repository | Description | Stars |
|---|---|---|
 victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |
 aiplanethub/beyondllm | An open-source toolkit for building and evaluating large language models | 261 |
 r2d4/openlm | Library that provides a unified API to interact with various Large Language Models (LLMs) | 366 |
 ai-hypercomputer/maxtext | A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. | 1,529 |
 ngxson/wllama | A WebAssembly binding for a large language model inference engine | 437 |
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,937 |
 internlm/openaoe | Enables users to engage with multiple large language models simultaneously and access their APIs | 253 |
 stoyan-stoyanov/llmflows | A framework for building transparent and explicit LLM-powered applications with simple APIs | 668 |
 lazyagi/lazyllm | A low-code development tool for building multi-agent large language models applications | 1,020 |
 melih-unsal/demogpt | A comprehensive toolset for building Large Language Model (LLM) based applications | 1,710 |
 kurama622/llm.nvim | An extension for Neovim that integrates with large language models to provide tools for text translation, code explanation and optimization. | 47 |
 jpmcb/nvim-llama | An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. | 259 |
 matlab-deep-learning/llms-with-matlab | Connects MATLAB to LLM APIs for natural language processing capabilities | 113 |
 llm-ui-kit/llm-ui | A React library designed to work with Large Language Models (LLMs) by providing features such as syntax removal, custom component addition, and rendering at a native frame rate. | 403 |
 sunlemuria/opengptandbeyond | An effort to develop and compare large language models beyond OpenGPT | 105 |