BricksLLM
LLM Gateway
An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
938 stars
7 watching
66 forks
Language: Go
last commit: about 1 month ago
Linked from 1 awesome list
aianthropicapiartificial-intelligenceazuredockergenerative-aigolanggptllmopen-sourceopenaipostgresqlprivacyrest-apisecurityself-hostedvllmycombinator
rootsongjc/awesome-cloud-nativeRelated projects:
| Repository | Description | Stars |
|---|---|---|
 victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |
 aiplanethub/beyondllm | An open-source toolkit for building and evaluating large language models | 267 |
 r2d4/openlm | Library that provides a unified API to interact with various Large Language Models (LLMs) | 367 |
 ai-hypercomputer/maxtext | A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. | 1,557 |
 ngxson/wllama | A WebAssembly binding for the LLaMA model that enables on-browser inference without requiring a backend or GPU. | 465 |
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,997 |
 internlm/openaoe | Enables users to engage with multiple large language models simultaneously and access their APIs | 256 |
 stoyan-stoyanov/llmflows | A framework for building transparent and explicit LLM-powered applications with simple APIs | 673 |
 lazyagi/lazyllm | A low-code development tool for building multi-agent large language models applications | 1,039 |
 melih-unsal/demogpt | A comprehensive toolset for building Large Language Model (LLM) based applications | 1,733 |
 kurama622/llm.nvim | Enables users to interact with large language models within Neovim for tasks like code optimization and translation. | 65 |
 jpmcb/nvim-llama | An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. | 263 |
 matlab-deep-learning/llms-with-matlab | Connects MATLAB to LLM APIs for natural language processing capabilities | 119 |
 llm-ui-kit/llm-ui | A React library designed to work with Large Language Models (LLMs) by providing features such as syntax removal, custom component addition, and rendering at a native frame rate. | 425 |
 sunlemuria/opengptandbeyond | An effort to develop and compare large language models beyond OpenGPT | 105 |