BricksLLM
LLM Gateway
An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
926 stars
7 watching
65 forks
Language: Go
last commit: 16 days ago
Linked from 1 awesome list
aianthropicapiartificial-intelligenceazuredockergenerative-aigolanggptllmopen-sourceopenaipostgresqlprivacyrest-apisecurityself-hostedvllmycombinator
Related projects:
Repository | Description | Stars |
---|---|---|
victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |
aiplanethub/beyondllm | An open-source toolkit for building and evaluating large language models | 264 |
r2d4/openlm | Library that provides a unified API to interact with various Large Language Models (LLMs) | 366 |
ai-hypercomputer/maxtext | A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. | 1,546 |
ngxson/wllama | A WebAssembly binding for the LLaMA model that enables on-browser inference without requiring a backend or GPU. | 451 |
run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,976 |
internlm/openaoe | Enables users to engage with multiple large language models simultaneously and access their APIs | 254 |
stoyan-stoyanov/llmflows | A framework for building transparent and explicit LLM-powered applications with simple APIs | 670 |
lazyagi/lazyllm | A low-code development tool for building multi-agent large language models applications | 1,027 |
melih-unsal/demogpt | A comprehensive toolset for building Large Language Model (LLM) based applications | 1,726 |
kurama622/llm.nvim | A Neovim plugin providing an interface to interact with large language models (LLMs) for tasks such as code optimization and translation. | 56 |
jpmcb/nvim-llama | An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. | 262 |
matlab-deep-learning/llms-with-matlab | Connects MATLAB to LLM APIs for natural language processing capabilities | 115 |
llm-ui-kit/llm-ui | A React library designed to work with Large Language Models (LLMs) by providing features such as syntax removal, custom component addition, and rendering at a native frame rate. | 413 |
sunlemuria/opengptandbeyond | An effort to develop and compare large language models beyond OpenGPT | 105 |