BricksLLM

LLM Gateway

An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

GitHub

926 stars
7 watching
65 forks
Language: Go
last commit: 16 days ago
Linked from 1 awesome list

aianthropicapiartificial-intelligenceazuredockergenerative-aigolanggptllmopen-sourceopenaipostgresqlprivacyrest-apisecurityself-hostedvllmycombinator

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
aiplanethub/beyondllm An open-source toolkit for building and evaluating large language models 264
r2d4/openlm Library that provides a unified API to interact with various Large Language Models (LLMs) 366
ai-hypercomputer/maxtext A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. 1,546
ngxson/wllama A WebAssembly binding for the LLaMA model that enables on-browser inference without requiring a backend or GPU. 451
run-llama/llamaindexts A data framework for integrating large language models into applications with custom data 1,976
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 254
stoyan-stoyanov/llmflows A framework for building transparent and explicit LLM-powered applications with simple APIs 670
lazyagi/lazyllm A low-code development tool for building multi-agent large language models applications 1,027
melih-unsal/demogpt A comprehensive toolset for building Large Language Model (LLM) based applications 1,726
kurama622/llm.nvim A Neovim plugin providing an interface to interact with large language models (LLMs) for tasks such as code optimization and translation. 56
jpmcb/nvim-llama An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. 262
matlab-deep-learning/llms-with-matlab Connects MATLAB to LLM APIs for natural language processing capabilities 115
llm-ui-kit/llm-ui A React library designed to work with Large Language Models (LLMs) by providing features such as syntax removal, custom component addition, and rendering at a native frame rate. 413
sunlemuria/opengptandbeyond An effort to develop and compare large language models beyond OpenGPT 105