OpenLLM

LLM host

A tool for hosting and serving large language models as cloud-based APIs

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

GitHub

10k stars
56 watching
650 forks
Language: Python
last commit: almost 2 years ago
Linked from 3 awesome lists

bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-opsllm-servingllmopsmistralmlopsmodel-inferenceopen-source-llmopenllmvicuna

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
crawlscript/webcollectorA Java-based framework for building web crawlers with automatic URL detection and content extraction capabilities.3,074
pallets/quartAn asynchronous Python framework for building web applications using ASGI and asyncio.3,076
mtytel/helmA software platform for creating and manipulating sound in real-time using multiple oscillators, filters, and effects2,387
ruanyf/weeklyA platform sharing and discussing technology-related content on a weekly basis.49,688
yogeshojha/rengineAutomated reconnaissance framework for web applications with customizable workflow and data correlation.7,588
amyreese/zsh-takeReplication of the "take" functionality from Oh My Zsh, allowing users to create and navigate directories with a single command.3
joaomdmoura/machineryA lightweight Elixir library for creating and managing state machines538
kdomanski/iso9660A package for reading and creating ISO9660 images265
jxub/barrel_exAn Elixir client for interacting with the BarrelDB database system.0
batate/elixir-pipesProvides macros to extend Elixir's pipe operator for more flexible function composition and error handling325
fabiokiatkowski/exercism.plugin.zshA plugin to enhance the Oh My Zsh framework with features and functionality from Excercism.io for learning and improving shell scripting skills.10
jwhiteman/a-little-elixir-goes-a-long-wayPort of The Little Schemer to Elixir with exercises and algorithms in Scheme, along with unit tests and comparisons.349
hemanth/bangalore-startupsAn extensive list of Bangalore-based startups organized by name31
parroty/oauth2exAn OAuth 2.0 client library for Elixir.56
antonmi/espec_phoenixProvides an Elixir wrapper around ESpec to enable Behavioral Driven Development (BDD) for the Phoenix web framework138