OpenLLM

LLM host

Self-hosting LLMs made easy with OpenAI-compatible APIs and simplified cloud deployment

Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.

GitHub

10k stars
56 watching
636 forks
Language: Python
last commit: 10 days ago
Linked from 3 awesome lists

bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-opsllm-servingllmopsmistralmlopsmodel-inferenceopen-source-llmopenllmvicuna

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
crawlscript/webcollector A Java-based framework for building web crawlers with automatic URL detection and content extraction capabilities. 3,068
pallets/quart An async Python micro framework for building web applications. 3,008
mtytel/helm A polyphonic synthesizer with advanced modulation capabilities and visual feedback. 2,377
ruanyf/weekly A weekly publication featuring curated content on technology and science, written by enthusiasts for the tech community. 47,834
yogeshojha/rengine Automated reconnaissance framework for web applications with customizable workflow and data correlation. 7,514
amyreese/zsh-take Replication of the "take" functionality from Oh My Zsh, allowing users to create and navigate directories with a single command. 3
joaomdmoura/machinery A lightweight Elixir library for creating and managing state machines 535
kdomanski/iso9660 A package for reading and creating ISO9660 images 264
jxub/barrel_ex An Elixir client for interacting with the BarrelDB database system. 0
batate/elixir-pipes Provides macros to extend Elixir's pipe operator for more flexible function composition and error handling 327
fabiokiatkowski/exercism.plugin.zsh A plugin to enhance the Oh My Zsh framework with features and functionality from Excercism.io for learning and improving shell scripting skills. 10
jwhiteman/a-little-elixir-goes-a-long-way Port of The Little Schemer to Elixir with exercises and algorithms in Scheme, along with unit tests and comparisons. 348
hemanth/bangalore-startups An extensive list of Bangalore-based startups organized by name 31
parroty/oauth2ex An OAuth 2.0 client library for Elixir. 57
antonmi/espec_phoenix Provides an Elixir wrapper around ESpec to enable Behavioral Driven Development (BDD) for the Phoenix web framework 138