OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

GitHub

10k stars
55 watching
622 forks
Language: Python
last commit: 7 days ago
Linked from 2 awesome lists

aibentomlfalconfine-tuningllamallama2llmllm-inferencellm-opsllm-servingllmopsmistralmlmlopsmodel-inferencemptopen-source-llmopenllmstablelmvicuna

Backlinks from these awesome lists: