OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
10k stars
55 watching
622 forks
Language: Python
last commit: 7 days ago
Linked from 2 awesome lists
aibentomlfalconfine-tuningllamallama2llmllm-inferencellm-opsllm-servingllmopsmistralmlmlopsmodel-inferencemptopen-source-llmopenllmstablelmvicuna