OpenLLM
by bentoml
Pythonpushed almost 2 years ago
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
AI summary
LLM host
A tool for hosting and serving large language models as cloud-based APIs
- stars
- 10.2K
- forks
- 650
- watching
- 56
- awesome lists
- 3
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions OpenLLM.