Awesome Lists

OpenLLM

by bentoml

Pythonpushed almost 2 years ago

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

AI summary

LLM host

A tool for hosting and serving large language models as cloud-based APIs

stars
10.2K
forks
650
watching
56
awesome lists
3
View on GitHubbentoml.com

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/bentoml/OpenLLM/links.svg)](https://awesome.facts.dev/awesome/bentoml/OpenLLM)
HTML
<a href="https://awesome.facts.dev/awesome/bentoml/OpenLLM"><img src="https://awesome.facts.dev/shield/bentoml/OpenLLM/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/bentoml/OpenLLM/links.svg

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.