basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Archived

GitHub
1k stars
22 watching
80 forks
Language: Python
last commit: 9 months ago
Linked from 1 awesome list

generativegpthuggingfacelanguage-modelllamallmmodelnatural-language-processingnlpopenai-apipythontext-generationtransformers

Backlinks from these awesome lists: