text-generation-inference
by huggingface
Large Language Model Text Generation Inference
AI summary
Text Generation Toolkit
A toolkit for deploying and serving Large Language Models (LLMs) for high-performance text generation
- stars
- 9.5K
- forks
- 1.1K
- watching
- 104
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Embedding Server
A toolkit for deploying and serving text embeddings models with high-performance inference capabilities.
ggerganov/llama.cpp69.2K
LLM inference software
Enables LLM inference with minimal setup and high performance on various hardware platforms
Batch processor
Generates large language model outputs in high-throughput mode on single GPUs
Tokenizer toolkit
A toolkit providing optimized tokenizers for natural language processing tasks in various programming languages.
google/big-bench2.9K
Language model benchmark
A benchmark designed to probe large language models and extrapolate their future capabilities through a diverse set of tasks.
Model repository
A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects.
Prompt engineering guide
Guides software developers on how to effectively use and build systems around Large Language Models like GPT-4.
meta-llama/codellama16.1K
Code generator
Provides inference code and tools for fine-tuning large language models, specifically designed for code generation tasks
modeltc/lightllm2.7K
LLM server
A Python-based framework for serving large language models with low latency and high scalability.
Text generator UI
A web-based interface for generating text using large language models
LLM
A large language model series with various sizes and variants for text generation and understanding.
LLM evaluator
A framework for evaluating large language models
Machine learning automator
Automates machine learning workflows and optimizes model performance using large language models and efficient algorithms
Inference engine
A high-performance inference engine for transformer models
LLM inference framework
A high-performance LLM inference framework written in Rust
Featured in 1 awesome list
Each link jumps to the spot where the list mentions text-generation-inference.
