llmperf
by ray-project
LLMPerf is a library for validating and benchmarking LLMs
AI summary
LLM benchmarking tool
A tool for evaluating the performance of large language model APIs
- stars
- 678
- forks
- 115
- watching
- 9
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
LLM benchmarker
A benchmarking framework for large language models
LM Benchmark
A benchmark for evaluating large language models in multiple languages and formats
LLM framework
A framework for managing and testing large language models to evaluate their performance and optimize user experiences.
LLM Microservice Framework
A Python web framework specifically designed to build LLM microservices with built-in support for FastAPI and streaming capabilities.
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
LLM framework
A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs.
LLM
An open-source implementation of a vision-language instructed large language model
r2d4/openlm367
LLM client
Library that provides a unified API to interact with various Large Language Models (LLMs)
Model benchmarking suite
Measures the performance of deep learning models in various deployment scenarios.
AI computing framework
A unified framework for scaling AI and Python applications by providing a distributed runtime and a set of libraries for machine learning and other compute tasks.
Visual Model Benchmark
An open-source benchmarking framework for evaluating cross-style visual capability of large multimodal models
LLM tool
A framework for leveraging language models in production code
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
LLM toolkit
An open-source toolkit for building and evaluating large language models
internlm/lagent1.9K
LLM agent framework
A lightweight framework for building agent-based applications using LLMs and transformer architectures
Featured in 1 awesome list
Each link jumps to the spot where the list mentions llmperf.
