AgentBench
by THUDM
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
AI summary
Agent evaluation platform
A benchmark suite for evaluating the ability of large language models to operate as autonomous agents in various environments
- stars
- 2.3K
- forks
- 167
- watching
- 28
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
agenta-ai/agenta1.6K
LLM platform
An end-to-end platform for building and deploying large language model applications
AI agent framework
A framework and benchmark for training and evaluating multi-modal large language models, enabling the development of AI agents capable of seamless interaction between humans and machines.
LM Benchmark
A benchmark for evaluating large language models in multiple languages and formats
Benchmark
An image-context reasoning benchmark designed to challenge large vision-language models and help improve their accuracy
LLM toolkit
A comprehensive toolset for building Large Language Model (LLM) based applications
LLM benchmarker
A benchmarking framework for large language models
LLM agent
Builds agents controlled by large language models (LLMs) to perform tasks with tool-based components
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
LLM interface
A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output.
Reward model evaluator
A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning.
internlm/lagent1.9K
LLM agent framework
A lightweight framework for building agent-based applications using LLMs and transformer architectures
Legal model evaluator
Evaluates the legal knowledge of large language models using a custom benchmarking framework.
Long Context Aligner
A framework for training and evaluating large language models on long context inputs
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Featured in 1 awesome list
Each link jumps to the spot where the list mentions AgentBench.
