reward-bench
by allenai
RewardBench: the first evaluation tool for reward models.
AI summary
Reward model evaluator
A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning.
- stars
- 459
- forks
- 54
- watching
- 5
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
cloud-cv/evalai1.8K
Benchmarking tool
A platform for comparing and evaluating AI and machine learning algorithms at scale
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
thudm/agentbench2.3K
Agent evaluation platform
A benchmark suite for evaluating the ability of large language models to operate as autonomous agents in various environments
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
ethicalml/xai1.1K
Bias analysis tool
An eXplainability toolbox for machine learning that enables data analysis and model evaluation to mitigate biases and improve performance
Experiment runner
A software framework for organizing and running machine learning experiments with Python.
Web task evaluator
A tool to evaluate AI agents on web tasks by dynamically constructing and executing test suites against predefined example websites.
Adversarial benchmarking tool
A standardized benchmark for measuring the robustness of machine learning models against adversarial attacks
RL agent
An implementation of an actor-critic reinforcement learning algorithm in Python.
RL Benchmark
A benchmark suite for unsupervised reinforcement learning agents, providing pre-trained models and scripts for testing and fine-tuning agent performance.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
Benchmarker
Tools for comparing and benchmarking small code snippets
Featured in 1 awesome list
Each link jumps to the spot where the list mentions reward-bench.