evals
by open-evals
Evals is a framework for evaluating OpenAI models and an open-source registry of benchmarks.
AI summary
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
- stars
- 19
- forks
- 3
- watching
- 1
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
Model evaluation framework
An evaluation toolkit and platform for assessing large models in various domains
LLM evaluator collection
A collaborative catalogue of LLM evaluation frameworks and papers
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
hkust-nlp/ceval1.7K
Evaluation suite
An evaluation suite providing multiple-choice questions for foundation models in various disciplines, with tools for assessing model performance.
cloud-cv/evalai1.8K
Benchmarking tool
A platform for comparing and evaluating AI and machine learning algorithms at scale
DevOps benchmark
An evaluation suite for assessing foundation models in the DevOps field.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Evaluation framework
An evaluation toolkit for large vision-language models
Reward model evaluator
A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Featured in 1 awesome list
Each link jumps to the spot where the list mentions evals.
