OLMo-Eval
by allenai
Evaluation suite for LLMs
AI summary
Evaluation pipeline
A framework for evaluating language models on NLP tasks
- stars
- 326
- forks
- 39
- watching
- 6
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
LLM evaluator
An evaluation framework for large language models with Elo rating system and A/B testing capabilities
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
Reward model evaluator
A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning.
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Evaluator
An automatic evaluation tool for large language models
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions OLMo-Eval.
