simple-evals
by openai
AI summary
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
- stars
- 2.1K
- forks
- 177
- watching
- 28
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
Evaluator
An automatic evaluation tool for large language models
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
RAG model evaluator
A tool for automatically evaluating RAG models by generating synthetic data and fine-tuning classifiers
Exam evaluator
Evaluates foundation models on human-centric tasks with diverse exams and question types
Evaluation framework
An evaluation toolkit for large vision-language models
Multimodal model evaluator
An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks
obss/jury187
NLP evaluator
A comprehensive toolkit for evaluating NLP experiments offering automated metrics and efficient computation.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Model evaluator
A tool for evaluating and visualizing machine learning model performance
Model evaluator
Provides a Python scripting infrastructure for evaluating and visualizing meteorological model performance.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions simple-evals.
