ceval
by hkust-nlp
Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]
AI summary
Evaluation suite
An evaluation suite providing multiple-choice questions for foundation models in various disciplines, with tools for assessing model performance.
- stars
- 1.7K
- forks
- 79
- watching
- 14
Similar projects
Found by comparing what the projects do, not just their names.
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
Exam evaluator
Evaluates foundation models on human-centric tasks with diverse exams and question types
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
Language model evaluator
Evaluates German transformer language models with syntactic agreement tests
obss/jury187
NLP evaluator
A comprehensive toolkit for evaluating NLP experiments offering automated metrics and efficient computation.
Client Contribution Evaluator
A framework for evaluating contribution of individual clients in federated learning systems.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Multimodal model evaluator
An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks
Code evaluator
A build-time code evaluation tool for JavaScript
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Model evaluator
Evaluates the capabilities of large multimodal models using a set of diverse tasks and metrics
DevOps benchmark
An evaluation suite for assessing foundation models in the DevOps field.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
