FlagEval
FlagEval is an evaluation toolkit for AI large foundation models.
AI summary
Model evaluation framework
An evaluation toolkit and platform for assessing large models in various domains
- stars
- 307
- forks
- 27
- watching
- 13
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Language model toolkit
Provides pre-trained language models and tools for fine-tuning and evaluation
Evaluation pipeline
A framework for evaluating language models on NLP tasks
LLM evaluator
An all-in-one toolkit for evaluating Large Language Models (LLMs) across multiple backends.
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
ModelEvaluator
A framework to evaluate and compare language models by analyzing their performance on various tasks
baaivision/emu1.7K
Model framework
A multimodal generative model framework
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
LLM evaluator collection
A collaborative catalogue of LLM evaluation frameworks and papers
Model inspector
A framework for evaluating large language models
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Featured in 1 awesome list
Each link jumps to the spot where the list mentions FlagEval.
