evalscope
by modelscope
A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
AI summary
Model evaluator
A framework for efficiently evaluating and benchmarking large models
- stars
- 308
- forks
- 36
- watching
- 7
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model evaluation framework
A framework for evaluating OpenAI models and an open-source registry of benchmarks.
tsb0601/mmvp296
Visual model evaluation
An evaluation framework for multimodal language models' visual capabilities using image and question benchmarks.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Model evaluation framework
An evaluation toolkit and platform for assessing large models in various domains
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
LLM evaluator collection
A collaborative catalogue of LLM evaluation frameworks and papers
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
Model evaluator
A community-developed tool for evaluating climate models and providing diagnostic metrics.
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions evalscope.
