VLMEvalKit
by open-compass
Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
AI summary
Evaluation framework
An evaluation toolkit for large vision-language models
- stars
- 1.5K
- forks
- 211
- watching
- 11
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Legal model evaluator
Evaluates the legal knowledge of large language models using a custom benchmarking framework.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Multi-modal model evaluation suite
A collection of benchmarks to evaluate the multi-modal understanding capability of large vision language models.
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
LLM evaluator
An all-in-one toolkit for evaluating Large Language Models (LLMs) across multiple backends.
Multimodal model evaluator
An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
Visual decoder
A large language model designed to process and generate visual information
Model evaluator
A tool for evaluating and visualizing machine learning model performance
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Model evaluator
A community-developed tool for evaluating climate models and providing diagnostic metrics.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions VLMEvalKit.
