PCA-EVAL
by pkunlp-icler
[ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
AI summary
Multimodal model evaluator
An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks
- stars
- 99
- forks
- 3
- watching
- 5
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Model evaluator
A tool for evaluating and visualizing machine learning model performance
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Evaluation framework
An evaluation toolkit for large vision-language models
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Evaluator
An automatic evaluation tool for large language models
Model evaluator
A library that enables evaluation of predictive models stored in PMML format within Apache Spark
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
