CharXiv
[NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
AI summary
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
- stars
- 85
- forks
- 9
- watching
- 3
Similar projects
Found by comparing what the projects do, not just their names.
hkust-nlp/ceval1.7K
Evaluation suite
An evaluation suite providing multiple-choice questions for foundation models in various disciplines, with tools for assessing model performance.
Exam evaluator
Evaluates foundation models on human-centric tasks with diverse exams and question types
Multimodal model evaluator
An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks
cloud-cv/evalai1.8K
Benchmarking tool
A platform for comparing and evaluating AI and machine learning algorithms at scale
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Multimodal LLM test suite
A benchmark for evaluating large language models' ability to process multimodal input
chart evaluation tool
An open-source benchmarking project that evaluates large multimodal models' code generation capabilities via visually-grounded chart-to-code conversion
obss/jury187
NLP evaluator
A comprehensive toolkit for evaluating NLP experiments offering automated metrics and efficient computation.
Chart model trainer
Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models.
Model value alignment
Evaluates and aligns the values of Chinese large language models with safety and responsibility standards
Evaluation framework
An evaluation toolkit for large vision-language models
Legal model evaluator
Evaluates the legal knowledge of large language models using a custom benchmarking framework.
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
