HallusionBench
by tianyi-lab
[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
AI summary
Benchmark
An image-context reasoning benchmark designed to challenge large vision-language models and help improve their accuracy
- stars
- 259
- forks
- 7
- watching
- 4
Similar projects
Found by comparing what the projects do, not just their names.
Hallucination corrector
A method to correct hallucinations in multimodal large language models without requiring retraining
Model debiasing
Debiasing techniques to minimize hallucinations in large visual language models
Hallucination Detector
Automates fine-grained hallucination detection in large language model outputs
Hallucination tester
Evaluates and mitigates hallucinations in multimodal large language models
Visual Reasoning Benchmark
A benchmarking tool and software framework for evaluating few-shot visual reasoning capabilities in computer vision models.
Model validator
Analyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability.
Hallucination fixer
An implementation of a method to mitigate hallucinations in large language models using visual re-tracing
Hallucination mitigation
A research project focused on mitigating hallucinations in large multi-modal models by improving instruction tuning through robust training methods.
MLLM benchmark
An LLM-free benchmark suite for evaluating MLLMs' hallucination capabilities in various tasks and dimensions
Hallucination fixer
Improves the performance of large language models by intervening in their internal workings to reduce hallucinations
Hallucination detector
Evaluates answers generated by large vision-language models to assess hallucinations
Model Comparison
Compares performance of large language models on generating coherent summaries from short documents
LLM benchmarker
A benchmarking framework for large language models
Hallucination detector
A framework for detecting hallucinations in large language models
Data processing framework
This project provides tools and frameworks to mitigate hallucinatory toxicity in visual instruction data, allowing researchers to fine-tune MLLM models on specific datasets.
