less-is-more
Hallucination mitigation
Improving multimodal hallucination mitigation in EOS decision-making by selectively supervising training data
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
39 stars
1 watching
0 forks
Language: Python
last commit: 3 months ago Related projects:
Repository | Description | Stars |
---|---|---|
fuxiaoliu/lrv-instruction | A research project focused on mitigating hallucinations in large multi-modal models by improving instruction tuning through robust training methods. | 262 |
x-plug/mplug-halowl | Evaluates and mitigates hallucinations in multimodal large language models | 82 |
lalbj/pai | Improves the performance of large language models by intervening in their internal workings to reduce hallucinations | 83 |
yfzhang114/llava-align | Debiasing techniques to minimize hallucinations in large visual language models | 75 |
1zhou-wang/memvr | An implementation of a method to mitigate hallucinations in large language models using visual re-tracing | 28 |
yiyangzhou/lure | Analyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability. | 136 |
bradyfu/woodpecker | A method to correct hallucinations in multimodal large language models without requiring retraining | 617 |
assafbk/mocha_code | A unified framework and benchmark for detecting and mitigating hallucinations in open-vocabulary image captioning models | 13 |
tianyi-lab/hallusionbench | An image-context reasoning benchmark designed to challenge large vision-language models and help improve their accuracy | 259 |
yuqifan1117/hallucidoctor | This project provides tools and frameworks to mitigate hallucinatory toxicity in visual instruction data, allowing researchers to fine-tune MLLM models on specific datasets. | 41 |
billchan226/halc | An implementation of an object hallucination reduction method using a PyTorch framework and various decoding algorithms. | 72 |
damo-nlp-sg/vcd | An approach to reduce object hallucinations in large vision-language models by contrasting output distributions derived from original and distorted visual inputs | 222 |
bronyayang/halle_control | Controlling object hallucination in large multimodal models | 28 |
nickjiang2378/vl-interp | This project provides an official PyTorch implementation of a method to interpret and edit vision-language representations to mitigate hallucinations in image captions. | 46 |
masaiahhan/correlationqa | An investigation into the relationship between misleading images and hallucinations in large language models | 8 |