less-is-more

Hallucination mitigation

Improving multimodal hallucination mitigation in EOS decision-making by selectively supervising training data

Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)

GitHub

31 stars
1 watching
0 forks
Language: Python
last commit: 25 days ago

Related projects:

Repository Description Stars
fuxiaoliu/lrv-instruction A research project focused on mitigating hallucinations in large multi-modal models by improving instruction tuning through robust training methods. 255
x-plug/mplug-halowl Evaluates and mitigates hallucinations in multimodal large language models 79
lalbj/pai Improves the performance of large language models by intervening in their internal workings to reduce hallucinations 67
yfzhang114/llava-align Debiasing techniques to minimize hallucinations in large visual language models 71
1zhou-wang/memvr An implementation of a method to mitigate hallucinations in large language models using visual re-tracing 27
yiyangzhou/lure Analyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability. 134
bradyfu/woodpecker A method to correct hallucinations in multimodal large language models during text generation 611
assafbk/mocha_code A unified framework and benchmark for detecting and mitigating hallucinations in open-vocabulary image captioning models 12
tianyi-lab/hallusionbench An image-context reasoning benchmark designed to challenge large vision-language models and help improve their accuracy 243
yuqifan1117/hallucidoctor This project provides tools and frameworks to mitigate hallucinatory toxicity in visual instruction data, allowing researchers to fine-tune MLLM models on specific datasets. 41
billchan226/halc An implementation of an object hallucination reduction method using a PyTorch framework and various decoding algorithms. 69
damo-nlp-sg/vcd An approach to reduce object hallucinations in large vision-language models by contrasting output distributions derived from original and distorted visual inputs 209
bronyayang/halle_control Controlling object hallucination in large multimodal models 28
nickjiang2378/vl-interp This project provides an official PyTorch implementation of a method to interpret and edit vision-language representations to mitigate hallucinations in image captions. 31
masaiahhan/correlationqa An investigation into the relationship between misleading images and hallucinations in large language models 8