less-is-more

Hallucination mitigation

Improving multimodal hallucination mitigation in EOS decision-making by selectively supervising training data

Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)

GitHub

39 stars
1 watching
0 forks
Language: Python
last commit: almost 2 years ago

Related projects:

RepositoryDescriptionStars
fuxiaoliu/lrv-instructionA research project focused on mitigating hallucinations in large multi-modal models by improving instruction tuning through robust training methods.262
x-plug/mplug-halowlEvaluates and mitigates hallucinations in multimodal large language models82
lalbj/paiImproves the performance of large language models by intervening in their internal workings to reduce hallucinations83
yfzhang114/llava-alignDebiasing techniques to minimize hallucinations in large visual language models75
1zhou-wang/memvrAn implementation of a method to mitigate hallucinations in large language models using visual re-tracing28
yiyangzhou/lureAnalyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability.136
bradyfu/woodpeckerA method to correct hallucinations in multimodal large language models without requiring retraining617
assafbk/mocha_codeA unified framework and benchmark for detecting and mitigating hallucinations in open-vocabulary image captioning models13
tianyi-lab/hallusionbenchAn image-context reasoning benchmark designed to challenge large vision-language models and help improve their accuracy259
yuqifan1117/hallucidoctorThis project provides tools and frameworks to mitigate hallucinatory toxicity in visual instruction data, allowing researchers to fine-tune MLLM models on specific datasets.41
billchan226/halcAn implementation of an object hallucination reduction method using a PyTorch framework and various decoding algorithms.72
damo-nlp-sg/vcdAn approach to reduce object hallucinations in large vision-language models by contrasting output distributions derived from original and distorted visual inputs222
bronyayang/halle_controlControlling object hallucination in large multimodal models28
nickjiang2378/vl-interpThis project provides an official PyTorch implementation of a method to interpret and edit vision-language representations to mitigate hallucinations in image captions.46
masaiahhan/correlationqaAn investigation into the relationship between misleading images and hallucinations in large language models8