通过修正注意力失衡,有效减少大模型幻觉问题。
Mitigating Object Hallucinations in LVLMs via Attention Imbalance Rectification
- 提出注意力失衡概念,量化并可视化导致幻觉的注意力分配问题。
- 在多个基准上实现最高35.1%的幻觉率下降,提升模型通用能力。
- 轻量级解码时干预方法,适合高风险场景部署使用。
大型视觉语言模型(LVLMs)中的物体幻觉严重影响其在真实世界应用中的可靠性,成为自动驾驶和医学图像分析等高风险场景部署的关键障碍。通过系统性实证研究,我们发现跨模态(视觉与语言之间)及模态内(各标记间)注意力分配不均与物体幻觉存在强因果关联。基于此,提出注意力失衡概念,不仅能量化注意力差异程度,还能可视化揭示导致幻觉的模式(如对无关语言标记过度关注或对关键视觉特征关注不足)。为缓解幻觉,进一步提出轻量级解码时干预方法——注意力失衡修正(AIR),通过重分配注意力权重、调整分布以纠正模态间与标记间的不平衡。在四个主流LVLMs及三个基准(CHAIR、POPE、MM-Vet)上的广泛评估表明,AIR持续降低幻觉率,相较基线最高减少35.1%,同时在多样化任务中提升模型通用能力达15.9%。
原文摘要 · Abstract (English)
Object hallucination in Large Vision-Language Models (LVLMs) severely compromises their reliability in real-world applications, posing a critical barrier to their deployment in high-stakes scenarios such as autonomous driving and medical image analysis. Through systematic empirical investigation, we identify that the imbalanced attention allocation, both across modalities (i.e., vision and language) and within modalities (among individual tokens), exhibits a strong causal correlation with the occurrence of object hallucination. Leveraging this insight, we introduce a novel concept termed attention imbalance, which not only quantifies the degree of attention disparity but also visually delineates the underlying patterns (e.g., over-attentiveness to irrelevant language tokens or under-attentiveness to discriminative visual features) that drive object hallucination. To mitigate object hallucination, we further propose Attention Imbalance Rectification (AIR), a lightweight decoding-time intervention method that reallocates attention weights and adjusts attention distributions to rectify modality-wise and token-wise imbalances. Extensive evaluations on four mainstream LVLMs and three benchmarks (CHAIR, POPE, and MM-Vet) with seven baselines demonstrate that AIR consistently reduces object hallucination rates, achieving up to a 35.1% reduction compared to the baselines, while improving up to 15.9% of LVLMs' general capability across diverse vision-language tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。