通过调控注意力模式,让视觉模型更关注图像关键区域,减少错误描述。
Not All Tokens and Heads Are Equally Important: Dual-Level Attention Intervention for Hallucination Mitigation
- 分层级干预注意力:重振重要视觉标记,压制无关文本干扰。
- 在多个模型和评测上显著降低幻觉率,计算开销几乎为零。
- 适合希望提升多模态模型可靠性但不愿重训练的开发者使用。
大型视觉语言模型(LVLM)在多种多模态任务中表现卓越,但仍易产生视觉幻觉(VH),常对视觉内容做出自信却错误的描述。基于‘并非所有标记和注意力头都同等重要’的洞察,我们提出VisFlow——一种轻量级、无需训练的推理时注意力干预框架,直接调节注意力模式以缓解幻觉。针对幻觉两大根源:视觉注意力不足与语言先验过强,我们识别出三种问题性注意力行为:(1) 过度关注无信息或滞后的视觉标记;(2) 过度依赖先前生成的标记;(3) 过度聚焦系统提示,阻碍多模态融合。为此,VisFlow引入双层注意力干预:标记级干预(TAI)强化对显著视觉区域的关注,头级干预(HAI)抑制对系统提示及邻近文本标记的过度专注。二者协同增强视觉对齐,降低语言偏差。大量实验表明,该方法在多种模型与基准上有效缓解幻觉,且计算开销极低。
原文摘要 · Abstract (English)
Large vision-language models (LVLMs) have demonstrated impressive capabilities across diverse multimodal tasks, yet they remain highly susceptible to visual hallucinations (VH), often producing confident but inaccurate descriptions of visual content. Building on the insight that not all tokens and attention heads contribute equally to VH mitigation, we introduce VisFlow, a lightweight and training-free framework that alleviates hallucinations by directly modulating attention patterns during inference. To address two primary challenges of VH, namely insufficient visual attention and the dominance of language priors, we identify three problematic attention behaviors in LVLMs: (1) disproportionate allocation of attention to uninformative or trailing visual tokens, (2) over-dependence on the previously generated token, and (3) excessive fixation on system prompts that hinders multimodal integration. To overcome these issues, VisFlow introduces a dual-level Attention Intervention, consisting of Token-level Attention Intervention (TAI), which reinforces attention to salient visual regions, and Head-level Attention Intervention (HAI), which suppresses undue focus on system prompts and adjacent text tokens. Together, these interventions strengthen visual alignment while reducing linguistic bias. Extensive experiments across diverse models and benchmarks demonstrate that VisFlow effectively mitigates hallucinations with minimal computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。