arXiv:2609.02028cs.CV2026-09

通过注意力漂移与掩码验证,检测大模型中的物体幻觉。

Detecting Object Hallucinations in Large Vision-Language Models via Cross-Modal Attention Drifts and Mask-Based Verification

论文配图:Detecting Object Hallucinations in Large Vision-Language Models via Cross-Modal Attention Drifts and Mask-Based Verification
图 1 · 摘自论文原文
  • 分析相邻层间跨模态注意力的分布变化,捕捉视觉定位突变。
  • 在关键区域加掩码后,观察预测概率变化,验证依赖关系。
  • 轻量级框架适配多种模型,可有效识别幻觉输出。

尽管大型视觉语言模型(LVLMs)取得进展,物体幻觉仍是其可靠部署的主要障碍。现有方法通常仅使用单层注意力表征视觉定位,忽略了其在多层间的演化过程。本文提出CADMP,一种结合相邻层跨模态注意力漂移与目标视觉掩码下预测敏感性的轻量级幻觉检测框架。解码过程中,该方法量化连续层间跨模态注意力图的分布变化,以捕捉视觉定位的突发性转变;随后选取漂移最大的转移,定位对应视觉相关区域,并测量掩码这些区域后的预测概率变化。两个信号提供互补证据:注意力漂移反映内部视觉定位的稳定性,概率变化验证预测是否真正依赖所识别的视觉证据。一个轻量级检测器整合两者信号以识别幻觉预测。在多个基准和代表性开源LVLM上实验表明,CADMP性能持续领先;消融实验进一步证实了相邻层漂移建模与掩码验证的互补贡献。

原文摘要 · Abstract (English)

Despite recent advances in large vision-language models (LVLMs), object hallucination remains a major barrier to their reliable deployment. Existing detection methods often characterize visual grounding using attention from individual layers, leaving its evolution across layers underexplored. We propose CADMP, a lightweight object hallucination detection framework that combines adjacent-layer cross-modal attention drift with prediction sensitivity to targeted visual masking. During decoding, CADMP quantifies distributional changes between consecutive cross-modal attention maps to capture abrupt transitions in visual grounding. It then selects the transition with the largest drift, locates the corresponding visually relevant regions, and measures the change in prediction probability after masking these regions. These two signals provide complementary evidence: attention drift characterizes the stability of internal visual grounding, while probability variation verifies whether a prediction truly depends on the identified visual evidence. A lightweight detector integrates both signals to identify hallucinated predictions. Experiments on multiple benchmarks and representative open-source LVLMs demonstrate that CADMP achieves consistently competitive detection performance. Ablation studies further confirm the complementary contributions of adjacent-layer drift modeling and mask-based grounding verification.

视觉语言模型幻觉检测注意力分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。