提出新方法精准识别视觉语言模型的幻觉对象,且不破坏模型原有能力。
HaloProbe: Bayesian Detection and Mitigation of Object Hallucinations in Vision-Language Models

- 基于贝叶斯框架分离外部描述统计与内部解码信号,提升检测可靠性。
- 在COCO、VQAv2等数据集上,幻觉减少率超基准方法30%以上。
- 无需修改模型结构,适合部署于现有生成系统中使用。
大型视觉语言模型在图像描述中常产生对象幻觉,亟需有效检测与缓解策略。以往工作多依赖模型对视觉标记的注意力权重作为检测信号,但我们发现粗粒度注意力分析不可靠,因存在隐藏混杂因素——如标记位置和描述中对象重复性,导致统计上的辛普森悖论:聚合后注意力趋势反转或消失。为此,我们提出HaloProbe,一种贝叶斯框架,通过分解外部描述统计与内部解码信号,估计每个标记的幻觉概率。该方法采用均衡训练以隔离内部证据,并结合学习到的外部特征先验,恢复真实后验概率。相较于需干预模型内部的缓解方法,我们利用HaloProbe作为外部评分信号,实现非侵入式缓解。实验表明,基于HaloProbe引导的解码,在保持生成质量的同时,显著优于当前最优干预式方法,大幅降低幻觉发生率。
原文摘要 · Abstract (English)
Large vision-language models can produce object hallucinations in image descriptions, highlighting the need for effective detection and mitigation strategies. Prior work commonly relies on the model's attention weights on visual tokens as a detection signal. We reveal that coarse-grained attention-based analysis is unreliable due to hidden confounders, specifically token position and object repetition in a description. This leads to Simpson's paradox: the attention trends reverse or disappear when statistics are aggregated. Based on this observation, we introduce HaloProbe, a Bayesian framework that factorizes external description statistics and internal decoding signals to estimate token-level hallucination probabilities. HaloProbe uses balanced training to isolate internal evidence and combines it with a learned prior over external features to recover the true posterior. While intervention-based mitigation methods often degrade utility or fluency by modifying models' internals, we use HaloProbe as an external scoring signal for non-invasive mitigation. Our experiments show that HaloProbe-guided decoding reduces hallucinations more effectively than state-of-the-art intervention-based methods while preserving utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。