arXiv:2505.19498cs.CVcs.AI2025-05被引 4

从贝叶斯视角提升视觉依赖,有效减少大模型幻觉。

Enhancing Visual Reliance in Text Generation: A Bayesian Perspective on Mitigating Hallucination in Large Vision-Language Models

  • 通过评估并剔除冗余视觉标记,增强视觉信息有效性。
  • 修正不当先验,使生成更依赖真实视觉内容。
  • 在后验分布坍缩时提前终止生成,防止幻觉产生。

大型视觉语言模型(LVLM)常生成与视觉输入不符的文本,导致幻觉问题,限制其实际应用。核心在于提升文本生成对视觉内容的依赖性。现有方法多聚焦于调整单一模态特征或输出,未能系统性增强视觉依赖。本文从贝叶斯视角系统分析影响视觉依赖的因素,提出三方面改进:首先,发现并非所有视觉标记均具信息量,提出评估并移除冗余标记以降低干扰;其次,指出模型可能编码不当先验,导致生成异常词汇,提出基于贝叶斯思想的先验修正方法;第三,观察到在特定生成步骤后,下一词预测的后验分布会坍缩至不依赖任何视觉信息的先验,因此提出在该阶段前终止生成。在POPE、CHAIR和MME三个基准上的实验表明,本方法能持续缓解幻觉问题,优于现有先进方法。

原文摘要 · Abstract (English)

Large Vision-Language Models (LVLMs) usually generate texts which satisfy context coherence but don't match the visual input. Such a hallucination issue hinders LVLMs' applicability in the real world. The key to solving hallucination in LVLM is to make the text generation rely more on the visual content. Most previous works choose to enhance/adjust the features/output of a specific modality (i.e., visual or textual) to alleviate hallucinations in LVLM, which do not explicitly or systematically enhance the visual reliance. In this paper, we comprehensively investigate the factors which may degenerate the visual reliance in text generation of LVLM from a Bayesian perspective. Based on our observations, we propose to mitigate hallucination in LVLM from three aspects. Firstly, we observe that not all visual tokens are informative in generating meaningful texts. We propose to evaluate and remove redundant visual tokens to avoid their disturbance. Secondly, LVLM may encode inappropriate prior information, making it lean toward generating unexpected words. We propose a simple yet effective way to rectify the prior from a Bayesian perspective. Thirdly, we observe that starting from certain steps, the posterior of next-token prediction conditioned on visual tokens may collapse to a prior distribution which does not depend on any informative visual tokens at all. Thus, we propose to stop further text generation to avoid hallucination. Extensive experiments on three benchmarks including POPE, CHAIR, and MME demonstrate that our method can consistently mitigate the hallucination issue of LVLM and performs favorably against previous state-of-the-arts.

视觉语言模型幻觉抑制贝叶斯方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。