arXiv:2503.10602cs.CVcs.AI2025-03ICCV被引 12

通过分析模型内部状态,实现生成时的实时幻觉抑制。

TruthPrInt: Mitigating Large Vision-Language Models Object Hallucination Via Latent Truthful-Guided Pre-Intervention

  • 利用视觉语言模型内部状态识别每项生成内容的幻觉风险。
  • 发现多模型共享通用真实方向,提升跨模型检测能力。
  • 适合关注模型可信度与幻觉检测的研究者和开发者。

物体幻觉(OH)是大型视觉语言模型(LVLMs)面临的主要可信性挑战之一。尽管大型语言模型(LLMs)显示其内部状态(如隐藏状态)可编码整体回答的真实性,但LVLM内部状态的作用机制仍不明确,是否能作为每标记的幻觉指标也未被充分探索。本文深入研究含幻觉问题的LVLM内部状态,发现:(1)LVLM内部状态是高度特异性的逐标记幻觉指示器;(2)不同LVLM在共同的潜在子空间中编码通用的幻觉模式,表明存在各模型共有的“通用真实方向”。基于此,提出真值引导的生成前干预方法(TruthPrInt),先学习解码过程中的真实方向,再在推理阶段实施真值引导干预。进一步通过构建并对齐幻觉潜在子空间,增强跨模型与跨数据集的幻觉检测迁移能力。在多个主流LVLM及幻觉基准上进行广泛实验,结果表明TruthPrInt显著优于现有方法。

原文摘要 · Abstract (English)

Object Hallucination (OH) has been acknowledged as one of the major trustworthy challenges in Large Vision-Language Models (LVLMs). Recent advancements in Large Language Models (LLMs) indicate that internal states, such as hidden states, encode the "overall truthfulness" of generated responses. However, it remains under-explored how internal states in LVLMs function and whether they could serve as "per-token" hallucination indicators, which is essential for mitigating OH. In this paper, we first conduct an in-depth exploration of LVLM internal states with OH issues and discover that (1) LVLM internal states are high-specificity per-token indicators of hallucination behaviors. Moreover, (2) different LVLMs encode universal patterns of hallucinations in common latent subspaces, indicating that there exist "generic truthful directions" shared by various LVLMs. Based on these discoveries, we propose Truthful-Guided Pre-Intervention (TruthPrInt) that first learns the truthful direction of LVLM decoding and then applies truthful-guided inference-time intervention during LVLM decoding. We further propose TruthPrInt to enhance both cross-LVLM and cross-data hallucination detection transferability by constructing and aligning hallucination latent subspaces. We evaluate TruthPrInt in extensive experimental settings, including in-domain and out-of-domain scenarios, over popular LVLMs and OH benchmarks. Experimental results indicate that TruthPrInt significantly outperforms state-of-the-art methods. Codes will be available at https://github.com/jinhaoduan/TruthPrInt.

幻觉检测视觉语言模型可信AI推理干预

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。