通过调控生成过程中的视觉信息激活,有效降低大模型幻觉问题。
The Hidden Life of Tokens: Reducing Hallucination of Large Vision-Language Models via Visual Information Steering
- 分析生成过程中令牌得分变化,发现视觉信息逐渐减弱
- 提出VISTA框架,使真实视觉内容在生成中更易被保留
- 无需训练,适配多种解码策略,适合追求高准确性的应用
大型视觉语言模型(LVLM)能有效处理文本和视觉输入,但常产生语法正确却无视觉依据的幻觉内容。本文通过分析生成过程中令牌得分排序,揭示三大规律:(1)视觉信息逐步丢失——视觉相关令牌的偏好度随生成过程下降;(2)早期激活——语义重要令牌在较早层即达峰值激活;(3)隐藏真实信息——虽未被最终解码,但视觉相关令牌仍保有较高排名。基于此,提出VISTA(视觉信息引导),一种无需训练的推理时干预框架,通过增强激活空间中的视觉信息并利用早期层激活来促进真实语义输出。实验表明,该方法在开放式生成任务上平均降低40%幻觉率,在四个基准测试、四种架构及三种解码策略下均优于现有方法。代码已开源。
原文摘要 · Abstract (English)
Large Vision-Language Models (LVLMs) can reason effectively over both textual and visual inputs, but they tend to hallucinate syntactically coherent yet visually ungrounded contents. In this paper, we investigate the internal dynamics of hallucination by examining the tokens logits ranking throughout the generation process, revealing three key patterns in how LVLMs process information: (1) gradual visual information loss - visually grounded tokens gradually become less favored throughout generation, and (2) early excitation - semantically meaningful tokens achieve peak activation in the layers earlier than the final layer. (3) hidden genuine information - visually grounded tokens though not being eventually decoded still retain relatively high rankings at inference. Based on these insights, we propose VISTA (Visual Information Steering with Token-logit Augmentation), a training-free inference-time intervention framework that reduces hallucination while promoting genuine information. VISTA works by combining two complementary approaches: reinforcing visual information in activation space and leveraging early layer activations to promote semantically meaningful decoding. Compared to existing methods, VISTA requires no external supervision and is applicable to various decoding strategies. Extensive experiments show that VISTA on average reduces hallucination by about 40% on evaluated open-ended generation task, and it consistently outperforms existing methods on four benchmarks across four architectures under three decoding strategies. Code is available at https://github.com/LzVv123456/VISTA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。