通过压缩思维链和对比偏好优化,有效降低多模态模型幻觉。
Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization
- 压缩冗余思维链,提升视觉信息利用率。
- 利用高质量反馈构建训练对,减少幻觉生成。
- 适配多种模型与评测,效果稳定可靠。
多模态推理模型虽表现优异,但仍易产生幻觉,现有解决方案尚不充分。本文分析幻觉成因,提出基于训练的C3PO框架,包含思维链压缩与对比偏好优化。实验发现,引入推理机制会增强模型对语言先验的依赖,弱化视觉输入,导致思维链中视觉线索减少但文本冗余增加。为此,我们设计选择性过滤冗余思维标记的方法,生成更紧凑、信号高效的思维链表示,保留任务相关信息并抑制噪声。此外,我们观察到推理轨迹质量直接影响后续响应是否出现幻觉。据此,提出融合高质量AI反馈的推理增强型偏好调优方案,并设计多模态幻觉诱导机制,通过精心构造的诱发器激发模型固有幻觉模式,生成有助于对比修正的负向信号。理论证明其有效性,并在多种多模态模型与基准测试上实现一致的幻觉降低。
原文摘要 · Abstract (English)
While multimodal reasoning models (MLRMs) have exhibited impressive capabilities, they remain prone to hallucinations, and effective solutions are still underexplored. In this paper, we experimentally analyze the hallucination cause and propose C3PO, a training-based mitigation framework comprising \textbf{C}hain-of-Thought \textbf{C}ompression and \textbf{C}ontrastive \textbf{P}reference \textbf{O}ptimization. Firstly, we identify that introducing reasoning mechanisms exacerbates models' reliance on language priors while overlooking visual inputs, which can produce CoTs with reduced visual cues but redundant text tokens. To this end, we propose to selectively filter redundant thinking tokens for a more compact and signal-efficient CoT representation that preserves task-relevant information while suppressing noise. In addition, we observe that the quality of the reasoning trace largely determines whether hallucination emerges in subsequent responses. To leverage this insight, we introduce a reasoning-enhanced preference tuning scheme that constructs training pairs using high-quality AI feedback. We further design a multimodal hallucination-inducing mechanism that elicits models' inherent hallucination patterns via carefully crafted inducers, yielding informative negative signals for contrastive correction. We provide theoretical justification for the effectiveness and demonstrate consistent hallucination reduction across diverse MLRMs and benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。