arXiv:2411.15839cs.CV2024-11被引 19

通过融合视觉层特征,用对比解码减少大模型幻觉。

VaLiD: Mitigating the Hallucination of Large Vision Language Models by Visual Layer Fusion Contrastive Decoding

  • 从视觉编码层面入手,用不确定性选择关键视觉层
  • 在多个基准上显著降低幻觉率,性能优于现有方法
  • 适合关注视觉推理可靠性与生成准确性的研究者

大型视觉语言模型在多模态任务推理中表现出色,但常生成看似合理却不符合视觉内容的回答,即幻觉问题。现有方法多从语言模型解码角度改进,但本研究分析发现,视觉编码过程中的信息失真也会严重影响推理能力:早期视觉层虽保留关键特征,但随传播逐渐失真。为此,我们提出一种新方法——视觉层融合对比解码(VaLiD),利用不确定性指导视觉层选择,修正编码过程中的失真,提升生成内容可靠性。实验表明,该方法在多个基准上有效缓解幻觉,性能达到当前最优水平。

原文摘要 · Abstract (English)

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known as hallucination. Recent approaches have introduced training-free methods to mitigate hallucinations by adjusting the decoding strategy during the inference stage, typically attributing hallucinations to the language model itself. Our analysis, however, reveals that distortions in the visual encoding process significantly affect the model's reasoning capabilities. Specifically, earlier visual layers may retain key features but gradually distort as the information propagates toward the output layer. Building on these insights, we propose a novel hallucination-mitigation method from the visual encoding perspective: \textbf{V}isu\textbf{a}l \textbf{L}ayer Fus\textbf{i}on Contrastive \textbf{D}ecoding (\textbf{VaLiD}). This method utilizes uncertainty to guide the visual layer selection, correcting distortions in the visual encoding process and thereby enhancing the reliability of the generated content. Experimental results demonstrate the effectiveness of VaLiD in mitigating hallucinations across various benchmarks, achieving state-of-the-art performance when compared to baseline methods. Codes are available at \href{https://github.com/RicardoLuL/VaLiD_LVLMs_hallucinations}{Github}.

视觉语言模型幻觉抑制多模态推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。