arXiv:2508.04567cs.CVcs.CL2025-08AAAI被引 11

发现大模型训练数据偏差导致物体幻觉,提出轻量级方法有效缓解。

Analyzing and Mitigating Object Hallucination: A Training Bias Perspective

  • 基于训练数据反事实图像构建新评测基准POPEv2。
  • 模型在见过的图像上更易幻觉,且语言头是偏差主要来源。
  • 仅更新2%参数即可显著降低幻觉,适用于多种模型和数据规模。

随着训练数据规模扩大,大视觉语言模型(LVLMs)的多模态能力显著提升,但仍存在生成与视觉输入不符内容的幻觉问题。为此,本文系统研究了训练数据在幻觉中的作用,提出新基准POPEv2,包含从模型训练数据中提取的反事实图像(特定物体被遮掩)。在POPEv2上的全面评估发现,当前LVLM存在训练偏差:未能充分利用训练数据,在训练过的图像上反而更频繁产生幻觉,尤其在反事实图像上常错误回答‘是’。探针实验表明,该偏差主要存在于语言建模(LM)头。基于此,提出Obliviate方法,通过识别训练数据中真实标签与模型输出的差异作为偏差代理,采用参数与数据高效微调策略,仅更新LM头。实验表明,仅重用训练数据并更新约2%参数,Obliviate即可显著减少判别与生成任务中的幻觉。该方法在2B至72B模型规模及不同数据量下均表现良好,且对超越物体级别的幻觉类型具较强泛化能力。代码与数据将公开。

原文摘要 · Abstract (English)

As scaling up training data has significantly improved the general multimodal capabilities of Large Vision-Language Models (LVLMs), they still suffer from the hallucination issue, generating text that is inconsistent with the visual input. This phenomenon motivates us to systematically investigate the role of training data in hallucination. We introduce a new benchmark, POPEv2, which consists of counterfactual images collected from the training data of LVLMs with certain objects masked. Through comprehensive evaluation on POPEv2, we find that current LVLMs suffer from training bias: they fail to fully leverage their training data and hallucinate more frequently on images seen during training. Specifically, they perform poorly on counterfactual images, often incorrectly answering ``Yes'' to questions about masked objects. To understand this issue, we conduct probing experiments on the models' internal components, revealing that this training bias is primarily located in the language modeling (LM) head. Based on these findings, we propose Obliviate, an efficient and lightweight unlearning method designed to mitigate object hallucination via training bias unlearning. Obliviate identifies the discrepancy between ground-truth labels and model outputs on the training data as a proxy for bias and adopts a parameter- and data-efficient fine-tuning strategy that only updates the LM head. Extensive experiments demonstrate the effectiveness of our approach. While only reusing the training data and updating approximately 2\% of the parameters, Obliviate significantly reduces hallucination across both discriminative and generative tasks. Furthermore, it demonstrates strong scalability with respect to both model size (2B to 72B) and training data volume, and exhibits promising generalization to hallucination types beyond object-level hallucination. Our code and data will be publicly released.

幻觉检测视觉语言模型偏见缓解轻量微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。