arXiv:2507.12455cs.CV2025-07ICCV被引 30

通过早期句子级干预,90%降低多模态模型幻觉问题。

Mitigating Object Hallucinations via Sentence-Level Early Intervention

  • 用双开放词汇检测器自动标注幻觉句子,无需人工标注。
  • 在生成初期就识别并修正幻觉,使错误不扩散到后续文本。
  • 适合追求高可靠性多模态生成的开发者和研究者。

多模态大语言模型虽提升了跨模态理解能力,但仍存在与视觉输入矛盾的幻觉问题。现有方法或计算成本过高,或导致训练数据与输出分布不一致。我们发现幻觉主要在文本生成早期出现并持续传播。为此提出SENTINEL框架:通过迭代采样模型输出,利用两个开放词汇检测器交叉验证物体存在性,自动构建高质量域内偏好对;再以语境连贯正样本和幻觉负样本构建上下文感知偏好数据;最后使用上下文感知偏好损失(C-DPO)进行训练,强调在幻觉初现的句子层级进行判别学习。实验表明,SENTINEL相比原模型可减少超过90%的幻觉,在幻觉基准和通用能力基准上均优于当前最优方法,展现出优越性和泛化能力。代码、模型与数据集已公开于https://github.com/pspdada/SENTINEL。

原文摘要 · Abstract (English)

Multimodal large language models (MLLMs) have revolutionized cross-modal understanding but continue to struggle with hallucinations - fabricated content contradicting visual inputs. Existing hallucination mitigation methods either incur prohibitive computational costs or introduce distribution mismatches between training data and model outputs. We identify a critical insight: hallucinations predominantly emerge at the early stages of text generation and propagate through subsequent outputs. To address this, we propose SENTINEL (Sentence-level Early iNtervention Through IN-domain prEference Learning), a framework that eliminates dependency on human annotations. Specifically, we first bootstrap high-quality in-domain preference pairs by iteratively sampling model outputs, validating object existence through cross-checking with two open-vocabulary detectors, and classifying sentences into hallucinated/non-hallucinated categories. Subsequently, we use context-coherent positive samples and hallucinated negative samples to build context-aware preference data iteratively. Finally, we train models using a context-aware preference loss (C-DPO) that emphasizes discriminative learning at the sentence level where hallucinations initially manifest. Experimental results show that SENTINEL can reduce hallucinations by over 90% compared to the original model and outperforms the previous state-of-the-art method on both hallucination benchmarks and general capabilities benchmarks, demonstrating its superiority and generalization ability. The models, datasets, and code are available at https://github.com/pspdada/SENTINEL.

多模态幻觉抑制自监督生成优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。