arXiv:2509.11287cs.CVcs.CL2025-09EMNLP被引 6

用模型自动生成幻觉数据,自动训练减少视觉语言模型的错误联想。

Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations

  • 让模型自己制造幻觉样本,生成对比响应对用于训练。
  • 在六项基准测试中显著降低幻觉率,效果媲美依赖人工标注的方法。
  • 无需外部标注或辅助模型,适合长期迭代优化,通用性强。

大型视觉语言模型(LVLM)存在严重幻觉问题,即生成内容与视觉输入不符。现有缓解方法多依赖偏好对齐,需外部人工标注或辅助模型收集偏好数据,成本高且难以持续改进。为此,我们提出自主偏好对齐自注入方法(APASI),一种无需外部依赖的新方法。APASI利用目标LVLM自身生成幻觉响应,构造出具有不同偏好水平的响应对。自注入过程中,非优选响应基于幻觉的三个关键特征生成,确保其真实模拟实际幻觉模式,提供准确的学习信号。此外,APASI结合迭代对齐训练与课程学习策略,定期以更高挑战性数据更新偏好数据,实现模型稳定持续增强。大量实验表明,APASI不仅有效缓解三类基线模型的幻觉问题,性能还达到甚至超越依赖外部数据的对齐方法,验证了其有效性与泛化能力。代码已开源:https://github.com/davidluciolu/APASI。

原文摘要 · Abstract (English)

Large Vision-Language Models (LVLMs) suffer from serious hallucination problems, where the model-generated responses are inconsistent with the visual inputs. Existing hallucination mitigation methods are mainly based on preference alignment and require external human annotations or auxiliary models for preference data collection, which increase costs and limit sustainable improvement. To tackle these challenges, we propose Autonomous Preference Alignment via Self-Injection (APASI), a novel and generalizable method that mitigates hallucinations without external dependencies. APASI leverages the target LVLM to self-inject hallucinations into a generated response, creating a pair of responses with varying preference levels. During the self-injection process, the dis-preferred response is generated based on three key observations of hallucinations, ensuring it simulates real hallucination patterns. This fidelity offers an accurate learning signal for hallucination mitigation. Moreover, APASI incorporates an iterative alignment training strategy combined with curriculum learning to periodically update the preference data with increasing challenge, enabling stable and continuous enhancement of the LVLM. Extensive experiments across six benchmarks show that APASI not only effectively mitigates hallucinations for three baseline models but also achieves comparable or even superior performance to alignment-based methods with external dependency, thereby demonstrating its effectiveness and generalization capability. The code is available at https://github.com/davidluciolu/APASI.

视觉语言模型幻觉抑制自训练无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。