不训练、轻量级,用干预方向减少视觉语言模型幻觉。
ICT: Image-Object Cross-Level Trusted Intervention for Mitigating Object Hallucination in Large Vision-Language Models
- 通过干预注意力头,引导模型关注图像整体与细节
- 在少量数据下显著降低幻觉率,跨模型泛化好
- 无需微调,适合对精度要求高的实际应用
尽管大型视觉语言模型(LVLMs)在理解复杂图文上下文方面取得突破,但其固有的幻觉倾向限制了在高精度要求真实场景中的应用。现有方法或需额外标注数据微调模型,增加人力与计算成本;或在解码阶段进行比较,可能削弱语言先验并引入推理延迟。为此,我们提出ICT——一种轻量、无需训练的方法,通过计算干预方向,引导模型关注不同层级的视觉信息,增强对高层语义与细粒度物体细节的关注。在前向传播阶段,该干预作用于编码整体图像信息和细粒度对象细节的注意力头,有效缓解过度依赖语言先验的问题,从而减轻幻觉现象。大量实验证明,ICT仅需少量数据即可实现优异性能,并在不同数据集与模型间具有良好泛化能力。代码将公开。
原文摘要 · Abstract (English)
Despite the recent breakthroughs achieved by Large Vision Language Models (LVLMs) in understanding and responding to complex visual-textual contexts, their inherent hallucination tendencies limit their practical application in real-world scenarios that demand high levels of precision. Existing methods typically either fine-tune the LVLMs using additional data, which incurs extra costs in manual annotation and computational resources or perform comparisons at the decoding stage, which may eliminate useful language priors for reasoning while introducing inference time overhead. Therefore, we propose ICT, a lightweight, training-free method that calculates an intervention direction to shift the model's focus towards different levels of visual information, enhancing its attention to high-level and fine-grained visual details. During the forward pass stage, the intervention is applied to the attention heads that encode the overall image information and the fine-grained object details, effectively mitigating the phenomenon of overly language priors, and thereby alleviating hallucinations. Extensive experiments demonstrate that ICT achieves strong performance with a small amount of data and generalizes well across different datasets and models. Our code will be public.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。