不训练不推理,通过调整注意力权重减少视觉语言模型的幻觉。
Spectral Query-Key Product Weight Steering for Training-Free VLM Hallucination Mitigation

- 直接修改中间层的查询-键乘积,抑制主导奇异模式。
- 在三种GQA模型上平均降低4.0%的幻觉指标,效果显著。
- 无需额外数据或计算,适合部署场景快速优化模型可靠性。
视觉语言模型(VLMs)常生成流畅但缺乏图像支持的描述,尤其会引入图像中不存在的对象。本文提出QK Product Steering,一种无需数据、无需训练、无推理开销的权重修正方法,直接编辑每头查询-键乘积(产生预软最大注意力分数的算子),通过抑制选定中间层中的少量主导奇异模式实现。该修正后的乘积通过闭式仅查询更新映射回查询权重,保持共享键权重不变,兼容分组查询注意力机制。进一步将QK乘积分解为对称与反对称分量,以区分相互内容相似性模式与方向性注意力模式。在三种基于GQA的VLM上,该方法平均实现4.0%的相对CHAIR$_s$降低,而随机模式对照组变化可忽略。可解释性消融实验表明,幻觉信号特异于主导的QK模式,且主要集中在对称互注意力通道。总体而言,QK Product Steering提供了一种无需解码时干预的简单替代方案,无需额外数据、微调或推理开销,同时基本保留多模态通用能力。
原文摘要 · Abstract (English)
Vision-language models (VLMs) often generate fluent but visually unsupported descriptions, especially by mentioning objects absent from the image. We propose QK Product Steering, a data-free, training-free, and zero-inference-cost weight edit for reducing object hallucination. The method directly edits the per-head query-key product, the operator that produces pre-softmax attention logits, by suppressing a small number of dominant singular modes in selected middle layers. The edited product is then mapped back to the query weights through a closed-form query-only update while keeping shared key weights fixed, making the edit compatible with grouped-query attention. We further decompose the QK product into symmetric and antisymmetric components to distinguish mutual content-similarity patterns from directional attention patterns. Across three GQA-based VLMs, QK Product Steering achieves an average relative CHAIR$_s$ reduction of $4.0\%$, while matched random-mode controls show negligible change. Interpretability ablations show that the hallucination signal is specific to dominant QK modes and is primarily localized to the symmetric mutual-attention channel. Overall, QK Product Steering offers a simple alternative to decoding-time mitigation, requiring no additional data, fine-tuning, or inference-time overhead while largely preserving general multimodal capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。