arXiv:2512.18671cs.CV2025-12AAAI被引 9

不训练模型,用时间注意力崩溃检测减少视频大模型幻觉

SmartSight: Mitigating Hallucination in Video-LLMs Without Compromising Video Understanding via Temporal Attention Collapse

  • 通过多候选响应和时间注意力崩溃评分识别幻觉
  • 在VRIPT-HAL上幻觉降低10.59%,视频理解提升8.86%
  • 适合关注开源视频大模型可靠性的研究者

尽管视频大语言模型近年快速进步,感知幻觉仍带来重大安全风险,严重制约其实际应用。现有幻觉缓解方法常损害模型的视频理解与推理能力。本文提出SmartSight,一种无需训练的新方法,利用模型自身内省能力实现幻觉抑制。该方法生成多个候选回答,通过时间注意力崩溃分数评估每条回答的幻觉程度,该分数衡量模型在生成过程中是否过度关注输入视频中琐碎的时间片段。为提升效率,SmartSight还引入视觉注意力消失点,实现更精准的幻觉判断并提前终止幻觉响应,显著降低解码开销。实验表明,SmartSight在Qwen2.5-VL-7B上使VRIPT-HAL的幻觉率降低10.59%,同时提升VideoMMMU性能最高达8.86%,验证了其在增强开源视频大模型可靠性方面的有效性。

原文摘要 · Abstract (English)

Despite Video Large Language Models having rapidly advanced in recent years, perceptual hallucinations pose a substantial safety risk, which severely restricts their real-world applicability. While several methods for hallucination mitigation have been proposed, they often compromise the model's capacity for video understanding and reasoning. In this work, we propose SmartSight, a pioneering step to address this issue in a training-free manner by leveraging the model's own introspective capabilities. Specifically, SmartSight generates multiple candidate responses to uncover low-hallucinated outputs that are often obscured by standard greedy decoding. It assesses the hallucination of each response using the Temporal Attention Collapse score, which measures whether the model over-focuses on trivial temporal regions of the input video when generating the response. To improve efficiency, SmartSight identifies the Visual Attention Vanishing point, enabling more accurate hallucination estimation and early termination of hallucinated responses, leading to a substantial reduction in decoding cost. Experiments show that SmartSight substantially lowers hallucinations for Qwen2.5-VL-7B by 10.59% on VRIPT-HAL, while simultaneously enhancing video understanding and reasoning, boosting performance on VideoMMMU by up to 8.86%. These results highlight SmartSight's effectiveness in improving the reliability of open-source Video-LLMs.

视频大模型幻觉抑制注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。