arXiv:2505.12826cs.CV2025-05NeurIPS被引 7

通过时间敏感机制,精准抑制视频大模型的幻觉生成。

Mitigating Hallucination in VideoLLMs via Temporal-Aware Activation Engineering

  • 根据视频时序变化特征,动态识别易产生幻觉的模型模块。
  • 无需额外微调,显著降低多模型、多基准上的幻觉率。
  • 适用于希望提升视频理解可信度的研究者与开发者。

多模态大语言模型在视频理解方面取得显著进展,但幻觉问题——即生成看似合理却错误的内容——仍是视频领域中一个突出且未充分解决的挑战。尽管激活工程在语言模型和图像大模型中已证明能有效缓解幻觉,其在视频大模型中的应用尚未被系统研究。本文首次系统探究了激活工程在视频大模型中缓解幻觉的有效性及其内在机制。我们发现模型对幻觉的敏感性主要取决于时序变化特征,而非任务类型;选择合适的内部模块与训练数据对减少幻觉至关重要。基于此,我们提出一种时间感知的激活工程框架,可自适应地识别并调控受时序变化影响大的敏感模块,从而在不进行额外大语言模型微调的情况下,显著减少幻觉。跨多个模型与基准的实验表明,该方法能有效降低视频大模型中的幻觉现象,验证了研究结论的稳健性。

原文摘要 · Abstract (English)

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding.However, hallucination, where the model generates plausible yet incorrect outputs, persists as a significant and under-addressed challenge in the video domain. Among existing solutions, activation engineering has proven successful in mitigating hallucinations in LLMs and ImageLLMs, yet its applicability to VideoLLMs remains largely unexplored. In this work, we are the first to systematically investigate the effectiveness and underlying mechanisms of activation engineering for mitigating hallucinations in VideoLLMs. We initially conduct an investigation of the key factors affecting the performance of activation engineering and find that a model's sensitivity to hallucination depends on $\textbf{temporal variation}$ rather than task type. Moreover, selecting appropriate internal modules and dataset for activation engineering is critical for reducing hallucination. Guided by these findings, we propose a temporal-aware activation engineering framework for VideoLLMs, which adaptively identifies and manipulates hallucination-sensitive modules based on the temporal variation characteristic, substantially mitigating hallucinations without additional LLM fine-tuning. Experiments across multiple models and benchmarks demonstrate that our method markedly reduces hallucination in VideoLLMs, thereby validating the robustness of our findings.

视频理解幻觉抑制激活工程时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。