用可控视频生成技术减少大模型在视频理解中的幻觉问题。
Taming Hallucinations: Boosting MLLMs' Video Understanding via Counterfactual Video Generation
- 通过扩散模型生成反事实视频,构建对比训练数据对。
- 在反事实视频测试集上幻觉率降低24.0%,优于基线模型。
- 适合关注多模态模型可靠性与鲁棒性的研究者使用。
多模态大语言模型(MLLMs)在视频理解任务中取得了显著进展,但其严重依赖语言先验,导致在处理违背常识的反事实视频时易产生视觉无依据的幻觉。这一问题源于文本与视频数据间的固有不平衡,而收集标注反事实数据成本高昂。为此,我们提出DualityForge框架,利用可控扩散视频编辑技术将真实视频转化为反事实场景。该框架在视频编辑和问答生成过程中嵌入结构化上下文信息,自动生成高质量的问答对及原视频-编辑后视频配对,用于对比训练。基于此,我们构建了大规模视频数据集DualityVidQA,以减少MLLM幻觉。为进一步挖掘成对数据的对比特性,我们设计了双重归一化优势训练(DNA-Train),采用两阶段SFT-RL策略,其中强化学习阶段引入成对ℓ₁优势归一化,实现更稳定高效的策略优化。在DualityVidQA-Test上的实验表明,本方法显著降低模型在反事实视频上的幻觉,相比Qwen2.5-VL-7B基线提升24.0%。同时,在幻觉与通用基准上均取得显著提升,体现强泛化能力。我们将开源数据集与代码。
原文摘要 · Abstract (English)
Multimodal Large Language Models (MLLMs) have made remarkable progress in video understanding. However, they suffer from a critical vulnerability: an over-reliance on language priors, which can lead to visual ungrounded hallucinations, especially when processing counterfactual videos that defy common sense. This limitation, stemming from the intrinsic data imbalance between text and video, is challenging to address due to the substantial cost of collecting and annotating counterfactual data. To address this, we introduce DualityForge, a novel counterfactual data synthesis framework that employs controllable, diffusion-based video editing to transform real-world videos into counterfactual scenarios. By embedding structured contextual information into the video editing and QA generation processes, the framework automatically produces high-quality QA pairs together with original-edited video pairs for contrastive training. Based on this, we build DualityVidQA, a large-scale video dataset designed to reduce MLLM hallucinations. In addition, to fully exploit the contrastive nature of our paired data, we propose Duality-Normalized Advantage Training (DNA-Train), a two-stage SFT-RL training regime where the RL phase applies pair-wise $\ell_1$ advantage normalization, thereby enabling a more stable and efficient policy optimization. Experiments on DualityVidQA-Test demonstrate that our method substantially reduces model hallucinations on counterfactual videos, yielding a relative improvement of 24.0% over the Qwen2.5-VL-7B baseline. Moreover, our approach achieves significant gains across both hallucination and general-purpose benchmarks, indicating strong generalization capability. We will open-source our dataset and code.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。