让视频模型学会聚焦关键画面,自动找证据支持回答
Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs

- 用视频内在线索构建共识帧先验,无须人工标注时间点
- 通过奖励机制让模型与共识帧对齐,提升推理准确性
- 适合需要可解释视觉证据的视频理解任务
强化学习提升了大语言模型的推理能力,但仅使用结果奖励难以指导视频多模态大模型(Video-MLLM)选择支持答案的视觉证据。受多感官整合启发,我们提出无时间标注的进程级奖励框架——共识帧GRPO(CF-GRPO)。该方法基于视频内在线索(如时间覆盖度、场景切换信号、查询相关性)构建共识帧先验,并从视觉与回答表示中计算模型侧的帧使用得分,通过共识帧奖励(CFR)优化二者一致性。结合显著性感知的稀疏聚合与分布锐化,CFR在无需人工时间标注的情况下提供高对比度奖励信号。实验表明,VideoCFR在多个复杂视频推理基准上表现优异,优于代表性Video-MLLM与强化学习基线,且共识先验揭示了训练中被强调的证据帧,具备可解释性。实现代码已开源:https://github.com/1Pansy/VideoCFR。
原文摘要 · Abstract (English)
Reinforcement learning has improved the reasoning ability of large language models, but applying outcome-only rewards to video multimodal large language models (Video-MLLMs) provides limited guidance on which visual evidence should support the answer. Inspired by multisensory integration, where consistent cues can enhance the salience and reliability of perceptual estimates, we introduce Consensus Frame GRPO (CF-GRPO), a temporal-annotation-free process-level reward framework for evidence-aware video reasoning. CF-GRPO constructs a consensus frame prior from intrinsic video cues, including temporal coverage, scene-transition cues, and query-conditioned visual relevance. It then computes a model-side frame-use score from visual and response representations and optimizes their agreement through the Consensus Frame Reward (CFR). With salience-aware sparse aggregation and distribution sharpening, CFR provides a high-contrast reward signal without requiring human temporal annotations. Experiments show that VideoCFR achieves competitive performance across complex video reasoning benchmarks and improves several metrics over representative Video-MLLM and RL baselines, while the consensus prior provides an interpretable view of the evidence frames emphasized during training. The implementation is available at https://github.com/1Pansy/VideoCFR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。