arXiv:2606.01485cs.CVcs.LG2026-06

视频问答需先感知后推理,模型短板在视觉理解而非逻辑分析。

Perception First: A Frontier Native-Video Model with Self-Consistency for Implicit Video Question Answering

  • 以感知为先,用轻量测试时去噪提升视频理解能力。
  • 发现该任务受感知限制,推理增强反而降低性能。
  • 适合关注视频理解底层能力的开发者与评测研究者。

我们提交至CVPR 2026 VRR挑战赛的工作,基于ImplicitQA/VRR-QA基准,面向多选视频问答任务:答案无法在单帧中直接观察,需从创意视频的离散帧中推断空间布局、运动、深度、视角、因果关系及社会情境。我们对开源Video-LMMs(Qwen2.5-VL、Qwen3-VL、InternVL3、Gemma-3,以及RL调优的Video-R1和VideoChat-R1.5)进行了无训练系统性评估,并测试多种推理时策略(思维链、问题分解、描述-推理级联、音频转录、空间状态提示、自一致性、多模型集成、类别路由)。核心发现是该基准为感知受限而非推理受限:推理侧增强效果中性甚至有害;基础模型感知能力与轻量测试时去噪才是可靠提升手段。分类别误差分析显示,低层感知是难点——相对深度、视角与计数最困难,而因果与社会推理已基本解决。显式注入单目深度提示反而使测试准确率下降5.8点,证实模型缺的是更好的感知,而非更优的推理流程。

原文摘要 · Abstract (English)

We describe our submission to the VRR Challenge @ CVPR 2026, built on the \emph{ImplicitQA} / \emph{VRR-QA} benchmark~\cite{implicitqa}: multiple-choice video question answering in which answers are deliberately \emph{not} observable in any single frame and must be inferred from spatial layout, motion, depth, viewpoint, causality, and social context across discontinuous frames of creative video. We conduct a systematic, training-free study spanning open-source Video-LMMs (Qwen2.5-VL~\cite{qwen25vl}, Qwen3-VL~\cite{qwen3vl}, InternVL3, Gemma-3, and the RL-tuned video reasoners Video-R1~\cite{videor1} and VideoChat-R1.5~\cite{videochatr15}) and a battery of inference-time strategies (chain-of-thought, question decomposition, describe-then-reason cascades, audio transcripts, spatial state prompting, self-consistency~\cite{selfconsistency}, multi-model ensembling, and category routing). Our central finding is that this benchmark is \emph{perception-bound rather than reasoning-bound}: reasoning-side augmentations are neutral-to-harmful, whereas base-model perceptual capability and lightweight test-time denoising are the only reliable levers. A per-category error analysis localizes the difficulty to low-level perception -- relative depth, viewpoint, and counting are the hardest categories, while causal and social reasoning are nearly solved -- and a prompt that explicitly injects monocular depth cues to attack the weakest category \emph{lowers} test accuracy by $5.8$ points, confirming that the model needs a better \emph{percept}, not a better \emph{procedure}.

视频问答感知优先自一致性视觉理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。