arXiv:2606.14723cs.CV2026-06

通过模型间分歧路由,提升隐含信息视频问答准确率。

Disagreement-Based Cross-Model Routing for Implicit Video Question Answering

  • 用三个样本的分歧识别难题,仅将难例转给另一模型处理。
  • 在验证集上平均准确率提升1.43,运动轨迹等类别增益超5。
  • 无需训练或标签,适合处理跨镜头推理的复杂视频理解任务。

我们在ImplicitQA基准上研究多选视频问答任务,其中正确答案不直接出现,需从画面外事件、视线线索、因果结构和跨镜头空间布局中推断。当前前沿视频大模型已接近性能极限,传统自一致性策略(重复采样后多数投票)反而有害,因模型错误具有相关性。我们提出基于分歧的跨模型路由方法,纯推理阶段执行,无需标签与训练。对原生视频模型(Gemini 3.1 Pro Preview)在温度零下三重采样,利用其视频处理管道的真实样本差异,识别约20%存在分歧的问题,并将这些题目路由至另一模型家族(Claude Opus 4.8),该模型使用均匀采样帧并结合自适应思维。在包含1001个问题的公开验证集上,该方法使平均准确率提升1.43,各类别增益集中在运动与轨迹(+5.49)、推断计数(+3.45)和垂直空间推理(+1.82),均为依赖跨镜头参照解析的任务。同一流程在172题的CVPR 2026 ImplicitQA挑战测试集上达到82.03平均准确率/79.71宏平均准确率,比主模型最佳单样本高1.81,验证结果可靠性。

原文摘要 · Abstract (English)

We study multiple-choice video question answering on the ImplicitQA benchmark, where the correct answer is never explicitly shown but must be inferred from off-screen events, line-of-sight cues, causal structure, and cross-shot spatial layout. On this benchmark a single frontier video LLM already operates near its accuracy ceiling, and we observe that conventional self-consistency strategies -- majority voting across repeated samples of the same model -- can hurt rather than help, because the model's errors on hard questions are correlated. We propose disagreement-based cross-model routing, a pure inference-time procedure that requires no labels and no training. We triple-sample a native-video model (Gemini 3.1 Pro Preview) at temperature zero, exploit the genuine sample-to-sample variance of its video-processing pipeline to identify the roughly 20% subset of questions where the three samples disagree, and route only that subset to a second model from a different family (Claude Opus 4.8) that consumes uniformly sampled frames with adaptive thinking. On the 1001-question validation set with public ground truth -- our main evaluation -- the method improves AvgAcc by +1.43 over the best single sample of the primary model, with per-category gains concentrated on Motion & Trajectory (+5.49), Inferred Counting (+3.45), and Vertical Spatial Reasoning (+1.82) -- the categories most dependent on cross-shot reference resolution. The same pipeline applied to the held-out 172-question CVPR 2026 ImplicitQA challenge test set achieves 82.03 AvgAcc / 79.71 MacroAvgAcc (+1.81 over the best single sample of the primary model), confirming the validation result on an independent split.

视频问答跨模型路由隐含推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。