arXiv:2608.26355cs.CVcs.LG2026-08

通过分步筛选关键证据,提升长视频问答准确率

Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos

论文配图:Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos
图 1 · 摘自论文原文
  • 先用问题特征索引片段,再用答案对比增强证据检索
  • 在MMR-V上达42.6%准确率,线索恢复率达66.9%
  • 适合需要精准证据推理的长视频任务

尽管视觉语言模型快速进步,长视频问答仍面临挑战:相关证据稀疏,且上下文常无法区分正确答案与合理干扰项。对MMR-V数据集人工标注子集的诊断分析显示,现有代理系统虽显著提升线索检索,但准确率未同步提升,说明瓶颈在于选项区分性证据而非主题相关性。本文提出PACE(渐进式关键证据获取)框架,分两阶段进行:首先基于问题衍生特征索引片段级描述,不依赖候选答案;随后利用候选答案生成对比线索,查询索引进行验证。在采用开源Qwen3-VL主干的MMR-V上,PACE实现42.6%准确率,优于直接推理和Deep Video Discovery等先前代理基线。在同一诊断子集上,PACE恢复了66.9%的标注线索,证实其增益源于证据恢复能力提升而非更强的答案先验。在LVBench、Video-MME、EgoSchema和LongVideoBench上的持续优势表明,该方法具有跨数据集泛化能力。代码已开源。

原文摘要 · Abstract (English)

While LVLMs rapidly improve, long-video question answering still remains challenging: relevant evidence is sparse, and question-relevant context often fails to provide cues that discriminate the correct answer from plausible alternatives. Diagnostic analysis on a manually annotated subset of MMR-V shows that prior agentic systems substantially improve cue retrieval over direct VLM inference yet fail to achieve a corresponding gain in answer accuracy, indicating that the bottleneck lies in option-discriminative evidence rather than topical relevance alone. We propose PACE (Progressive Acquisition of Critical Evidence), a factor-guided framework for long-video evidence acquisition. PACE proceeds in two stages: it first indexes clip-level descriptions guided by question-derived factors without observing the candidate answers; it then uses the candidate answers to derive contrastive cues and queries the index for verification. On MMR-V with the open-source Qwen3-VL backbone, PACE achieves 42.6% accuracy, outperforming direct inference and prior agentic baselines including Deep Video Discovery (DVD). On the same diagnostic subset, PACE recovers 66.9% of the annotated cues, providing empirical evidence that its gains are associated with improved evidence recovery rather than stronger answer-side priors alone. Consistent gains over DVD on LVBench, Video-MME, EgoSchema, and LongVideoBench suggest that option-aware evidence acquisition transfers beyond MMR-V. Code is available at https://github.com/HKUST-KnowComp/PACE.

长视频问答证据检索视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。