arXiv:2603.14468cs.CVcs.IR2026-03被引 3

评测长视频中多跳证据检索的智能体能力,强调精准规划与高效查询。

LongVidSearch: An Agentic Benchmark for Multi-hop Evidence Retrieval Planning in Long Videos

  • 设计强制多跳检索的标准化基准,每题需恰好k个关键片段
  • GPT-5准确率42.43%领先,但仍未超50%,凸显规划难题
  • 提供统一工具接口,可分离评估检索规划与答案生成性能

长视频问答日益依赖智能体通过工具检索证据。真实场景中常需多跳检索——即迭代获取多个不连续的证据片段。然而现有基准多为静态,极少强制多跳要求,且缺乏标准证据访问接口,难以区分检索规划失败与答案生成失败。为此,我们提出LongVidSearch,一个在标准化访问约束下评估长视频中智能体多跳证据检索规划的基准。该基准强制检索必要性:第k跳问题需恰好k个必要证据片段,缺失任一片段即无法解答。基准包含447段长视频(平均时长26分钟)上的3,000道题目,涵盖状态变化、因果推理、全局总结和视觉追踪四类推理任务,支持2至4跳证据需求。为确保公平评估,所有智能体通过统一工具接口交互,固定检索后端,仅测试智能体的查询生成与检索规划能力。除答案准确率外,还测量工具调用成本,分析精度与效率的权衡。使用三名评委多数投票评估基于VideoAgent的问答智能体,采用多种主干大模型。GPT-5表现最佳(准确率42.43),优于Gemini 3 Pro(30.97)和GPT-4o(19.20),但仍未过半,表明多跳规划仍是主要瓶颈。当提供黄金证据片段时,性能接近完美,验证了检索规划是核心挑战。

原文摘要 · Abstract (English)

Long video question answering (Long-Video QA) increasingly relies on agentic tool use to retrieve evidence from long videos. In realistic settings, this process often requires multi-hop retrieval, where agents must iteratively gather multiple discontinuous evidence clips. However, existing long-video benchmarks are largely static: they rarely enforce strict multi-hop retrieval and typically lack a standardized evidence-access interface, making it difficult to separate failures in retrieval planning from those in answer generation. To address this gap, we introduce LongVidSearch, a benchmark for evaluating agentic multi-hop evidence retrieval planning in long videos under standardized access constraints. LongVidSearch enforces retrieval necessity: a Hop-k question requires exactly k necessary evidence clips, and removing any single clip renders the question unsolvable. The benchmark contains 3,000 questions over 447 long videos (average length 26 minutes), covering four reasoning categories: State Mutation, Causal Inference, Global Summary, and Visual Tracking, with 2-hop, 3-hop, and 4-hop evidence requirements. To ensure fair and controlled evaluation, all agents interact with LongVidSearch through a unified tool interface, which fixes the retrieval backend and isolates the agent's ability to formulate queries and plan iterative retrieval. In addition to answer accuracy, we measure tool-call cost to analyze the accuracy-efficiency trade-off under identical access conditions. We evaluate VideoAgent-style QA agents with multiple backbone LLMs using three-judge majority voting. GPT-5 achieves the highest accuracy (42.43), outperforming Gemini 3 Pro (30.97) and GPT-4o (19.20), yet remaining below 50 %, highlighting the difficulty of multi-hop retrieval planning. With gold evidence clips, performance becomes near-perfect, confirming retrieval planning as the primary bottleneck.

长视频多跳检索智能体评测问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。