arXiv:2602.20913cs.CV2026-02中稿 · CVPR被引 3

用智能推理导航高效理解长视频,节省计算资源。

LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding

  • 设计推理驱动的智能代理,按视觉线索选关键片段。
  • 在多个基准上实现准确率与效率的最佳平衡。
  • 适合需要低算力长视频理解的场景或研究者。

本文针对低计算预算下的长视频理解这一关键且未充分探索的问题提出 LongVideo-R1,一种具备主动推理能力的多模态大语言模型(MLLM)代理,用于高效视频上下文导航,避免全遍历冗余。其核心为利用高层视觉线索推断最相关信息片段的推理模块。推理时,代理从顶层视觉摘要开始迭代聚焦,一旦获取足够知识回答问题即停止探索。为训练,我们从带标注的视频语料 CGBench 中提取层次化视频描述,并引导 GPT-5 生成 3.3 万条高质量思维链+工具轨迹。基于 Qwen-3-8B 模型,采用两阶段微调:监督微调(SFT)后接强化学习(RL),其中 RL 使用特定奖励函数最大化选择性与效率。多组长视频基准测试验证了其有效性,表现优于现有方法,在问答准确率与效率间取得更优权衡。所有数据与代码已附于补充材料并公开。

原文摘要 · Abstract (English)

This paper addresses the critical and underexplored challenge of long video understanding with low computational budgets. We propose LongVideo-R1, an active, reasoning-equipped multimodal large language model (MLLM) agent designed for efficient video context navigation, avoiding the redundancy of exhaustive search. At the core of LongVideo-R1 lies a reasoning module that leverages high-level visual cues to infer the most informative video clip for subsequent processing. During inference, the agent initiates traversal from top-level visual summaries and iteratively refines its focus, immediately halting the exploration process upon acquiring sufficient knowledge to answer the query. To facilitate training, we first extract hierarchical video captions from CGBench, a video corpus with grounding annotations, and guide GPT-5 to generate 33K high-quality chain-of-thought-with-tool trajectories. The LongVideo-R1 agent is fine-tuned upon the Qwen-3-8B model through a two-stage paradigm: supervised fine-tuning (SFT) followed by reinforcement learning (RL), where RL employs a specifically designed reward function to maximize selective and efficient clip navigation. Experiments on multiple long video benchmarks validate the effectiveness of name, which enjoys superior tradeoff between QA accuracy and efficiency. All curated data and source code are provided in the supplementary material and will be made publicly available. Code and data are available at: https://github.com/qiujihao19/LongVideo-R1

长视频理解推理导航多模态模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。