视频理解模型先答后思,能省则省,效率提升3倍以上。
VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice
- 先出答案再思考,仅在必要时启动推理
- 平均响应长度缩减至44词元,比原来减少3.3倍
- 感知任务少思考,推理任务多思考,灵活高效
链式思维(CoT)是多模态大模型在视频理解任务中的一种强大工具,但其必要性与优势尚未充分探索。本文首次发现,对于强化学习训练的视频模型,直接作答往往与或超越链式思维表现,尽管后者计算成本更高。为此,我们提出VideoAuto-R1框架,采用‘思考一次,回答两次’策略:训练时先生成初答,再推理并输出修订答案,两者均通过可验证奖励监督。推理时,模型根据初答置信度决定是否启用思考。在多个视频问答与定位基准上,该方法实现顶尖准确率,平均响应长度从149降至44词元,效率提升约3.3倍。同时观察到,感知类任务思考激活率低,而推理密集任务更高,表明语言推理虽有益,但并非总是必需。
原文摘要 · Abstract (English)
Chain-of-thought (CoT) reasoning has emerged as a powerful tool for multimodal large language models on video understanding tasks. However, its necessity and advantages over direct answering remain underexplored. In this paper, we first demonstrate that for RL-trained video models, direct answering often matches or even surpasses CoT performance, despite CoT producing step-by-step analyses at a higher computational cost. Motivated by this, we propose VideoAuto-R1, a video understanding framework that adopts a reason-when-necessary strategy. During training, our approach follows a Thinking Once, Answering Twice paradigm: the model first generates an initial answer, then performs reasoning, and finally outputs a reviewed answer. Both answers are supervised via verifiable rewards. During inference, the model uses the confidence score of the initial answer to determine whether to proceed with reasoning. Across video QA and grounding benchmarks, VideoAuto-R1 achieves state-of-the-art accuracy with significantly improved efficiency, reducing the average response length by ~3.3x, e.g., from 149 to just 44 tokens. Moreover, we observe a low rate of thinking-mode activation on perception-oriented tasks, but a higher rate on reasoning-intensive tasks. This suggests that explicit language-based reasoning is generally beneficial but not always necessary.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。