arXiv:2608.01980cs.CVcs.AI2026-08

让视频问答自动决定思考深度,省 token 又提准确率。

AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning

论文配图:AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
图 1 · 摘自论文原文
  • 根据问题难易动态选择是否详细推理,无需人工设定阈值。
  • 在多个数据集上平均准确率达40.79,用257.2个词元完成推理。
  • 新算法能从难但可解的问题中恢复学习信号,适合高效视频理解场景。

链式思维(CoT)能提升复杂视频问答的性能,但常对简单问题浪费解码词元。本文研究视频多模态大模型能否自适应调整推理强度。提出AdaThinkV框架,通过强化学习自主判断是否显式推理,无需离线难度标签、人工调参或外部路由。训练时,对每个提示同时采样显式推理与直接回答的完整生成路径。ThinkGain衡量显式推理的收益,平衡准确率提升与额外长度开销,指导条件生成与模式选择。对于困难但可解的提示,有限探索可能导致所有路径失败,准确率奖励差异小,学习信号不足。为此引入方差恢复策略优化(VRPO),保留并逐步扩展此类提示组,从中恢复有效信号。推理阶段,单次自回归生成选择模式并输出结果。在统一视频推理评估体系下,AdaThinkV平均准确率达40.79,平均输出词元257.20,优于最强基线2.98点,且减少22.7%词元消耗。

原文摘要 · Abstract (English)

Chain-of-thought (CoT) reasoning can improve performance on difficult video questions but often wastes decoding tokens on simple ones. We study whether a video multimodal large language model can adapt its reasoning effort to each question. We propose AdaThinkV, an adaptive framework for video reasoning that learns whether to reason explicitly without offline difficulty labels, manually tuned confidence thresholds, or an external router. During reinforcement learning, AdaThinkV samples matched rollouts in explicit reasoning and direct answering modes for each prompt. ThinkGain estimates the prompt-level utility of explicit reasoning by balancing its accuracy gain against additional response length, providing supervision for both conditional response generation and autonomous mode selection. For difficult prompts, limited rollout exploration can yield groups in which every response is unsuccessful and accuracy rewards show little variation, providing insufficient signal for learning. We therefore introduce Variance Recovery Policy Optimization (VRPO), which retains and progressively expands these groups to recover informative signals from prompts that are difficult yet solvable. At inference, AdaThinkV selects a response mode and generates the response in a single autoregressive sequence. Across a unified suite of video reasoning evaluations, AdaThinkV achieves a mean accuracy of 40.79 with an average of 257.20 output tokens, outperforming the strongest evaluated adaptive baseline by 2.98 points while using 22.7% fewer tokens. Project page: https://trilarflagz.github.io/AdaThinkV/

视频理解自适应推理高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。