视频模型生成早期就锁定路径,可提升长迷宫求解准确率。
Video Models Reason Early: Exploiting Plan Commitment for Maze Solving
- 模型在前几步去噪中即确定整体路径,后续只优化细节。
- 路径长度超12步时模型失败率陡增,障碍密度影响较小。
- 新方法ChEaP仅保留优质初始路径,使长迷宫成功率从7%升至67%。
视频扩散模型展现出解决迷宫和谜题的涌现推理能力,但其生成过程中的推理机制尚不清晰。本文以二维迷宫求解为受控测试平台,研究视频模型的内部规划动态。发现两个关键现象:一是早期计划承诺——模型在前几轮去噪步骤内即确定高层运动路径,后续去噪仅改变视觉细节而不再改变轨迹;二是路径长度是迷宫难度的主要决定因素,而非障碍密度,在12步处存在明显的失败阈值。这意味着模型需通过串联多次生成才能处理长路径迷宫。为此提出基于早期规划的链式方法(ChEaP),仅对具有潜力的初始种子进行计算并链式组合,显著提升性能:在长视野迷宫上准确率从7%提升至67%,在Frozen Lake与VR-Bench上的复杂任务整体提升2.5倍,涵盖Wan2.2-14B与HunyuanVideo-1.5模型。分析表明,当前视频模型具备远超以往认知的深层推理能力,可通过更优的推理阶段扩展有效激发。
原文摘要 · Abstract (English)
Video diffusion models exhibit emergent reasoning capabilities like solving mazes and puzzles, yet little is understood about how they reason during generation. We take a first step towards understanding this and study the internal planning dynamics of video models using 2D maze solving as a controlled testbed. Our investigations reveal two findings. Our first finding is early plan commitment: video diffusion models commit to a high-level motion plan within the first few denoising steps, after which further denoising alters visual details but not the underlying trajectory. Our second finding is that path length, not obstacle density, is the dominant predictor of maze difficulty, with a sharp failure threshold at 12 steps. This means video models can only reason over long mazes by chaining together multiple sequential generations. To demonstrate the practical benefits of our findings, we introduce Chaining with Early Planning, or ChEaP, which only spends compute on seeds with promising early plans and chains them together to tackle complex mazes. This improves accuracy from 7% to 67% on long-horizon mazes and by 2.5x overall on hard tasks in Frozen Lake and VR-Bench across Wan2.2-14B and HunyuanVideo-1.5. Our analysis reveals that current video models possess deeper reasoning capabilities than previously recognized, which can be elicited more reliably with better inference-time scaling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。