arXiv:2606.02835cs.AI2026-06

发现大模型答对后继续推理会出错,停止过早反而更准。

Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models

论文配图:Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models
图 1 · 摘自论文原文
  • 通过最小推理预算定位首次正确答案,区分冗余与有害过度推理。
  • 在多模态数据集上,提前停止使准确率提升21%。
  • 逻辑漂移和视觉重解是错误主因,效率策略无法解决此问题。

大型推理模型(LRMs)通过增加推理时计算量生成中间推理过程来提升性能,但更长的推理是否始终有益尚未得到充分验证。本文研究模型在首次得出正确答案后的行为,提出基于推理充分性的前缀级轨迹评估协议,定义首次生成正确答案所需的最小推理预算。该方法可区分冗余的过度推理(无害)与有害的过度推理(导致正确路径偏离)。在多模态基准测试中发现,许多看似需要复杂推理的任务实际只需极少推理步骤。若在首次正确前缀处停止,准确率较标准推理最高提升21%,表明模型不仅推理能力受限,还难以适时终止。尽管早期停止等效率策略能减少50%的冗余推理,却无法缓解有害推理。故障分析显示,错误主要源于逻辑漂移和视觉重解。结果在纯语言推理基准上也成立,揭示有害过度推理是普遍存在的可靠性风险。代码已公开于 https://simonecaldarella.github.io/thinking-past-the-answer。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) improve performance by generating explicit intermediate reasoning traces through increased test-time compute, yet the assumption that longer reasoning is consistently beneficial remains under-examined. While recent evidence shows that additional reasoning can lead models to overthink, we ask: "Once a model has reached the correct answer, does further reasoning refine the solution, or deviate from it?" To study the dynamics after correctness, we introduce a prefix-level trajectory evaluation protocol grounded in reasoning sufficiency, defining the minimum reasoning budget required for a model to first generate the correct answer. This allows us to disentangle verbose overthinking, where additional reasoning is redundant but harmless, from harmful overthinking, where continued reasoning destabilizes an already-correct trajectory. Starting from multimodal benchmarks, we find that many instances considered reasoning-intensive require surprisingly little reasoning. Moreover, stopping at the first correct prefix improves accuracy over standard reasoning up to 21%, revealing that current models are limited not only by their ability to reason, but also by their inability to stop at the right time. Furthermore, while common efficiency strategies like early stopping substantially reduce verbose overthinking (up to 50%), they fail to mitigate harmful overthinking. Failure analysis reveals that correctness deviations are mainly driven by logical drift and visual reinterpretation. Finally, we show that our findings generalize to language-only reasoning benchmarks, highlighting harmful overthinking as a broader reliability risk. Code available at https://simonecaldarella.github.io/thinking-past-the-answer.

大模型推理过度思考可靠性风险

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。