arXiv:2605.23926cs.AIcs.LG2026-05

发现大模型推理过程93%是冗余的,思考太多反而浪费资源。

How Much Thinking is Enough? Quantifying and Understanding Redundancy in LLM Reasoning

  • 通过截断推理链条,量化每步是否必要,发现多数步骤可删
  • 8种情况下冗余率61%~93%,最难题仍有46%以上冗余
  • 冗余源于训练机制本质,非模型缺陷,改不了只能容忍

具备推理能力的大语言模型通过生成长链思维解决难题,但代价高昂。观察其推理轨迹可见大量重复、验证与循环反思,但这种冗余程度从未被规模化测量或从原理上解释。本文首次实现两方面突破:将推理冗余定义为正确推理路径中可被截断的最长尾部片段比例(ρ),即在强制终止时仍能得出正确答案的最大比例;在四个前沿推理模型和两个数学基准上进行大规模量化,结果显示步骤级冗余率普遍很高——8个(模型,基准)组合中为61%至93%,其中六个条件下临界前缀仅为单一步骤;该结果对判断者家族选择稳健,且即使在难度最高的MATH-500 Level-5问题上,四款模型仍保持46%至85%的显著冗余。进一步证明,这种冗余是长度无关结果奖励机制的结构性后果,无论强化学习算法、基础模型、数据分布或训练方式如何,不存在最优有限期望停止时间。因此,过度思考不是个别模型的缺陷,而是当前推理模型训练范式的内在属性。

原文摘要 · Abstract (English)

Reasoning-capable large language models solve hard problems by emitting long chains of thought, paying heavily in latency, GPU time, and energy. Casual inspection of their traces reveals extensive reformulation, verification, and circular self-reflection, yet how much of this deliberation is actually necessary has never been measured at scale or explained from first principles. This paper closes both gaps. We formalise reasoning redundancy directly in terms of the reasoning model itself: the redundancy of a correct trace is the largest fraction of its trailing segmented steps that can be truncated while $π$, forced to terminate thinking and emit a final answer, still produces the correct answer. A large-scale quantification across four frontier reasoning models and two mathematical benchmarks shows that step-level redundancy is consistently high -- between 61% and 93% across the 8 (model, benchmark) conditions we study, with the median critical prefix equal to a single segmented step in six of the eight conditions -- that the finding is robust to the choice of judge family, and that although $ρ$ decreases with problem difficulty on MATH-500, all four models remain substantially redundant ($ρ\in [46\%, 85\%]$) even on the hardest Level-5 problems. We then prove that this redundancy is a structural consequence of length-agnostic outcome rewards, not a model-specific artefact: under any such reward, no finite expected stopping time is optimal. The result holds regardless of RL algorithm, base model, data distribution, or whether the policy is obtained via RL or distillation; over-thinking is therefore not a bug to be patched in individual models but a structural property of how current reasoning models are trained. Code: https://github.com/zhiyuanZhai20/how-much-thinking-is-enough

大模型推理冗余分析思维链训练机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。