arXiv:2606.07410cs.LGcs.AI2026-06被引 1

对比人类与深求模型解题,发现后者只是模仿推理外表。

A Comprehensive Anatomy of Human and DeepSeek-R1 LLM Mathematical Reasoning

论文配图:A Comprehensive Anatomy of Human and DeepSeek-R1 LLM Mathematical Reasoning
图 1 · 摘自论文原文
  • 将30道题的1万多步推理分为五类,系统分析逻辑结构差异
  • 人类解题逻辑紧凑,模型频繁重复验证且无实质推进
  • 真正有效反思需嵌入推理链中,而非困于局部计算

我们对深求-R1-0120与人类在AIME 2025全部30道题上的推理过程进行了全面实证对比,对10,247个推理步骤进行标注,划分为分析、推断、分支、回溯和反思五类。结果发现:人类解题保持分析与推断间的紧凑交替,而深求-R1频繁回溯中间结果,执行浅层且不必要的验证,陷入局部检查循环却无实质性逻辑进展。我们将此称为拓扑模仿——仅复制推理的表面形式,而非其功能作用。尽管如此,我们识别出两个真实推理信号:成功轨迹稳定使用分支与回溯,失败轨迹则或过度或不足;反思仅在嵌入推断过程中有效,若困于分析循环,则聚焦局部数值细节而忽视全局逻辑错误。这些发现表明,当前长思维链模型可能更受表象推理奖励,而非真实演绎进展。我们建议改进评估与训练方向,包括衡量跨轨迹稳定性、惩罚‘原地打转’式轨迹、鼓励深层逻辑修正,并将推理时算力重新分配至推断与回溯。总体而言,推理质量不取决于反思次数,而在于其是否持续且恰当地出现在逻辑层级上。

原文摘要 · Abstract (English)

The emergence of "Aha moments" in large language models, particularly DeepSeek-R1-0120, has raised the question of whether these systems genuinely reason or merely imitate the appearance of reasoning. We conduct a comprehensive empirical comparison between model and human reasoning across all 30 problems from AIME 2025, exhaustively annotating 10,247 reasoning steps into five functional categories: Analysis, Inference, Branch, Backtrace, and Reflection. We find a clear structural difference. Human solutions maintain a compact alternation between analysis and deduction, whereas DeepSeek-R1 frequently revisits intermediate results, performs shallow and often unnecessary verification, and loops through local checks without meaningful logical progress. We describe this as topological mimicry: reproducing the surface form of reasoning without its functional role. Despite this, we identify two signals of genuine reasoning. First, successful traces exhibit stable use of branching and backtracking, while failed traces either underuse or overuse exploratory actions. Second, reflection is only effective when placed within deductive inference; reflections trapped in analysis loops focus on local numerical details while missing global logical errors. These findings suggest that current long-CoT models may be rewarded more for the appearance of reasoning than for genuine deductive progress. We discuss directions for improving evaluation and training, including measuring cross-trace stability, penalising "spinning-wheel" traces, encouraging deeper logical correction, and reallocating inference-time compute toward deduction and backtracking. Overall, reasoning quality depends not simply on how much reflection occurs, but on whether reflection appears consistently and at the appropriate logical scale.

大模型推理数学能力思维链认知分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。