arXiv:2601.10679cs.AIcs.LG2026-01被引 5

揭示分层推理模型其实是在'猜答案',并提出提升准确率的新方法。

Are Your Reasoning Models Reasoning or Guessing? A Mechanistic Analysis of Hierarchical Reasoning Models

  • 发现分层模型依赖固定点假设,但实际常因初始猜测错误而困住。
  • 在解题过程中出现'突然正确'现象,说明推理非渐进改善。
  • 通过数据增强、输入扰动和模型自举,可显著提升推理准确性。

分层推理模型(HRM)在各类推理任务中表现卓越,远超基于大语言模型的推理器。为理解其优势与潜在缺陷,我们对其推理模式进行机制分析,发现三个意外现象:(a) 极简谜题失败,例如仅有一个未知单元格的数独,归因于固定点性质被破坏;(b) 推理步骤中存在'悟道'动态,答案并非逐步优化,而是某一关键步骤突然正确;(c) 存在多个固定点,模型会‘猜测’首个固定点,可能错误且无法跳出。上述现象表明HRM更像是‘猜测’而非‘推理’。基于此‘猜测’视角,我们提出三种扩增猜测的方法:数据增强(提升猜测质量)、输入扰动(利用推理随机性增加猜测次数)、模型自举(利用训练随机性增加猜测次数)。实践中,结合三者构建增强型HRM,将Sudoku-Extreme准确率从54.5%提升至96.9%。科学上,本研究为理解推理模型如何‘思考’提供了新洞见。

原文摘要 · Abstract (English)

Hierarchical reasoning model (HRM) achieves extraordinary performance on various reasoning tasks, significantly outperforming large language model-based reasoners. To understand the strengths and potential failure modes of HRM, we conduct a mechanistic study on its reasoning patterns and find three surprising facts: (a) Failure of extremely simple puzzles, e.g., HRM can fail on a puzzle with only one unknown cell. We attribute this failure to the violation of the fixed point property, a fundamental assumption of HRM. (b) "Grokking" dynamics in reasoning steps, i.e., the answer is not improved uniformly, but instead there is a critical reasoning step that suddenly makes the answer correct; (c) Existence of multiple fixed points. HRM "guesses" the first fixed point, which could be incorrect, and gets trapped there for a while or forever. All facts imply that HRM appears to be "guessing" instead of "reasoning". Leveraging this "guessing" picture, we propose three strategies to scale HRM's guesses: data augmentation (scaling the quality of guesses), input perturbation (scaling the number of guesses by leveraging inference randomness), and model bootstrapping (scaling the number of guesses by leveraging training randomness). On the practical side, by combining all methods, we develop Augmented HRM, boosting accuracy on Sudoku-Extreme from 54.5% to 96.9%. On the scientific side, our analysis provides new insights into how reasoning models "reason".

推理模型分层推理数独机制分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。