arXiv:2603.15641cs.AIcs.LG2026-03被引 1

递归模型训练更快且可无限推理,解决复杂逻辑题更准。

Form Follows Function: Recursive Stem Model

  • 用无历史依赖的训练方式,让模型学稳定迭代规则
  • 训练速度超TRM20倍,错误率降低5倍,测试时可无限迭代
  • 适合需要高可靠性、长思考过程的推理任务

递归推理模型如TRM在解决计算密集型与NP难题上表现优异,但其训练依赖深度监督和长序列回溯,导致耗时长且易产生贪婪行为。本文提出递归主干模型(RSM),保留TRM结构但改变训练机制:训练中完全剥离隐藏状态历史,仅在最终步施加损失,早期迭代视为预热。通过独立增长外层递归深度H与内层计算深度L,结合随机外层转移策略(随机深度采样),缓解深层扩展带来的不稳定性。该方法实现两大优势:(i) 训练速度提升超过20倍,错误率下降约5倍;(ii) 测试时可任意增加迭代次数(~20,000步远超训练时20步),实现无需重训的持续思考。在Sudoku-Extreme上达到97.5%精确率(单A100训练约1小时),在30×30的Maze-Hard上40分钟内达~80%准确率。此外,收敛行为提供原生可靠性信号:非收敛轨迹提示无效解,固定点可配合领域验证器实现正确性判断。

原文摘要 · Abstract (English)

Recursive reasoning models such as Hierarchical Reasoning Model (HRM) and Tiny Recursive Model (TRM) show that small, weight-shared networks can solve compute-heavy and NP puzzles by iteratively refining latent states, but their training typically relies on deep supervision and/or long unrolls that increase wall-clock cost and can bias the model toward greedy intermediate behavior. We introduce Recursive Stem Model (RSM), a recursive reasoning approach that keeps the TRM-style backbone while changing the training contract so the network learns a stable, depth-agnostic transition operator. RSM fully detaches the hidden-state history during training, treats early iterations as detached "warm-up" steps, and applies loss only at the final step. We further grow the outer recursion depth $H$ and inner compute depth $L$ independently and use a stochastic outer-transition scheme (stochastic depth over $H$) to mitigate instability when increasing depth. This yields two key capabilities: (i) $>20\times$ faster training than TRM while improving accuracy ($\approx 5\times$ reduction in error rate), and (ii) test-time scaling where inference can run for arbitrarily many refinement steps ($\sim 20,000 H_{\text{test}} \gg 20 H_{\text{train}}$), enabling additional "thinking" without retraining. On Sudoku-Extreme, RSM reaches 97.5% exact accuracy with test-time compute (within ~1 hour of training on a single A100), and on Maze-Hard ($30 \times 30$) it reaches ~80% exact accuracy in ~40 minutes using attention-based instantiation. Finally, because RSM implements an iterative settling process, convergence behavior provides a simple, architecture-native reliability signal: non-settling trajectories warn that the model has not reached a viable solution and can be a guard against hallucination, while stable fixed points can be paired with domain verifiers for practical correctness checks.

递归推理思维链模型可靠性高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。