arXiv:2604.11791cs.LGcs.AI2026-04被引 19

分析循环推理模型的内部机制,发现其隐状态呈现周期性稳定轨迹。

A Mechanistic Analysis of Looped Reasoning Language Models

论文配图:A Mechanistic Analysis of Looped Reasoning Language Models
图 1 · 摘自论文原文
  • 通过分析隐空间循环递归,发现每层收敛到不同固定点,形成周期性轨迹。
  • 固定点达成后注意力头行为稳定,重复迭代中推理阶段保持一致。
  • 揭示了模型规模、输入注入和归一化对周期稳定性的关键影响,指导架构设计。

推理已成为大语言模型的核心能力。近期研究显示,通过在隐空间中循环调用语言模型的层,可提升推理性能,形成循环推理语言模型。尽管结果令人鼓舞,但关于其内部动态与标准前馈模型差异的研究仍较少。本文对循环语言模型的隐状态进行机制分析,特别比较了前馈模型与循环模型在推理阶段的差异。我们分析了循环递归现象,发现多数模型中循环中的每一层均收敛至不同的固定点,从而导致递归模块在隐空间中遵循稳定的周期轨迹。我们提供证据表明,当这些固定点达到时,注意力头的行为趋于稳定,使各次递归间表现一致。实证发现,递归模块学习到的推理阶段与前馈模型高度相似,并在每次迭代中重复这些阶段。我们进一步研究了递归块大小、输入注入和归一化对周期固定点出现与稳定性的影响。这些发现有助于将机制洞察转化为实际的架构设计指导。

原文摘要 · Abstract (English)

Reasoning has become a central capability in large language models. Recent research has shown that reasoning performance can be improved by looping an LLM's layers in the latent dimension, resulting in looped reasoning language models. Despite promising results, few works have investigated how their internal dynamics differ from those of standard feedforward models. In this paper, we conduct a mechanistic analysis of the latent states in looped language models, focusing in particular on how the stages of inference observed in feedforward models compare to those observed in looped ones. To this end, we analyze cyclic recurrence and show that for many of the studied models each layer in the cycle converges to a distinct fixed point; consequently, the recurrent block follows a consistent cyclic trajectory in the latent space. We provide evidence that as these fixed points are reached, attention-head behavior stabilizes, leading to constant behavior across recurrences. Empirically, we discover that recurrent blocks learn stages of inference that closely mirror those of feedforward models, repeating these stages in depth with each iteration. We study how recurrent block size, input injection, and normalization influence the emergence and stability of these cyclic fixed points. We believe these findings help translate mechanistic insights into practical guidance for architectural design.

循环推理机制分析隐空间轨迹

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。