arXiv:2605.27935cs.AI2026-05

研究发现智能体推理时会随任务复杂度动态调动深层网络。

Do Agents Think Deeper? A Mechanistic Investigation of Layer-Wise Dynamics in Sequential Planning

论文配图:Do Agents Think Deeper? A Mechanistic Investigation of Layer-Wise Dynamics in Sequential Planning
图 1 · 摘自论文原文
  • 通过层级分析发现,智能体在多轮规划中逐步激活更深层
  • 后期层间依赖增强,残差更新以修正为主
  • 不同模型深度分配差异大,适合研究推理机制

近期机械机制研究表明,大型语言模型(LLMs)在标准单轮任务中可能未有效利用其深度。但在自主智能体场景下,模型需执行多轮规划、工具使用和迭代状态更新,这一现象是否依然存在尚不明确。本文通过系统性地分析涵盖三个领域(深度研究、代码生成、表格处理)的完整用户-智能体轨迹,采用残差流探针、因果层跳过干预和有效深度测量方法,揭示了智能体推理具有与静态任务不同的深度特征。随着轨迹展开,模型逐步调用更多且更深的层,后期轮次中长程层间依赖显著增强。同时,残差更新逐渐以修正为主,表明从稳定的特征积累转向反复校准。有效深度分析进一步显示明显的构建-精炼差距:语义方向通常较早形成,但深层仍对最终输出的稳定至关重要。跨模型家族比较发现,该差距在Qwen和Minimax中尤为明显,而GLM则表现出更强的领域依赖性深度分配模式。这些结果提供了机制层面的证据,表明自主LLM智能体能随推理复杂度自适应分配深度。

原文摘要 · Abstract (English)

Recent mechanistic studies suggest that large language models (LLMs) may utilize their depth inefficiently in standard single-turn tasks. Whether this still holds in autonomous agent settings, where models must perform multi-turn planning, tool use, and iterative state updates, remains unclear. We study this question through a systematic layer-wise analysis of complete user-agent trajectories spanning three domains: Deep Research, Code Generation, and Tabular Processing. Using residual stream probes, causal layer-skipping interventions, and effective-depth measurements, we show that agentic reasoning exhibits a distinct depth profile from static tasks. As trajectories unfold, models progressively recruit more and deeper layers, with stronger long-range inter-layer dependencies emerging in later turns. At the same time, residual updates become increasingly correction-dominant, indicating a shift from stable feature accumulation toward repeated recalibration. Effective-depth analysis further reveals a substantial construction-refinement gap: semantic direction often forms relatively early, while deep layers remain necessary for stabilizing final outputs. Across model families, this gap is pronounced in Qwen and Minimax, whereas GLM shows a more domain-dependent depth allocation pattern. These results provide mechanistic evidence that autonomous LLM agents allocate depth adaptively as reasoning complexity grows.

智能体深度机制推理分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。