arXiv:2506.05744cs.AI2025-06NeurIPS被引 29

通过分析推理图结构,揭示大模型推理机制与性能的关系。

Topology of Reasoning: Understanding Large Reasoning Models through Reasoning Graph Properties

  • 用隐藏状态聚类构建推理图,分析循环性、直径和小世界特性。
  • 32B模型推理图直径最大,循环约5次,小世界特征强6倍,与准确率正相关。
  • 微调数据集可扩大图直径,为提升推理能力提供设计指南。

近期大规模推理模型在复杂数学基准测试中达到顶尖水平,但其内部机制仍不清晰。本文提出推理图概念,通过聚类每个推理步骤的隐藏状态提取,并系统分析其三个图论特性:循环性、直径和小世界指数。实验覆盖GSM8K、MATH500和AIME 2024多个任务。结果表明,蒸馏模型(如DeepSeek-R1-Distill-Qwen-32B)相比基线模型具有显著更多循环(约5次/样本)、更大直径及更强小世界特性(约6倍)。这些结构优势随任务难度与模型容量增加而增强:14B模型循环检测达峰值,32B模型探索直径最大,且与准确率正相关。此外,改进数据集上的监督微调能系统性扩大推理图直径,伴随性能提升,为数据设计提供了具体指导。本研究连接推理图结构的理论洞察与数据构建实践,推动大模型推理能力的可解释性与有效性提升。

原文摘要 · Abstract (English)

Recent large-scale reasoning models have achieved state-of-the-art performance on challenging mathematical benchmarks, yet the internal mechanisms underlying their success remain poorly understood. In this work, we introduce the notion of a reasoning graph, extracted by clustering hidden-state representations at each reasoning step, and systematically analyze three key graph-theoretic properties: cyclicity, diameter, and small-world index, across multiple tasks (GSM8K, MATH500, AIME 2024). Our findings reveal that distilled reasoning models (e.g., DeepSeek-R1-Distill-Qwen-32B) exhibit significantly more recurrent cycles (about 5 per sample), substantially larger graph diameters, and pronounced small-world characteristics (about 6x) compared to their base counterparts. Notably, these structural advantages grow with task difficulty and model capacity, with cycle detection peaking at the 14B scale and exploration diameter maximized in the 32B variant, correlating positively with accuracy. Furthermore, we show that supervised fine-tuning on an improved dataset systematically expands reasoning graph diameters in tandem with performance gains, offering concrete guidelines for dataset design aimed at boosting reasoning capabilities. By bridging theoretical insights into reasoning graph structures with practical recommendations for data construction, our work advances both the interpretability and the efficacy of large reasoning models.

推理机制图结构模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。