arXiv:2605.14619cs.AI2026-05被引 1

发现相同答案但推理路径不同的'过程异构体',揭示多路径推理的隐藏结构。

SliceGraph: Mapping Process Isomers in Multi-Run Chain-of-Thought Reasoning

论文配图:SliceGraph: Mapping Process Isomers in Multi-Run Chain-of-Thought Reasoning
图 1 · 摘自论文原文
  • 用稀疏激活相似性构建推理路径图,分析中间步骤的共享与分裂
  • 85.5%正确解答分属不同推理家族,76.6%路径对跨家族,同一答案有多样解法
  • 适合研究大模型推理机制、可解释性与多路径探索的学者

多轮链式思维推理通常被简化为最终答案聚合,忽略了采样轨迹在中间计算中如何共享、分裂和重连。我们提出SliceGraph,一种基于互近邻(mutual-kNN)和稀疏激活键的杰卡德相似性构建的后处理问题-模型-单元图,将其作为过程几何的度量对象而非解码程序。在三个4B/8B模型于数学与科学基准上的采样推理集上,盲注验证显示SliceGraph的双连通分量是共享推理状态单元,而过程家族是策略一致的路径单元。在954个问题-模型单元中,85.5%的正确链式思维虽得相同归一化答案却分属多个过程家族;至少包含两个该类路径的单元中,平均76.6%的路径对跨家族。我们将这类同答异路的正确轨迹称为‘过程异构体’。标签引导的奖励场提供独立价值景观层:成功区域常分裂为不连通的高价值核心,路径家族则专门化于这些核心足迹,而非简单重复。类型化状态转移分析进一步表明,过程家族在相同地图上以不同转移核导航,匹配零控制条件下仍成立。表示消融、跨架构复制及两次跨尺度复制均支持路径家族框架的鲁棒性,表明最终答案聚合忽略了这种结构化的多路径过程几何。

原文摘要 · Abstract (English)

Multi-run chain-of-thought reasoning is usually collapsed to final-answer aggregates, which discard howsampled trajectories share, split, and rejoin through intermediate computation. We propose SliceGraph, a post-hoc problem-model-cell graph built by mutual-kNN over sparse activation-key Jaccard similarity between CoT slices, and treat it as a measurement object for process geometry rather than as a decoding program. Across sampled CoT ensembles from three primary 4B/8B models on math and science benchmarks, blinded annotation supports SliceGraph biconnected components as shared reasoning-state units and process families as within-family strategy-coherent route units. In 85.5% of 954 problem-model cells, correct CoTs sharing the same normalized answer split into multiple process families; among cells with at least two such runs, 76.6% of run pairs are cross-family on average. We call such same-answer, family-divergent correct trajectories process isomers. A label-seeded reward field provides a separate value-landscape layer: success-associated regions often split into disconnected high-value cores, and route families specialize over these core footprints rather than merely duplicating one another. A typed-state transition analysis further shows that process families navigate the same atlas with distinct transition kernels under matched null controls. Representation ablations, a cross-architecture replication, and two cross-scale replications support the robustness of the route-family scaffold, showing that final-answer aggregation overlooks this structured multi-route process geometry.

推理机制过程异构体链式思考可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。