提出可量化信息局部流动的框架,揭示递归推理中局部操作如何累积成全局结构。
Interaction Locality in Hierarchical Recursive Reasoning

- 设计交互局部性框架,通过激活修补与稀疏编码器分析信息流动范围。
- 发现高阶循环状态仅在邻近单元或同语义段内写入,递归更新逐步构建全局解结构。
- 适用于迷宫、数独和3D场景理解模型,适合研究递归推理机制的研究者。
空间推理需兼顾位置相关计算与位置无关结构:智能体必须进行局部操作,同时维持路径、物体或约束层面的规划。本文提出交互局部性——一种任务几何感知的框架,用于衡量信息流是否局限于邻近单元或语义片段,还是跨区域传播。通过稀疏自编码器特征消融和有限噪声激活修补法实现该框架,并在附录中报告结构雅可比矩阵与注意力分析。应用于HRM与TRM两个紧凑的层次化递归推理模型,在Maze-Hard、Sudoku Extreme和ARC-AGI数据集上验证。激活修补结果清晰呈现架构指纹:高层循环状态倾向于在邻近单元或同段单元内写入信息,而重复递归更新将这些局部写入累积为更广泛的解结构。此模式在迷宫路径、数独约束及ARC-AGI对象邻域中均成立,以TRM最为显著。为检验其是否超越网格类基准,进一步应用于大型具身3D场景理解模型MTU3D。结果显示,因果空间局部性主要出现在视觉特征传递至下游接地模块的过渡阶段,而非视觉编码器全程分布。这一对比表明,HRM与TRM中观察到的局部到全局交接机制与显式递归推理动态相关,而具身3D模型可能将因果空间结构集中于模块边界。交互局部性将‘局部执行、全局规划’的直观认知转化为可复现的递归与具身空间推理测量框架。
原文摘要 · Abstract (English)
Spatial reasoning requires both location-bound computation and location-invariant structure: agents must make local moves while preserving route, object, or constraint-level plans. We propose interaction locality, a task-geometry-aware framework for measuring whether information flow stays within nearby cells or semantic segments, or crosses them. We instantiate the framework with sparse-autoencoder feature ablations and finite-noise activation patching, with structural Jacobian and attention checks reported in the appendix, and apply it to HRM and TRM, two compact hierarchical and recursive reasoning models, on Maze-Hard, Sudoku Extreme, and ARC-AGI. Across these models, activation patching gives the clearest architectural fingerprint: high-level recurrent states tend to write information within nearby cells or same-segment units, while repeated recursive updates accumulate these local writes into broader solution structure. This pattern holds across maze paths, Sudoku constraints, and ARC-AGI object neighborhoods, with the strongest concentration in TRM. To test whether interaction locality extends beyond toy-yet-challenging grid benchmarks, we also apply it to MTU3D, a large-scale embodied 3D scene-grounding model. In this MTU3D setting, causal spatial locality appears primarily at the transition where visual scene features are handed to the downstream grounding module, rather than uniformly throughout the visual encoder. This contrast suggests that the local-to-global handoff observed in HRM and TRM is tied to explicit recursive reasoning dynamics, while embodied 3D models may concentrate causal spatial structure at module boundaries. Interaction locality turns the intuitive local-execution/global-planning story into a reproducible measurement framework for recursive and embodied spatial reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。