arXiv:2602.10097cs.LGcs.AI2026-02被引 3

揭示循环变压器中每个训练样本在不同推理步骤的影响轨迹

Step-resolved data attribution for looped transformers

  • 提出步分解影响分析法,追踪样本在每轮迭代中的作用
  • 在50轮循环下误差低于1.2%,性能接近完整梯度方法
  • 适用于大模型推理过程解释,尤其适合算法推理任务

我们研究训练样本如何塑造循环变压器的内部计算,其中共享模块在τ次递归迭代中用于实现潜在推理。现有训练数据影响估计方法如TracIn仅输出单一标量得分,对所有循环迭代进行聚合,掩盖了样本在何时起作用。本文提出「步分解影响(SDI)」,通过展开递归计算图,将TracIn分解为长度为τ的影响轨迹,实现对特定循环步骤的影响归属。为使SDI在变压器规模下实用,我们设计了基于TensorSketch的实现,无需显式生成每样本梯度。在循环GPT型模型和算法推理任务上的实验表明,SDI扩展性极佳,在τ=50时误差低于1.2%,与全梯度基线匹配,并支持多种数据归因与可解释性任务,提供对潜在推理过程的逐步洞察。

原文摘要 · Abstract (English)

We study how individual training examples shape the internal computation of looped transformers, where a shared block is applied for $τ$ recurrent iterations to enable latent reasoning. Existing training-data influence estimators such as TracIn yield a single scalar score that aggregates over all loop iterations, obscuring when during the recurrent computation a training example matters. We introduce \textit{Step-Decomposed Influence (SDI)}, which decomposes TracIn into a length-$τ$ influence trajectory by unrolling the recurrent computation graph and attributing influence to specific loop iterations. To make SDI practical at transformer scale, we propose a TensorSketch implementation that never materialises per-example gradients. Experiments on looped GPT-style models and algorithmic reasoning tasks show that SDI scales excellently, matches full-gradient baselines with low error and supports a broad range of data attribution and interpretability tasks with per-step insights into the latent reasoning process.

模型解释循环结构数据归因

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。