用可计算的反向区分度测量梯度下降的记忆特性,揭示训练过程非马尔可夫性。
Process-Tensor Tomography of SGD: Measuring Non-Markovian Memory via Back-Flow of Distinguishability
- 将训练过程视为多时间映射,通过干预实验检测区分度回流
- 正向回流在高动量、大批次重叠时增强,重置优化器状态则消失
- 无需改动模型结构,适合比较优化器与训练调度的内存效应
本文将神经网络训练建模为过程张量:一个输入可控操作序列(如批处理选择、数据增强、优化器微步)并输出模型可观测结果的多时间映射。基于此视角,提出一种简单、模型无关的训练记忆判别器,基于区分度回流(back-flow of distinguishability)。在两阶段控制协议中,比较单次干预与双次干预后的输出分布差异,若 $Δ_{\mathrm{BF}} = D_2 - D_1 > 0$(其中 $D \in \{\mathrm{TV}, \mathrm{JS}, \mathrm{H}\}$ 为软标签预测上的总变差、詹森-香农或海林格距离),即证明显非马尔可夫性。实验观察到一致正向回流,且置信区间紧密;在更高动量、更大批次重叠、更多微步下显著放大,而优化器状态重置(因果断裂)后完全消失,直接归因于优化器与数据状态的记忆。该判别器对 TV/JS/Hellinger 均鲁棒,计算成本低,无需架构修改。本工作定位为一项测量贡献:提供严谨诊断工具与实证证据,表明实际 SGD 偏离了马尔可夫理想化假设。探索性案例研究显示,微观信号可用于指导课程顺序设计。'数据顺序重要'由此变为可检验的带置信区间的算子,框架为比较优化器、课程与调度的训练记忆效应提供了统一平台。
原文摘要 · Abstract (English)
This work proposes neural training as a \emph{process tensor}: a multi-time map that takes a sequence of controllable instruments (batch choices, augmentations, optimizer micro-steps) and returns an observable of the trained model. Building on this operational lens, we introduce a simple, model-agnostic witness of training memory based on \emph{back-flow of distinguishability}. In a controlled two-step protocol, we compare outcome distributions after one intervention versus two; the increase $Δ_{\mathrm{BF}} = D_2 - D_1>0$ (with $D\in\{\mathrm{TV}, \mathrm{JS}, \mathrm{H}\}$ measured on softmax predictions over a fixed probe set) certifies non-Markovianity. We observe consistent positive back-flow with tight bootstrap confidence intervals, amplification under higher momentum, larger batch overlap, and more micro-steps, and collapse under a \emph{causal break} (resetting optimizer state), directly attributing the effect to optimizer/data-state memory. The witness is robust across TV/JS/Hellinger, inexpensive to compute, and requires no architectural changes. We position this as a \emph{measurement} contribution: a principled diagnostic and empirical evidence that practical SGD deviates from the Markov idealization. An exploratory case study illustrates how the micro-level signal can inform curriculum orderings. "Data order matters" turns into a testable operator with confidence bounds, our framework offers a common stage to compare optimizers, curricula, and schedules through their induced training memory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。