优化器状态延迟传输影响短期训练决策,可提升模型表现。
Delayed Optimizer-State Transport Shapes Short-Horizon Training Decisions
- 通过追踪8步AdamW轨迹,发现优化器状态影响未来损失调度选择。
- 在12个未使用历史中,全传输方案降低分词损失4.71×10⁻⁴(p=0.0193)。
- 适合关注训练动态建模与短期干预策略的研究者阅读。
自适应优化器通过动量变量保留梯度历史,使损失权重的局部变化影响后续更新。本文研究这种延迟传输是否足以改变短期训练决策。在已确定的未来小批量序列上,我们对完整模型-优化器状态的八步AdamW轨迹进行微分,并在独立评估前选择匹配曝光的Math-Code损失调度。在12个未使用过的0.3M Transformer历史中,全传输方案在10/12个历史中优于优化器感知的即时导数(平均收益4.71×10⁻⁴;单侧符号检验,p=0.0193)。两个控制器选择频率相同,但在60/96窗口中选择不同调度。交叉检查点-未来路径测试表明,此重排序源于优化器状态与近未来数据顺序的相互作用;独立的Ising-CNN实验显示,删除动量状态传输会破坏准确响应预测。全传输得分还能在更大候选库中集中精确回溯的胜出者,将有限幅度评估聚焦于短名单。因此,在这些确定的短路径上,优化器记忆与近未来数据顺序是可操作的训练状态成分,为何时需采用有限视野而非单步干预提供了机制依据。
原文摘要 · Abstract (English)
Adaptive optimizers retain gradient history in moment variables, allowing a local change in loss weighting to alter later updates. We examine whether this delayed transport is large enough to change prospective short-horizon decisions. On committed future-minibatch sequences, we differentiate eight-step AdamW trajectories through the complete model--optimizer state and select exposure-matched Math--Code loss schedules before independent evaluation. Across 12 unused 0.3M Transformer histories, full transport lowers token-disjoint loss relative to an optimizer-aware immediate derivative in 10/12 histories (mean benefit $4.71\times10^{-4}$; exact one-sided sign test, $p=0.0193$). The two controllers act equally often but select different schedules in 60/96 windows. Crossed checkpoint--future-path tests attribute this reordering to the interaction between optimizer state and near-future data, while an independent Ising--CNN experiment shows that deleting moment-state transport destroys accurate response prediction. Full-transport scores also concentrate exact-rollout winners in larger candidate libraries, focusing finite-amplitude evaluation on a shortlist. On these committed short paths, optimizer memory and near-future data order are therefore actionable components of the training state, providing a mechanism-based criterion for when finite-horizon rather than one-step intervention is required.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。