为大模型训练设计动态调控层,提升高压力下的稳定性与效率。
Learn-by-Wire Training Control Governance: Bounded Autonomous Training Under Stress for Stability and Efficiency
- 在AdamW之上添加可观测的运行时控制层,实时调节训练过程。
- 7B模型下困惑度降18.7%,训练时间减少10%,强学习率下仍保持稳定。
- 适合追求高效鲁棒训练的大模型研发团队,尤其高压场景下使用。
现代语言模型训练在激进的学习率、规模和运行时间压力下愈发易出现不稳定、性能下降和算力浪费。本文提出Learn-by-Wire Guard(LBW-Guard),一个位于AdamW之上的受控自治训练治理层。它不替换优化器更新规则,而是通过观测训练遥测数据,识别敏感不稳定区间,并对优化器执行施加有界控制,同时保持既定训练目标不变。我们在以Qwen2.5为核心的应力与鲁棒性测试套件中评估,采用WikiText-103数据集,以Qwen2.5-7B为基准,对比Qwen2.5-3B与14B模型规模,测试不同学习率压力、梯度裁剪基线及无LoRA的TinyLlama-1B全参数验证。在7B参考设置下,LBW-Guard将最终困惑度从13.21降至10.74(降低18.7%),端到端时间由392.54秒缩短至357.02秒(提速1.10倍)。在更强学习率压力下,当学习率设为3e-3时,原AdamW困惑度飙升至1885.24,而LBW-Guard仍可维持在11.57;学习率1e-3时,后者达10.33,远优于原始方法。梯度裁剪基线无法复现此效果。结果表明,在敏感稳定性场景中,优化器之上的治理平面可显著提升训练鲁棒性。LBW-Guard证实,有界运行时控制可在压力下保留有效算力,且区别于优化器替换或局部梯度抑制。
原文摘要 · Abstract (English)
Modern language-model training is increasingly exposed to instability, degraded runs, and wasted compute, especially under aggressive learning-rate, scale, and runtime-stress conditions. This paper introduces Learn-by-Wire Guard (LBW-Guard), a bounded autonomous training-control governance layer that operates above AdamW. Rather than replacing the optimizer update rule, LBW-Guard observes training telemetry, interprets instability-sensitive regimes, and applies bounded control to optimizer execution while preserving fixed training objectives. We evaluate LBW-Guard in a Qwen2.5-centered stress-and-robustness suite using WikiText-103, with Qwen2.5-7B as the empirical anchor, model-size comparisons against Qwen2.5-3B and Qwen2.5-14B, learning-rate stress tests, gradient-clipping baselines, and a no-LoRA TinyLlama-1B full-parameter sanity check. In the 7B reference setting, LBW-Guard reduces final perplexity from 13.21 to 10.74, an 18.7% improvement, while reducing end-to-end time from 392.54s to 357.02s, a 1.10x speedup. Under stronger learning-rate stress, AdamW degrades to 1885.24 final perplexity at LR=3e-3 and 659.76 at LR=1e-3, whereas LBW-Guard remains trainable at 11.57 and 10.33, respectively. Gradient-clipping baselines do not reproduce this effect. These results support a scoped systems conclusion that stability-sensitive LLM training can benefit from a governance plane above the optimizer. LBW-Guard provides evidence that bounded runtime control can preserve productive compute under stress while remaining distinct from optimizer replacement and local gradient suppression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。