arXiv:2607.02544cs.DCcs.AI2026-07被引 1

提出可校准的DiLoCo调度策略,提升共享AI基础设施的训练效率与服务延迟保障

Not Every Sync Is Safe: Calibrated DiLoCo Scheduling for Shared AI Infrastructure

  • 基于学习者进展与集群压力设计评分控制器,动态决定同步时机
  • 实测显示新策略将服务延迟违规率从6.54%降至5.09%(显著性p=0.021)
  • 强调必须用匹配随机基线验证改进,避免误导性结论

DiLoCo式训练通过局部训练与周期性全局同步降低通信开销,适用于训练与低延迟服务共用硬件的工业级AI集群。关键问题是:何时进行全局合并才值得其系统开销?选择推迟哪些训练窗口是否真有影响?现有研究常将工作负载感知策略与固定周期基线对比,却忽略了控制变量——匹配随机推迟策略(继承控制器同步预算但不可部署)。这一忽略后果严重:在受控压力测试与真实vLLM侧车回放中,匹配随机策略均能持平或超越所有无需预测的策略,说明此前报告的性能增益未必来自窗口选择。本文提出工作负载感知的DiLoCo(WA-DiLoCo),一种基于评分的控制器,结合校准协议以判断匹配随机能否被超越,并证实其可行性。在突发请求场景下,引入一阶EWMA突发预测的在线控制器,在真实vLLM侧车回放中将SLO违规率从6.54%降至5.09%(10次种子中8次显著,p=0.021);离线校准版(非可部署)进一步显示剩余提升空间至4.45%对比6.26%。可部署的核心启示是:报告真实侧车效应量迁移、无同步负载匹配及匹配随机包络后,方可宣称服务SLO改进。

原文摘要 · Abstract (English)

DiLoCo-style training reduces communication by letting learner islands train locally before occasional outer synchronization, making it attractive for fragmented industrial AI fleets where training shares hardware with latency-sensitive serving. The question for such fleets is when an outer merge is worth its system cost, and whether choosing \emph{which} windows to defer matters at all. Existing scheduling studies evaluate workload-aware policies against fixed-period baselines, but most omit the control that isolates timing from budget: matched random deferral, which inherits the controller's synchronization budget but is not itself deployable. This omission is consequential: across controlled stress tests and real vLLM sidecar replays, matched random ties or beats every forecast-free policy we test, so gains reported against weaker baselines cannot be attributed to window choice. We fill this gap with Workload-Aware DiLoCo (WA-DiLoCo), a score-based controller that weighs learner progress against fleet pressure, and a calibration protocol that determines when matched random can be beaten, then demonstrate that it can. In the bursty regime where calibration exposes request-overlap structure, adding a one-step EWMA burst forecast to the online controller beats matched random in real vLLM sidecar replay, reducing SLO violations from 6.54\% to 5.09\% (8 of 10 seeds, $p=0.021$); offline Calibrated-WA, a non-deployable bound, shows the remaining headroom at 4.45\% versus 6.26\%. The deployable lesson remains the protocol: report real-sidecar effect-size transfer, a no-sync load match, and a matched-random envelope before claiming serving-SLO improvement.

分布式训练调度优化服务延迟AI基础设施

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。