arXiv:2603.07373cs.NIcs.AI2026-03

提出Spectra调度算法,高效分配AI训练流量到多台光电路交换机。

Scheduling Parallel Optical Circuit Switches for AI Training

  • 将流量矩阵拆解为加权排列,分步调度并动态平衡负载。
  • 在GPT和MoE任务上使调度时长缩短1.4至1.9倍,标准测试集上缩2.4倍。
  • 适合大规模AI训练数据中心优化光网络调度,尤其关注能效与延迟。

AI训练的快速发展显著增加了数据中心的流量需求和能耗,推动了光电路交换机(OCS)作为高带宽、低功耗方案的复兴。部署多台并行OCS是主流选择,但如何在存在非可忽略重配置延迟δ的情况下,高效调度随时间变化的流量矩阵仍是一个开放挑战。本文针对单个AI流量矩阵D在s台并行OCS上的调度问题,提出Spectra算法,目标是最小化完成时间(makespan)。该算法采用三步策略:将D分解为最小数量的加权排列;基于负载感知的分配策略调度这些排列;通过受控的排列拆分均衡各交换机负载。在真实AI训练工作负载(GPT模型与Qwen MoE专家路由)及标准基准测试上评估,Spectra显著优于基于现有先进算法的基线,平均使调度完成时间分别减少1.4倍(GPT)、1.9倍(MoE)和2.4倍(标准基准)。此外,Spectra实现的完成时间持续逼近新推导的理论下界。

原文摘要 · Abstract (English)

The rapid growth of AI training has dramatically increased datacenter traffic demand and energy consumption, which has motivated renewed interest in optical circuit switches (OCSes) as a high-bandwidth, energy-efficient alternative for AI fabrics. Deploying multiple parallel OCSes is a leading alternative. However, efficiently scheduling time-varying traffic matrices across parallel optical switches with non-negligible reconfiguration delays remains an open challenge. We consider the problem of scheduling a single AI traffic demand matrix $D$ over $s$ parallel OCSes while minimizing the makespan under reconfiguration delay $δ$. Our algorithm Spectra relies on a three-step approach: Decompose $D$ into a minimal set of weighted permutations; Schedule these permutations across parallel switches using load-aware assignment; then Equalize the imbalanced loads on the switches via controlled permutation splitting. Evaluated on realistic AI training workloads (GPT model and Qwen MoE expert routing) as well as standard benchmarks, Spectra vastly outperforms a baseline based on state-of-the-art algorithms, reducing schedule makespan by an average factor of $1.4\times$ on GPT AI workloads, $1.9\times$ on MoE AI workloads, and $2.4\times$ on standard benchmarks. Further, the makespans achieved by Spectra consistently approach newly derived lower bounds.

光网络调度算法AI训练数据通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。