arXiv:2504.00277cs.AIcs.DC2025-04中稿 · The International …

用强化学习优化数据中心机架布局,提升效率与容错能力。

Rack Position Optimization in Large-Scale Heterogeneous Data Centers

  • 分两层优化:高层用深度强化学习决定机架类型顺序,底层用梯度启发式搜索位置。
  • 比传统优化器快近400倍,成功率100%,且在复杂场景下稳定高效。
  • 适合超大规模异构数据中心运维,对故障容忍和资源调度有显著提升。

随着AI算力需求激增,新硬件部署与维护对数据中心资源管理提出更高要求。本文提出一种新型两层优化框架,通过高层深度强化学习(DRL)模型指导低层基于梯度的启发式方法进行局部搜索,实现机架类型排序与位置映射的协同优化。高层采用领导奖励机制(Leader Reward)优化机架类型顺序,底层则最小化移动次数并保障容错性资源分布。该方法可扩展至超过10万位置和100种机架类型。实验表明,相比梯度启发式方法平均提升7%性能,优于混合整数规划(MIP)求解器30%以上目标值;在20分钟时限内,成功率100%(MIP为97.5%),仅需2分钟完成,而MIP耗时1630分钟(约4个数量级提升)。与依赖时间约束的MIP不同,本方法在高惩罚条件下仍保持稳定高效,适用于大规模异构数据中心动态管理。

原文摘要 · Abstract (English)

As rapidly growing AI computational demands accelerate the need for new hardware installation and maintenance, this work explores optimal data center resource management by balancing operational efficiency with fault tolerance through strategic rack positioning considering diverse resources and locations. Traditional mixed-integer programming (MIP) approaches often struggle with scalability, while heuristic methods may result in significant sub-optimality. To address these issues, this paper presents a novel two-tier optimization framework using a high-level deep reinforcement learning (DRL) model to guide a low-level gradient-based heuristic for local search. The high-level DRL agent employs Leader Reward for optimal rack type ordering, and the low-level heuristic efficiently maps racks to positions, minimizing movement counts and ensuring fault-tolerant resource distribution. This approach allows scalability to over 100,000 positions and 100 rack types. Our method outperformed the gradient-based heuristic by 7\% on average and the MIP solver by over 30\% in objective value. It achieved a 100\% success rate versus MIP's 97.5\% (within a 20-minute limit), completing in just 2 minutes compared to MIP's 1630 minutes (i.e., almost 4 orders of magnitude improvement). Unlike the MIP solver, which showed performance variability under time constraints and high penalties, our algorithm consistently delivered stable, efficient results - an essential feature for large-scale data center management.

数据中心优化强化学习资源调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。