arXiv:2412.17484cs.DCcs.AI2024-12被引 6

优化GPU数据中心调度,兼顾节能与资源利用率。

Power- and Fragmentation-aware Online Scheduling for GPU Datacenters

  • 提出PWR调度策略,优选低功耗的GPU-CPU组合。
  • 结合FGD策略,使碎片率降低23%,功耗减少18%。
  • 适合关注绿色计算与高负载资源管理的工程师。

人工智能与大语言模型的发展推动了数据中心对GPU的大量使用,带来高昂运营成本、能源消耗和环境影响。本文研究GPU数据中心的在线调度问题,即在未知未来任务到达的情况下进行调度。聚焦两个目标:减少GPU碎片化和降低能耗。碎片化发生在部分分配导致剩余资源无法高效利用时,尤其在接近满载时更严重。现有方案如片段梯度下降(FGD)通过碎片度量缓解该问题。为降低功耗,本文提出PWR调度策略,通过简化功率模型并集成至Kubernetes评分插件,智能选择低功耗的GPU-CPU组合。在模拟集群上的大规模实验表明,将PWR与FGD结合后,可在降低18%功耗的同时,将碎片率降低23%,实现能效与资源利用率的平衡。

原文摘要 · Abstract (English)

The rise of Artificial Intelligence and Large Language Models is driving increased GPU usage in data centers for complex training and inference tasks, impacting operational costs, energy demands, and the environmental footprint of large-scale computing infrastructures. This work addresses the online scheduling problem in GPU datacenters, which involves scheduling tasks without knowledge of their future arrivals. We focus on two objectives: minimizing GPU fragmentation and reducing power consumption. GPU fragmentation occurs when partial GPU allocations hinder the efficient use of remaining resources, especially as the datacenter nears full capacity. A recent scheduling policy, Fragmentation Gradient Descent (FGD), leverages a fragmentation metric to address this issue. Reducing power consumption is also crucial due to the significant power demands of GPUs. To this end, we propose PWR, a novel scheduling policy to minimize power usage by selecting power-efficient GPU and CPU combinations. This involves a simplified model for measuring power consumption integrated into a Kubernetes score plugin. Through an extensive experimental evaluation in a simulated cluster, we show how PWR, when combined with FGD, achieves a balanced trade-off between reducing power consumption and minimizing GPU fragmentation.

GPU调度节能计算资源碎片

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。