arXiv:2410.11855cs.DCcs.AI2024-10被引 2

实时优化超算GPU能耗,兼顾省电与性能不下降。

Online GPU Energy Optimization with Switching-Aware Bandits

  • 用多臂赌博机模型动态调节GPU频率,边学边调。
  • 实测节能显著,性能损耗小,且可设性能底线。
  • 适合追求能效比的高性能计算系统运维者。

能源消耗已成为从可穿戴设备到顶级超算等未来计算架构的瓶颈。现有能源管理技术多针对CPU,而实际在异构高性能计算(HPC)系统中,GPU已主导功耗。此外,多数先前方法依赖纯离线或混合离线/在线训练,不切实际且数据收集阶段易造成能效浪费。本文提出一种面向真实HPC场景的在线GPU能耗优化问题。该问题具有挑战性:(1)GPU频率调节存在性能-能耗权衡;(2)在线控制需平衡探索与利用;(3)频繁频率切换引入显著开销并降低服务质量(QoS)。为应对挑战,我们将问题建模为多臂赌博机问题,提出EnergyUCB——一种轻量级基于UCB的控制器,可实时动态调整GPU核心频率以节省能耗。具体而言,EnergyUCB(1)定义了融合能量与性能的奖励函数,使用核心与非核心利用率比值作为GPU吞吐量代理;(2)采用乐观初始化和UCB风格置信度奖励,加速从零开始的学习;(3)引入切换感知的UCB索引及带QoS约束的变体,明确设定减速预算并抑制不必要的频率振荡。在世界第三快超算Aurora的真实工作负载上进行的大量实验表明,EnergyUCB实现了显著的能耗节省,仅带来适度的延迟增加;其带QoS约束的版本能可靠遵守用户指定的性能预算。

原文摘要 · Abstract (English)

Energy consumption has become a bottleneck for future computing architectures, from wearable devices to leadership-class supercomputers. Existing energy management techniques largely target CPUs, even though GPUs now dominate power draw in heterogeneous high performance computing (HPC) systems. Moreover, many prior methods rely on either purely offline or hybrid offline and online training, which is impractical and results in energy inefficiencies during data collection. In this paper, we introduce a practical online GPU energy optimization problem in a HPC scenarios. The problem is challenging because (1) GPU frequency scaling exhibits performance-energy trade-offs, (2) online control must balance exploration and exploitation, and (3) frequent frequency switching incurs non-trivial overhead and degrades quality of service (QoS). To address the challenges, we formulate online GPU energy optimization as a multi-armed bandit problem and propose EnergyUCB, a lightweight UCB-based controller that dynamically adjusts GPU core frequency in real time to save energy. Specifically, EnergyUCB (1) defines a reward that jointly captures energy and performance using a core-to-uncore utilization ratio as a proxy for GPU throughput, (2) employs optimistic initialization and UCB-style confidence bonuses to accelerate learning from scratch, and (3) incorporates a switching-aware UCB index and a QoS-constrained variant that enforce explicit slowdown budgets while discouraging unnecessary frequency oscillations. Extensive experiments on real-world workloads from the world's third fastest supercomputer Aurora show that EnergyUCB achieves substantial energy savings with modest slowdown and that the QoS-constrained variant reliably respects user-specified performance budgets.

GPU节能在线优化能效比超算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。