arXiv:2604.07345eess.SYcs.DC2026-04被引 11

首次以0.1秒精度测量生成式AI算力的能耗,助力数据中心规划。

Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning

论文配图:Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning
图 1 · 摘自论文原文
  • 通过高精度测量生成式AI任务的实时功耗,建立细粒度能耗数据。
  • 构建基于事件的底层模型,将局部功耗扩展至整栋数据中心能效。
  • 公开数据集支持电网接入、微电网等基础设施的精准设计。

生成式人工智能的快速发展带来了前所未有的计算需求,显著增加了数据中心的能耗足迹。然而,现有能耗数据多为专有且报告分辨率不一,难以估算整设施能耗并指导基础设施规划。本文提出一种方法,将高分辨率工作负载功耗测量与整设施能源需求相连接。利用配备NVIDIA H100 GPU的NLR高性能计算数据中心,我们在0.1秒分辨率下测量了AI训练、微调和推理任务的功耗。工作负载采用MLCommons基准(训练与微调)及vLLM基准(推理),确保可复现与标准化。所获功耗数据集已公开。随后,通过自下而上的事件驱动数据中心能效模型,将这些功耗曲线扩展至整设施层级。生成的整设施能效曲线真实反映了由AI任务和用户行为驱动的时间波动,可用于支持电网连接、本地能源生成和分布式微电网的规划。

原文摘要 · Abstract (English)

The rapid growth of generative artificial intelligence (AI) has introduced unprecedented computational demands, driving significant increases in the energy footprint of data centers. However, existing power consumption data is largely proprietary and reported at varying resolutions, creating challenges for estimating whole-facility energy use and planning infrastructure. In this work, we present a methodology that bridges this gap by linking high-resolution workload power measurements to whole-facility energy demand. Using NLR's high-performance computing data center equipped with NVIDIA H100 GPUs, we measure power consumption of AI workloads at 0.1-second resolution for AI training, fine-tuning and inference jobs. Workloads are characterized using MLCommons benchmarks for model training and fine-tuning, and vLLM benchmarks for inference, enabling reproducible and standardized workload profiling. The dataset of power consumption profiles is made publicly available. These power profiles are then scaled to the whole-facility-level using a bottom-up, event-driven, data center energy model. The resulting whole-facility energy profiles capture realistic temporal fluctuations driven by AI workloads and user-behavior, and can be used to inform infrastructure planning for grid connection, on-site energy generation, and distributed microgrids.

AI能耗数据中心功耗测量能源规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。