arXiv:2509.26534cs.AIcs.AR2025-09被引 7

为AI数据中心设计全周期降本框架,最高省40%总拥有成本。

Rearchitecting Datacenter Lifecycle for AI: A TCO-Driven Framework

  • 重构建站、换代、运营三阶段协同决策机制
  • 通过软硬件优化实现最高40%的总拥有成本降低
  • 适合云服务商和大规模AI基础设施规划者

大语言模型的迅猛发展推动了对AI推理基础设施的巨大需求,主要依赖高端GPU。这些加速器虽算力强大,但因频繁升级、高功耗与散热需求,导致资本与运营成本高昂,使人工智能数据中心的总拥有成本(TCO)成为云服务商的核心关切。然而,传统数据中心生命周期管理(针对通用负载设计)难以适应AI模型快速迭代、资源需求上升及硬件多样性等挑战。本文从建设、硬件更新和运行三个阶段重新思考AI数据中心生命周期管理,分析供电、冷却与网络配置对长期TCO的影响,探索与硬件趋势匹配的更新策略,并通过运行时软件优化降低成本。尽管各阶段优化均有成效,但只有整合全生命周期决策才能释放最大潜力。因此,我们提出一个整体式生命周期管理框架,协调并联合优化三阶段决策,综合考虑工作负载动态、硬件演进与系统老化。实验表明,该框架相比传统方法可将TCO降低最高达40%。基于此,我们为未来AI数据中心生命周期管理提供了具体指导。

原文摘要 · Abstract (English)

The rapid rise of large language models (LLMs) has been driving an enormous demand for AI inference infrastructure, mainly powered by high-end GPUs. While these accelerators offer immense computational power, they incur high capital and operational costs due to frequent upgrades, dense power consumption, and cooling demands, making total cost of ownership (TCO) for AI datacenters a critical concern for cloud providers. Unfortunately, traditional datacenter lifecycle management (designed for general-purpose workloads) struggles to keep pace with AI's fast-evolving models, rising resource needs, and diverse hardware profiles. In this paper, we rethink the AI datacenter lifecycle scheme across three stages: building, hardware refresh, and operation. We show how design choices in power, cooling, and networking provisioning impact long-term TCO. We also explore refresh strategies aligned with hardware trends. Finally, we use operation software optimizations to reduce cost. While these optimizations at each stage yield benefits, unlocking the full potential requires rethinking the entire lifecycle. Thus, we present a holistic lifecycle management framework that coordinates and co-optimizes decisions across all three stages, accounting for workload dynamics, hardware evolution, and system aging. Our system reduces the TCO by up to 40\% over traditional approaches. Using our framework we provide guidelines on how to manage AI datacenter lifecycle for the future.

数据中心成本优化AI基础设施

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。