构建跨微瓦到兆瓦的机器学习能效评测体系,助力可持续AI发展
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI
- 提出覆盖微型设备到数据中心的全量级能效评测方法
- 采集60个系统1841组可复现数据,揭示性能与能效权衡规律
- 为边缘到云端的AI系统优化提供实证依据,适合硬件与算法设计者
机器学习技术的快速普及导致从微型物联网设备到大型数据中心集群的能耗急剧上升。评估这些系统能效至关重要,但受硬件平台多样性、工作负载特性及系统级交互影响,面临新挑战。本文提出MLPerf Power,一个涵盖微瓦至兆瓦级的全面能效评测方法,由20多家机构组成的联盟共同开发,确立规则与最佳实践以确保跨架构可比性。采用MLPerf基准套件中的代表性工作负载,收集了60个系统在全部署规模下的1841组可复现测量数据。分析揭示了性能、复杂度与能效之间的权衡关系,为从最小边缘设备到最大云基础设施的优化设计提供了可操作洞见。本研究强调能效作为关键评估指标的重要性,为未来该领域研究奠定基础,并讨论了可持续AI解决方案的发展与能效评测标准化的前景。
原文摘要 · Abstract (English)
Rapid adoption of machine learning (ML) technologies has led to a surge in power consumption across diverse systems, from tiny IoT devices to massive datacenter clusters. Benchmarking the energy efficiency of these systems is crucial for optimization, but presents novel challenges due to the variety of hardware platforms, workload characteristics, and system-level interactions. This paper introduces MLPerf Power, a comprehensive benchmarking methodology with capabilities to evaluate the energy efficiency of ML systems at power levels ranging from microwatts to megawatts. Developed by a consortium of industry professionals from more than 20 organizations, MLPerf Power establishes rules and best practices to ensure comparability across diverse architectures. We use representative workloads from the MLPerf benchmark suite to collect 1,841 reproducible measurements from 60 systems across the entire range of ML deployment scales. Our analysis reveals trade-offs between performance, complexity, and energy efficiency across this wide range of systems, providing actionable insights for designing optimized ML solutions from the smallest edge devices to the largest cloud infrastructures. This work emphasizes the importance of energy efficiency as a key metric in the evaluation and comparison of the ML system, laying the foundation for future research in this critical area. We discuss the implications for developing sustainable AI solutions and standardizing energy efficiency benchmarking for ML systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。