谷歌测量了生成式AI服务的碳足迹,发现单次文本请求耗电仅0.24瓦时。
Measuring the environmental impact of delivering AI at Google Scale
- 全面监测谷歌生成式AI服务全栈能耗,包含加速器、主机与数据中心
- 一年内能效提升33倍,碳排放降低44倍,单次请求耗电低于9秒电视
- 为行业提供可复用的环境影响评估方法,适合关注可持续AI的研发者
人工智能的变革力毋庸置疑,但随着用户规模增长,其服务环节的环境影响亟需量化与缓解。然而,此前尚无研究在真实生产环境中测量过AI服务的能源消耗、碳排放和用水量。本文提出并实施了一套完整的方法论,对谷歌大规模生产环境中的AI推理工作负载进行能量使用、碳排放和水耗的测量。该方法覆盖了从主动AI加速器功耗、主机系统能耗、空闲机位容量到数据中心整体能耗的全栈基础设施。通过对谷歌Gemini AI助手服务架构的详细仪器化,我们发现:单次Gemini Apps文本提示平均耗电0.24瓦时,远低于多数公开估算值。此外,得益于谷歌软件效率优化和清洁电力采购,该指标在一年内实现33倍能效提升,碳足迹下降44倍。单次请求耗电量相当于观看9秒电视,用水量约等于5滴水(0.26毫升)。尽管与日常活动相比影响较小,但持续优化仍具重要意义。为此,我们主张建立对AI服务环境指标的全面测量体系,以准确比较模型性能,并有效激励全栈效率改进。
原文摘要 · Abstract (English)
The transformative power of AI is undeniable - but as user adoption accelerates, so does the need to understand and mitigate the environmental impact of AI serving. However, no studies have measured AI serving environmental metrics in a production environment. This paper addresses this gap by proposing and executing a comprehensive methodology for measuring the energy usage, carbon emissions, and water consumption of AI inference workloads in a large-scale, AI production environment. Our approach accounts for the full stack of AI serving infrastructure - including active AI accelerator power, host system energy, idle machine capacity, and data center energy overhead. Through detailed instrumentation of Google's AI infrastructure for serving the Gemini AI assistant, we find the median Gemini Apps text prompt consumes 0.24 Wh of energy - a figure substantially lower than many public estimates. We also show that Google's software efficiency efforts and clean energy procurement have driven a 33x reduction in energy consumption and a 44x reduction in carbon footprint for the median Gemini Apps text prompt over one year. We identify that the median Gemini Apps text prompt uses less energy than watching nine seconds of television (0.24 Wh) and consumes the equivalent of five drops of water (0.26 mL). While these impacts are low compared to other daily activities, reducing the environmental impact of AI serving continues to warrant important attention. Towards this objective, we propose that a comprehensive measurement of AI serving environmental metrics is critical for accurately comparing models, and to properly incentivize efficiency gains across the full AI serving stack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。