用简单提示优化可省下95%的AI能耗,相当于14万家庭年用电量
From Caveman to Expert Analyst: Energy Consumption of Variable LLM Tasks

- 用非推理模型替代推理模型,能耗降至约1/20
- 简单提示修改最多可再降65%能耗,最高省电相当于7200户年用量
- 适合普通用户实践,低门槛减排,助力绿色AI
人工智能能源消耗增长及其环境影响引发广泛关注。本文测试了四种具有高行为可塑性的零售用户行为,评估其技术减碳潜力。研究发现,非推理模型在保持足够质量的同时,能耗仅为推理模型的约1/20,每日使用条件下可节省相当于至少141,000个美国家庭的年用电量。通过简单的提示修改,使用非推理模型还能额外降低高达65%的能耗;其中最接近基线的做法可减少4%至35%的电力需求,相当于最多7,200个美国家庭的年用电量。尽管AI进步使精准评估环境与电力影响困难,但结果表明,面向大众的低侵入性最佳实践能有效减轻AI带来的能源与环境负担。
原文摘要 · Abstract (English)
The energy demand growth and environmental impacts of artificial intelligence (AI) have generated substantial interest in supplying sufficient low-cost electricity for AI-driven data center development. Research on the ability of demand-side management to address these challenges has been more limited. Shifting the amount or timing of demand from retail, corporate, and other organizational behaviors is a plausible option but only if changes in demand-related behavior have important effects on the envi- ronmental and electricity effects of AI. This article tests four retail (i.e., consumer) user behaviors with high behavioral plasticity to assess their technical abatement potential. The research concludes that non- reasoning models provide sufficient quality while consuming close to one-twentieth of energy compared to reasoning models, saving an amount equal to the annual electricity requirement of at least 141,000 US households under daily usage assumptions. Simple prompt modifications can yield additional reduc- tions in energy consumption by up to 65% using non-reasoning models. Specifically, the practice that maintains the highest degree of similarity with the baseline reduces electricity demand in the range of 4 to 35%, an amount equal to the annual electricity requirement of up to 7,200 US households. Although AI advancements make precise estimates of environmental and electricity impacts difficult to assess, the results confirm that certain minimally intrusive best practices aimed at the majority of users can reduce the energy and environmental burdens imposed by AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。