arXiv:2605.13981cs.LGcs.AI2026-05中稿 · ICML被引 1

为大模型蒸馏全流程做能耗审计,揭示隐藏的电力成本

Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines

论文配图:Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines
图 1 · 摘自论文原文
  • 逐阶段追踪GPU功耗,量化蒸馏全链路真实能耗
  • 发现教师模型生成数据等环节耗能占主导,远超预期
  • 提供开源工具和标准协议,助力绿色模型研发

大型语言模型部署激增导致GPU需求和数据中心规模扩张,引发对电力消耗、电网压力及现代AI工作负载影响的担忧。尽管蒸馏常被视为获得更廉价高效模型的有效路径,但此类主张极少涵盖包括数据生成、对数概率缓存和评估在内的完整端到端能源与资源成本。本文提出一个全面的能源核算框架,通过细粒度阶段追踪GPU设备功耗,测量蒸馏流水线的全部计算成本。实验中,我们分离并记录不同阶段的实际能耗,系统评估两种常见蒸馏方法——基于对数概率的知识蒸馏与合成数据监督微调的能源与碳排放,构建能源-质量帕累托前沿,揭示此前被忽略的成本。基于这些测量与分析,我们得出在能源与预算约束下选择蒸馏方法及超参数的实用设计准则,并发布开源测量工具包与核算协议,为可比较、可复现的蒸馏研究提供标准化基础,明确问责整个流水线的能源影响。

原文摘要 · Abstract (English)

The rise in deployment of large language models has driven a surge in GPU demand and datacenter scaling, raising concerns about electricity use, grid stress, and the impacts of modern AI workloads. Distillation is often promoted as one of the most effective paths to obtain cheaper, more efficient models, yet these claims rarely account for the full end-to-end energy and resource costs, including crucial teacher-side workloads such as data generation, logit caching, and evaluation. We present a comprehensive energy accounting framework that measures the complete computational cost of distillation pipelines via detailed stage-wise tracking of GPU device power consumption. In our experiments, we separate and log empirical energy use across distinct phases and systematically measure the energy and emissions of two common distillation methods: the classic logit-based knowledge distillation and synthetic-data supervised fine-tuning, constructing energy-quality Pareto frontiers that expose the previously ignored costs. From these measurements and analyses, we derive practical design rules for selecting distillation methods and hyperparameters under energy and budget constraints, and release an open-source measurement harness and accounting protocol to provide a standardized foundation for comparable, reproducible distillation research, explicitly accountable for complete pipeline energy impact.

能耗审计模型蒸馏绿色AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。