提出可解释的能效模型,精准优化大模型推理能耗。
EnergyLens: Interpretable Closed-Form Energy Models for Multimodal LLM Inference Serving

- 用符号回归构建12参数封闭形式能效模型,解耦并行与推理阶段能量贡献。
- 仅需50次采样即达88.2%能效配置选择准确率,优于前人方法27.3个百分点。
- 模型物理可解释,适用于多硬件、多批次场景,适合部署优化人员使用。
随着大语言模型采用密集、专家混合和状态空间等多种架构,并在异构加速器上运行多样化的多模态负载,优化推理能耗已与降低延迟和提升吞吐量同等重要。现有方法或以延迟为能耗代理,或依赖数据密集型黑箱替代模型,但在不同并行策略下均表现不佳:我们测试中超过20%配置下延迟与能耗最优解不一致;而黑箱模型需数百次采样才能跨模型家族和硬件泛化。本文提出EnergyLens,利用符号回归从采样数据中发现结构,构建一个基于系统参数(如并行度、批大小、序列长度)的单一封闭形式能效模型。不同于黑箱替代模型,EnergyLens可分离张量并行与流水线并行的能量贡献,区分预填充与解码阶段能耗,使预测具备物理可解释性与可操作性。仅需50次采样即可训练,其在多种评估场景下达到88.2%的Top-1配置选择准确率,显著优于最接近的解析基线(60.9%),且预测精度媲美集成机器学习方法,但只需十分之一采样量。该模型无需结构调整即可可靠外推至未见批大小与硬件平台,是一种实用且可解释的能源最优大模型部署工具。
原文摘要 · Abstract (English)
As large language models span dense, mixture-of-experts, and state-space architectures and are deployed on heterogeneous accelerators under increasingly diverse multimodal workloads, optimising inference energy has become as critical as optimizing latency and throughput. Existing approaches either treat latency as an energy proxy or rely on data-hungry black-box surrogates. Both fail under varying parallelism strategies: latency and energy optima diverge in over 20% of configurations we tested, and black-box surrogates require hundreds of profiling samples to generalize across model families and hardware. We present EnergyLens, which uses symbolic regression as a structure-discovery tool over profiling data to derive a single twelve-parameter closed-form energy model expressed in terms of system properties such as degree of parallelism, batch size, and sequence length. Unlike black-box surrogates, EnergyLens decouples tensor and pipeline parallelism contributions and separates prefill from decode energy, making its predictions physically interpretable and actionable. Fitted from as few as 50 profiling measurements, EnergyLens achieves 88.2% Top-1 configuration selection accuracy across many evaluation scenarios compared to 60.9% for the closest prior analytical baseline, matches the predictive accuracy of ensemble ML methods with 10x fewer profiling samples, and extrapolates reliably to unseen batch sizes and hardware platforms without structural modification, making it a practical, interpretable tool for energy-optimal LLM deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。