arXiv:2603.21908cs.LG2026-03

根据算子稀疏性精细调节频率,显著降低边缘设备推理能耗。

SparseDVFS: Sparse-Aware DVFS for Energy-Efficient Edge Inference

  • 依据算子稀疏度动态分配CPU/GPU/EMC三频,实现细粒度能效优化。
  • 相比现有方案平均节能78.17%,且成本增益比仅上升14%。
  • 适合追求极致能效的边缘AI部署,尤其适用于稀疏模型推理。

在功耗敏感的边缘设备上部署深度神经网络(DNN)面临严峻挑战。尽管动态电压频率调节(DVFS)被广泛用于能效优化,但传统模型级调节过于粗略,无法捕捉推理过程中的内部变化;而细粒度算子级调节又因显著的硬件切换延迟导致性能严重下降。本文提出SparseDVFS,一种面向边缘推理的细粒度、稀疏感知型DVFS框架。核心洞察是:算子稀疏度是硬件频率调节的关键指标。通过区分计算密集型稠密算子与内存密集型稀疏算子,系统可为每类算子配置专用的频率三元组以最大化能效。为克服切换开销与组件干扰,SparseDVFS引入三项关键创新:(1) 离线建模器,基于白盒时间线分析建立算子稀疏度与最优频率三元组之间的确定性映射;(2) 运行时图分区器,采用贪心合并启发式方法将算子聚合成超块,在调节粒度与DVFS切换延迟间取得平衡,满足延迟摊销约束;(3) 统一协同控制器,利用频率统一缩放引擎(FUSE)与前瞻指令队列,消除独立控制器间的冲突效应并隐藏硬件切换延迟。大量实验表明,SparseDVFS相比现有最优方案平均提升78.17%能效,同时保持14%的成本增益比。

原文摘要 · Abstract (English)

Deploying deep neural networks (DNNs) on power-sensitive edge devices presents a formidable challenge. While Dynamic Voltage and Frequency Scaling (DVFS) is widely employed for energy optimization, traditional model-level scaling is often too coarse to capture intra-inference variations, whereas fine-grained operator-level scaling suffers from prohibitive performance degradation due to significant hardware switching latency. This paper presents SparseDVFS, a fine-grained, sparse-aware DVFS framework designed for energy-efficient edge inference. Our key insight is that operator sparsity is a primary metric for hardware frequency modulation. By distinguishing between compute-bound dense operators and memory-bound sparse operators, the system can apply specialized frequency triplets to maximize energy efficiency. To overcome switching overheads and component interference, SparseDVFS incorporates three key innovations: (1) an offline modeler that established a deterministic mapping between operator sparsity and optimal frequency triplets (CPU/GPU/EMC) via white-box timeline analysis; (2) a runtime graph partitioner that utilizes a greedy merging heuristic to aggregate operators into super-blocks, balancing scaling granularity and DVFS switching latency through a latency amortization constraint; and (3) a unified co-governor that employs a frequency unified scaling engine (FUSE) and a look-ahead instruction queue to eliminate antagonistic effects between independent controllers and hide hardware transition latencies. Extensive evaluations show that SparseDVFS achieves an average 78.17% energy efficiency gain over state-of-the-art solutions while maintaining a superior 14% cost-gain ratio.

边缘计算能效优化稀疏性感知DVFS

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。