用特征代理提升能量采集联邦学习调度效率
Feature-Based Semantics-Aware Scheduling for Energy-Harvesting Federated Learning
- 基于中间层特征构建轻量代理,高效估算模型冗余
- 在极端非独立同分布数据下实现能耗降低同时保持性能
- 适合资源受限设备上训练成本主导通信的场景
边缘设备上的联邦学习面临关键挑战:深度神经网络训练的计算能耗常远超通信开销。然而,现有能量采集联邦学习策略大多忽略此现实,导致因冗余本地计算而浪费能源。为实现高效主动的资源管理,需设计能预测本地更新贡献的算法。本文提出一种轻量级客户端调度框架,利用语义感知指标——信息版本年龄(VAoI),量化更新的时效性与重要性。关键在于,我们克服了传统VAoI计算复杂度高的问题——其需对整个参数空间进行统计距离计算——通过引入基于特征的代理,仅通过一次前向传播提取中间层特征即可估计模型冗余,大幅降低计算开销。在极端非独立同分布数据分布和能源极度稀缺条件下进行实验,结果表明本框架在显著降低能耗的同时,仍保持优于现有基线选择策略的学习性能。该框架确立了语义感知调度在真实场景中训练成本主导传输成本时的实用性和必要性。
原文摘要 · Abstract (English)
Federated Learning (FL) on resource-constrained edge devices faces a critical challenge: The computational energy required for training Deep Neural Networks (DNNs) often dominates communication costs. However, most existing Energy-Harvesting FL (EHFL) strategies fail to account for this reality, resulting in wasted energy due to redundant local computations. For efficient and proactive resource management, algorithms that predict local update contributions must be devised. We propose a lightweight client scheduling framework using the Version Age of Information (VAoI), a semantics-aware metric that quantifies update timeliness and significance. Crucially, we overcome VAoI's typical prohibitive computational cost, which requires statistical distance over the entire parameter space, by introducing a feature-based proxy. This proxy estimates model redundancy using intermediate-layer extraction from a single forward pass, dramatically reducing computational complexity. Experiments conducted under extreme non-IID data distributions and scarce energy availability demonstrate superior learning performance while achieving energy reduction compared to existing baseline selection policies. Our framework establishes semantics-aware scheduling as a practical and vital solution for EHFL in realistic scenarios where training costs dominate transmission costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。