arXiv:2512.23200cs.LG2025-12被引 1

通过有序冻结层和轻量级张量近似,提升物联网联邦学习的能效与内存效率。

Energy and Memory-Efficient Federated Learning With Ordered Layer Freezing

  • 按预设顺序冻结网络层,降低计算与内存开销。
  • 在非独立同分布数据下,精度最高提升6.27%,内存占用更低。
  • 适合资源受限设备部署,尤其适用于边缘智能场景。

联邦学习(FL)作为隐私保护范式,在物联网(IoT)分布式边缘设备上训练机器学习模型方面崭露头角。通过保持数据本地化并通过中心服务器协调模型训练,FL有效缓解了隐私问题并减少了通信开销。然而,物联网边缘设备有限的计算能力、内存和带宽对深度神经网络的高效性和可扩展性构成了显著挑战。现有多种联邦学习框架通过丢弃或层冻结来减少计算与通信开销,但常以牺牲准确率或忽略内存约束为代价。为此,本文提出具有有序层冻结的联邦学习(FedOLF)。FedOLF在训练前按预定义顺序持续冻结层,显著降低了计算与内存需求。为进一步降低通信与能耗,引入轻量级张量操作近似(TOA),作为传统量化方法的替代方案,更好地保留模型精度。实验结果表明,在非独立同分布数据下,相比现有方法,FedOLF在EMNIST(CNN)、CIFAR-10(AlexNet)、CIFAR-100(ResNet20与ResNet44)、CINIC-10(ResNet20与ResNet44)上分别实现至少0.3%、6.4%、5.81%、4.4%、6.27%和1.29%的精度提升,同时具备更高的能效与更低的内存占用。

原文摘要 · Abstract (English)

Federated Learning (FL) has emerged as a privacy-preserving paradigm for training machine learning models across distributed edge devices in the Internet of Things (IoT). By keeping data local and coordinating model training through a central server, FL effectively addresses privacy concerns and reduces communication overhead. However, the limited computational power, memory, and bandwidth of IoT edge devices pose significant challenges to the efficiency and scalability of FL, especially when training deep neural networks. Various FL frameworks have been proposed to reduce computation and communication overheads through dropout or layer freezing. However, these approaches often sacrifice accuracy or neglect memory constraints. To this end, in this work, we introduce Federated Learning with Ordered Layer Freezing (FedOLF). FedOLF consistently freezes layers in a predefined order before training, significantly mitigating computation and memory requirements. To further reduce communication and energy costs, we incorporate Tensor Operation Approximation (TOA), a lightweight alternative to conventional quantization that better preserves model accuracy. Experimental results demonstrate that over non-iid data, FedOLF achieves at least 0.3%, 6.4%, 5.81%, 4.4%, 6.27% and 1.29% higher accuracy than existing works respectively on EMNIST (with CNN), CIFAR-10 (with AlexNet), CIFAR-100 (with ResNet20 and ResNet44), and CINIC-10 (with ResNet20 and ResNet44), along with higher energy efficiency and lower memory footprint.

联邦学习边缘计算模型压缩能效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。