arXiv:2412.06210cs.LG2024-12被引 4

H-FedSN通过稀疏网络和个性化结构,大幅降低物联网联邦学习通信开销。

H-FedSN: Personalized Sparse Networks for Efficient and Accurate Hierarchical Federated Learning for IoT Applications

  • 用二值掩码生成稀疏网络,不改变原始权重减少通信量
  • 在非独立同分布数据下,通信成本降低477倍且保持高精度
  • 适合资源受限的物联网设备,尤其适用于多层级异构场景

随着物联网快速发展,联邦学习因其保护隐私的分布式数据使用特性受到关注。然而,传统两层联邦学习架构难以适配真实物联网系统的分层异构特性。分层联邦学习引入多层聚合以更好匹配物联网环境,但仍面临通信效率低、性能受限等问题,源于大规模数据传输、非独立同分布数据分布及设备参与不均。为此,本文提出H-FedSN,用于实际物联网场景。该方法利用共享与个性化层的二值掩码机制,在不改变原始权重的前提下构建稀疏网络,显著降低通信开销。为应对数据异构与设备分布不均问题,引入个性化层进行本地数据适应,并在边缘与云端采用基于累积贝塔分布更新的贝叶斯聚合策略,有效平衡不同客户端群体的贡献。在三个真实物联网数据集和MNIST上的实验表明,相比基线方法,H-FedSN通信成本最高可降低477倍,同时保持高精度,适用于物联网中的分层联邦学习部署。

原文摘要 · Abstract (English)

With the rapid development of the Internet of Things (IoT), federated learning (FL) has gained increasing attention for its privacy-preserving use of distributed data. However, conventional two-tier FL architectures are poorly suited to the hierarchical and heterogeneous nature of real-world IoT systems. Hierarchical Federated Learning (HFL) introduces multi-layer aggregation to better match IoT environments, but still suffers from communication inefficiencies and performance limitations caused by large data transfers, non-IID data distributions, and uneven device participation. These challenges hinder the realization of low-latency and high-accuracy training in practical IoT deployments. To address these limitations, we propose H-FedSN for practical IoT environments. H-FedSN leverages a binary mask mechanism with shared and personalized layers to reduce communication overhead by creating a sparse network without altering original weights. To tackle data heterogeneity and imbalanced device distribution, H-FedSN incorporates personalized layers for local data adaptation and employs Bayesian aggregation with cumulative Beta distribution updates at edge and cloud levels, effectively balancing contributions from diverse client groups. Experiments on three real-world IoT datasets and MNIST under non-IID conditions show that H-FedSN reduces communication costs by up to 477 times compared to baseline methods while maintaining high accuracy, making it well-suited for hierarchical FL in IoT deployments.

联邦学习物联网稀疏网络通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。