针对分层边缘网络中的非独立同分布数据,提出个性化联邦学习框架提升各边缘节点性能。
Personalizing Federated Learning for Hierarchical Edge Networks with Non-IID Data
- 为每个边缘节点定制模型,适应其独特的标签分布。
- 相比现有方法,准确率最高提升83%,训练轮次相同条件下表现更优。
- 适合边缘设备数据异构性强的物联网场景,尤其关注跨边缘稳定性。
在分层联邦学习(HFL)中,将物联网设备与云服务器之间的边缘网络纳入考虑,可在不牺牲数据隐私的前提下提升通信效率。然而,连接至同一边缘节点的设备往往具有地理或上下文上的相似性,导致边缘层面的数据异构性——不同边缘拥有不同的标签子集,叠加设备层面的非独立同分布(non-IID)特性。这种分层非独立同分布现象意味着每个边缘应有独立优化目标,但现有研究未予重视,致使现有边缘适配型联邦学习在各类分层非独立同分布场景下表现不一致。为此,我们提出个性化分层边缘联邦学习(PHE-FL),通过为每个边缘模型进行个性化设计,使其在特定边缘的类别分布上表现更优。我们在4种不同程度边缘级非独立同分布、且设备级极端非独立同分布的场景下评估了PHE-FL。为准确评估个性化效果,测试集部署于各边缘服务器而非云服务器,并采用平衡与不平衡测试集。大量实验表明,在相同训练轮次下,PHE-FL相较现有融合边缘网络的联邦学习方法,准确率最高提升83%。此外,PHE-FL展现出更高稳定性,其准确率波动显著低于两级聚合(边缘与云)的先进方法FedAvg。
原文摘要 · Abstract (English)
Accommodating edge networks between IoT devices and the cloud server in Hierarchical Federated Learning (HFL) enhances communication efficiency without compromising data privacy. However, devices connected to the same edge often share geographic or contextual similarities, leading to varying edge-level data heterogeneity with different subsets of labels per edge, on top of device-level heterogeneity. This hierarchical non-Independent and Identically Distributed (non-IID) nature, which implies that each edge has its own optimization goal, has been overlooked in HFL research. Therefore, existing edge-accommodated HFL demonstrates inconsistent performance across edges in various hierarchical non-IID scenarios. To ensure robust performance with diverse edge-level non-IID data, we propose a Personalized Hierarchical Edge-enabled Federated Learning (PHE-FL), which personalizes each edge model to perform well on the unique class distributions specific to each edge. We evaluated PHE-FL across 4 scenarios with varying levels of edge-level non-IIDness, with extreme IoT device level non-IIDness. To accurately assess the effectiveness of our personalization approach, we deployed test sets on each edge server instead of the cloud server, and used both balanced and imbalanced test sets. Extensive experiments show that PHE-FL achieves up to 83 percent higher accuracy compared to existing federated learning approaches that incorporate edge networks, given the same number of training rounds. Moreover, PHE-FL exhibits improved stability, as evidenced by reduced accuracy fluctuations relative to the state-of-the-art FedAvg with two-level (edge and cloud) aggregation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。