arXiv:2508.08339cs.LG2025-08被引 2

将表征学习融入分层联邦学习,显著降低通信开销与设备负担。

SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learning

  • 在边缘层和云端分阶段计算,实现客户端与服务器独立训练
  • 相比中心化联邦学习减少90%以上数据传输量
  • 适合资源受限设备部署,尤其适用于医疗图像等场景

联邦学习(FL)通过不共享原始数据实现协同模型训练,缓解大规模网络中的可扩展性与延迟问题。然而,现有框架常忽略边缘设备的计算异构性及资源受限设备的训练压力。尽管已有工作结合分层联邦学习(HierFL)与分拆学习(SL)以减轻设备端计算负载并提升可扩展性,但跨层级协调仍带来复杂性。为此,我们提出SHeRL-FL,将分拆学习与分层模型聚合相结合,并在中间层引入表征学习。该方法使客户端与边缘服务器可独立计算训练目标,显著降低协调复杂度与通信开销。我们在图像分类任务中使用CIFAR-10、CIFAR-100、HAM10000数据集,搭配AlexNet、ResNet-18、ResNet-50,在IID与非IID设置下进行实验;同时在图像分割任务中,使用ISIC-2018数据集,基于ResNet-50构建的U-Net进行评估。结果表明,相较于集中式联邦学习和分层联邦学习,SHeRL-FL的数据传输量减少超过90%,相比SplitFed(FL与SL的混合方法)减少50%,进一步提升了分层分拆学习的性能。

原文摘要 · Abstract (English)

Federated learning (FL) is a promising approach for addressing scalability and latency issues in large-scale networks by enabling collaborative model training without requiring the sharing of raw data. However, existing FL frameworks often overlook the computational heterogeneity of edge clients and the growing training burden on resource-limited devices. However, FL suffers from high communication costs and complex model aggregation, especially with large models. Previous works combine split learning (SL) and hierarchical FL (HierFL) to reduce device-side computation and improve scalability, but this introduces training complexity due to coordination across tiers. To address these issues, we propose SHeRL-FL, which integrates SL and hierarchical model aggregation and incorporates representation learning at intermediate layers. By allowing clients and edge servers to compute training objectives independently of the cloud, SHeRL-FL significantly reduces both coordination complexity and communication overhead. To evaluate the effectiveness and efficiency of SHeRL-FL, we performed experiments on image classification tasks using CIFAR-10, CIFAR-100, and HAM10000 with AlexNet, ResNet-18, and ResNet-50 in both IID and non-IID settings. In addition, we evaluate performance on image segmentation tasks using the ISIC-2018 dataset with a ResNet-50-based U-Net. Experimental results demonstrate that SHeRL-FL reduces data transmission by over 90\% compared to centralized FL and HierFL, and by 50\% compared to SplitFed, which is a hybrid of FL and SL, and further improves hierarchical split learning methods.

联邦学习分拆学习边缘计算表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。