解决联邦学习中个性化与全局性能的矛盾,提升异构数据下的模型表现。
Separate Aggregation of Split Network for Personalized Federated Learning

- 拆分网络结构,按组件动态调度聚合策略,平衡共享与本地适配。
- 在多个数据集上超越现有方法,异构环境下收敛稳定且个性化更强。
- 结合真实与合成特征,增强标签不平衡和缺失类别场景的鲁棒性。
联邦学习可在不共享原始数据的前提下实现协作训练,但客户端数据分布异构时性能显著下降。单一全局模型难以满足多样化客户端需求,因此个性化联邦学习被提出以提升本地性能同时保持全局泛化能力。现有PFL方法常面临根本性权衡:强全局共享会削弱局部特化,而强本地适应又易在数据有限、标签不平衡及类别缺失情况下过拟合。本文提出PGFedSplit框架,在严重异构环境下同时提升个性化与全局泛化能力。该方法采用拆分架构,针对不同模型组件进行自适应聚合调度,实现稳定知识共享与客户端特化并存。每个客户端融合本地提取表征与服务器端基于高斯统计生成的合成表征,增强了在标签不平衡与类别缺失条件下的鲁棒性。在Fashion MNIST、CIFAR 10、CIFAR 100和Tiny ImageNet上的大量实验表明,该方法持续优于当前最优PFL方法,具有稳定的收敛性和更优的个性化表现。
原文摘要 · Abstract (English)
Federated learning enables collaborative model training without sharing raw data, but its performance can degrade substantially under heterogeneous client data distributions. A single global model often cannot satisfy diverse client requirements, so personalized federated learning has therefore been explored to improve client specific performance while preserving global generalization. Existing PFL methods often face a fundamental tradeoff in which stronger global sharing can undermine local specialization, whereas stronger local adaptation can lead to overfitting under limited data, label imbalance, and missing class scenarios. In this work, we propose PGFedSplit, a personalized federated learning framework that improves both personalization and global generalization under severe client heterogeneity. PGFedSplit adopts a split architecture and performs adaptive aggregation scheduling tailored to the roles of different model components, enabling stable knowledge sharing while maintaining client specific adaptation. Each client further leverages a mixture of locally extracted representations and synthetic representations generated from server side Gaussian statistics, improving robustness under label imbalance and missing class conditions. Extensive experiments on Fashion MNIST, CIFAR 10, CIFAR 100, and Tiny ImageNet demonstrate consistent improvements over state of the art PFL methods, with stable convergence and superior personalization in highly heterogeneous settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。