解决联邦学习中全局泛化与本地适应的精细平衡问题
FedeCouple: Fine-Grained Balancing of Global-Generalization and Local-Adaptability in Federated Learning
- 通过动态知识蒸馏和锚点机制协同优化全局与局部特征
- 在5个数据集上比最优基线提升4.3%,且收敛性有理论保障
- 适合隐私敏感、客户端数据异构的移动端场景
在隐私保护的异构客户端数据联邦学习场景中,解耦特征提取器与分类器的个性化方法虽能提升学习能力,但多数现有方法仅关注特征空间一致性与分类个性化,忽视提取器的本地适应性与分类器的全局泛化性,导致组件间协调不足、耦合弱,影响整体性能。为此,我们提出FedeCouple,一种在细粒度层面平衡全局泛化与本地适应性的联邦学习方法。该方法联合学习全局与局部特征表示,并采用动态知识蒸馏增强个性化分类器的泛化能力;引入锚点以精炼特征空间,其严格局部性与不传输特性天然保障隐私并降低通信开销。此外,我们提供了理论分析,证明FedeCouple对非凸目标可收敛,迭代过程随通信轮次增加趋近于驻点。在五个图像分类数据集上的大量实验表明,FedeCouple在有效性、稳定性、可扩展性和安全性方面均持续优于九种基线方法,其中有效性评估中超越最佳基线达4.3%。
原文摘要 · Abstract (English)
In privacy-preserving mobile network transmission scenarios with heterogeneous client data, personalized federated learning methods that decouple feature extractors and classifiers have demonstrated notable advantages in enhancing learning capability. However, many existing approaches primarily focus on feature space consistency and classification personalization during local training, often neglecting the local adaptability of the extractor and the global generalization of the classifier. This oversight results in insufficient coordination and weak coupling between the components, ultimately degrading the overall model performance. To address this challenge, we propose FedeCouple, a federated learning method that balances global generalization and local adaptability at a fine-grained level. Our approach jointly learns global and local feature representations while employing dynamic knowledge distillation to enhance the generalization of personalized classifiers. We further introduce anchors to refine the feature space; their strict locality and non-transmission inherently preserve privacy and reduce communication overhead. Furthermore, we provide a theoretical analysis proving that FedeCouple converges for nonconvex objectives, with iterates approaching a stationary point as the number of communication rounds increases. Extensive experiments conducted on five image-classification datasets demonstrate that FedeCouple consistently outperforms nine baseline methods in effectiveness, stability, scalability, and security. Notably, in experiments evaluating effectiveness, FedeCouple surpasses the best baseline by a significant margin of 4.3%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。