解决设备异构与掉线问题,让每个设备自动生成个性化模型。
Asynchronous Personalized Federated Learning through Global Memorization
- 用服务器生成虚拟数据补全缺失样本,提升数据多样性。
- 在真实场景中比现有方法准确率更高,抗掉线能力更强。
- 适合边缘计算、隐私敏感的物联网应用。
物联网设备普及与通信技术进步带来了海量个人数据,加剧了在GDPR和CCPA等严格法规下的隐私担忧。联邦学习通过在分布式设备上协同训练模型而无需集中数据,提供了隐私保护方案。然而,非独立同分布(non-IID)数据带来的统计异质性,以及因客户端掉线(尤其是垄断类别客户端)导致的系统异质性,严重损害全局模型性能。为此,我们提出异步个性化联邦学习框架(AP FL),使客户端利用服务器侧语义生成器构建个性化模型。该生成器通过无数据知识迁移,在全局模型监督下训练,可生成已见与未见样本,后者借助零样本学习缓解掉线导致的数据损失。为防止合成数据干扰训练,引入解耦模型插值方法,确保个性化稳健性。大量实验表明,AP FL显著优于当前最先进联邦学习方法,在应对非IID分布和客户端掉线方面表现出更优准确率与鲁棒性,适用于多样化的现实场景。
原文摘要 · Abstract (English)
The proliferation of Internet of Things devices and advances in communication technology have unleashed an explosion of personal data, amplifying privacy concerns amid stringent regulations like GDPR and CCPA. Federated Learning offers a privacy preserving solution by enabling collaborative model training across decentralized devices without centralizing sensitive data. However, statistical heterogeneity from non-independent and identically distributed datasets and system heterogeneity due to client dropouts particularly those with monopolistic classes severely degrade the global model's performance. To address these challenges, we propose the Asynchronous Personalized Federated Learning framework, which empowers clients to develop personalized models using a server side semantic generator. This generator, trained via data free knowledge transfer under global model supervision, enhances client data diversity by producing both seen and unseen samples, the latter enabled by Zero-Shot Learning to mitigate dropout-induced data loss. To counter the risks of synthetic data impairing training, we introduce a decoupled model interpolation method, ensuring robust personalization. Extensive experiments demonstrate that AP FL significantly outperforms state of the art FL methods in tackling non-IID distributions and client dropouts, achieving superior accuracy and resilience across diverse real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。