提出去中心化异步联邦学习方法,支持不同模型结构的客户端协同训练。
FedPAE: Peer-Adaptive Ensemble Learning for Asynchronous and Model-Heterogeneous Federated Learning
- 采用点对点共享与集成选择机制,实现去中心化协作。
- 在异构数据和设备条件下性能优于现有主流个性化联邦学习方法。
- 适合资源差异大、无法同步的分布式场景,如移动边缘计算。
联邦学习(FL)使分布于不同客户端的数据源能在不泄露隐私的前提下协同训练共享模型。然而,现有联邦学习范式受限于客户端数据分布和系统能力的异质性。个性化联邦学习(pFL)虽能缓解此问题,但通常依赖统一模型架构和中心化聚合,导致可扩展性和通信瓶颈。近期模型异构的联邦学习受到关注,但现有方法仍依赖中心化框架、同步训练和公开数据集。为此,我们提出去中心化个性化联邦学习算法FedPAE,支持模型异构与异步学习。该方法通过点对点模型共享和集成选择,更精细地平衡局部与全局信息。实验表明,FedPAE在多样客户端能力下表现优异,对统计异质性具有强鲁棒性,优于现有最先进pFL方法。
原文摘要 · Abstract (English)
Federated learning (FL) enables multiple clients with distributed data sources to collaboratively train a shared model without compromising data privacy. However, existing FL paradigms face challenges due to heterogeneity in client data distributions and system capabilities. Personalized federated learning (pFL) has been proposed to mitigate these problems, but often requires a shared model architecture and a central entity for parameter aggregation, resulting in scalability and communication issues. More recently, model-heterogeneous FL has gained attention due to its ability to support diverse client models, but existing methods are limited by their dependence on a centralized framework, synchronized training, and publicly available datasets. To address these limitations, we introduce Federated Peer-Adaptive Ensemble Learning (FedPAE), a fully decentralized pFL algorithm that supports model heterogeneity and asynchronous learning. Our approach utilizes a peer-to-peer model sharing mechanism and ensemble selection to achieve a more refined balance between local and global information. Experimental results show that FedPAE outperforms existing state-of-the-art pFL algorithms, effectively managing diverse client capabilities and demonstrating robustness against statistical heterogeneity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。