arXiv:2412.11674cs.LGcs.AI2024-12被引 2

提出一种自适应个性化去中心化联邦学习框架,解决数据分布不均问题。

UA-PDFL: A Personalized Approach for Decentralized Federated Learning

  • 通过单元表示动态调节个性化层级,适应不同数据偏移程度。
  • 引入客户端级丢弃与层级个性化,提升去中心化学习性能。
  • 适合数据异构性强的分布式场景,如医疗、金融等隐私敏感领域。

联邦学习(FL)是一种保护隐私的机器学习范式,可在不泄露数据的前提下协同训练全局模型。传统FL系统中,中央服务器仅作为协调者,周期性聚合各客户端本地模型,易造成单点传输瓶颈和安全风险。为此,去中心化联邦学习(DFL)被提出,使所有客户端通过点对点通信协作,无需中央服务器。然而,由于客户端数据非独立同分布(non-IID),DFL仍面临训练性能下降的问题。将个性化模块引入DFL是缓解non-IID负面影响的有效方法。本文提出一种新型单元表示辅助的个性化去中心化联邦学习框架(UA-PDFL),通过单元表示引导自适应调整个性化层级,有效应对不同程度的数据偏移。在此基础上,提出客户端级丢弃与层间个性化策略,进一步提升DFL学习效果。大量实验验证了该方法的有效性。

原文摘要 · Abstract (English)

Federated learning (FL) is a privacy preserving machine learning paradigm designed to collaboratively learn a global model without data leakage. Specifically, in a typical FL system, the central server solely functions as an coordinator to iteratively aggregate the collected local models trained by each client, potentially introducing single-point transmission bottleneck and security threats. To mitigate this issue, decentralized federated learning (DFL) has been proposed, where all participating clients engage in peer-to-peer communication without a central server. Nonetheless, DFL still suffers from training degradation as FL does due to the non-independent and identically distributed (non-IID) nature of client data. And incorporating personalization layers into DFL may be the most effective solutions to alleviate the side effects caused by non-IID data. Therefore, in this paper, we propose a novel unit representation aided personalized decentralized federated learning framework, named UA-PDFL, to deal with the non-IID challenge in DFL. By adaptively adjusting the level of personalization layers through the guidance of the unit representation, UA-PDFL is able to address the varying degrees of data skew. Based on this scheme, client-wise dropout and layer-wise personalization are proposed to further enhance the learning performance of DFL. Extensive experiments empirically prove the effectiveness of our proposed method.

联邦学习去中心化个性化数据异构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。