arXiv:2501.08521cs.LGcs.AI2025-01被引 2

提出I²PFL方法,同时利用域内和域间原型缓解联邦学习中的数据分布差异。

Mitigating Domain Shift in Federated Learning via Intra- and Inter-Domain Prototypes

  • 融合域内与域间原型,双视角应对数据分布不均问题。
  • 在Digits、Office-10和PACS数据集上显著优于现有基线方法。
  • 适合处理多客户端异构数据场景的联邦学习应用。

联邦学习(FL)是一种去中心化机器学习技术,使客户端可在不共享私有数据的情况下协同训练全局模型。然而,大多数联邦学习研究忽略了真实场景中常见的异构域问题——每个客户端具有不同的特征分布。原型学习通过利用同一类别内的均值特征向量,成为应对联邦学习中域偏移的主流方案。然而,现有方法仅关注域间原型,忽视了域内特征多样性。本文提出一种新型联邦原型学习方法I²PFL,结合域内与域间原型,从双重角度缓解域偏移,学习跨多个域的通用全局模型。为构建域内原型,提出基于MixUp增强的特征对齐策略,捕捉本地域内的特征多样性,提升局部特征泛化能力;同时引入域间原型重加权机制,生成能降低域偏移且跨客户端传递知识的通用原型。在Digits、Office-10和PACS数据集上的大量实验表明,该方法性能显著优于其他基线。

原文摘要 · Abstract (English)

Federated Learning (FL) has emerged as a decentralized machine learning technique, allowing clients to train a global model collaboratively without sharing private data. However, most FL studies ignore the crucial challenge of heterogeneous domains where each client has a distinct feature distribution, which is popular in real-world scenarios. Prototype learning, which leverages the mean feature vectors within the same classes, has become a prominent solution for federated learning under domain shift. However, existing federated prototype learning methods focus soley on inter-domain prototypes and neglect intra-domain perspectives. In this work, we introduce a novel federated prototype learning method, namely I$^2$PFL, which incorporates $\textbf{I}$ntra-domain and $\textbf{I}$nter-domain $\textbf{P}$rototypes, to mitigate domain shift from both perspectives and learn a generalized global model across multiple domains in federated learning. To construct intra-domain prototypes, we propose feature alignment with MixUp-based augmented prototypes to capture the diversity within local domains and enhance the generalization of local features. Additionally, we introduce a reweighting mechanism for inter-domain prototypes to generate generalized prototypes that reduce domain shift while providing inter-domain knowledge across multiple clients. Extensive experiments on the Digits, Office-10, and PACS datasets illustrate the superior performance of our method compared to other baselines.

联邦学习原型学习域偏移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。