解决联邦学习中的领域偏移问题,让模型更懂不同数据来源的差异。
FedDAP: Domain-Aware Prototype Learning for Federated Learning under Domain Shift
- 按领域分组聚合原型,构建专属领域特征模板。
- 本地特征与同域原型对齐,跨域原型强制分离,提升泛化能力。
- 适用于多领域数据分布不一的隐私保护场景,如医疗、金融。
联邦学习(FL)可在不暴露私有数据的前提下实现跨客户端的分布式模型训练,适用于隐私敏感场景。然而在真实场景中,各客户端数据来自不同领域,导致严重领域偏移,损害全局模型性能。原型学习作为解决方案,利用类别级特征表示。但现有方法存在两大缺陷:(1) 通常通过聚合所有客户端的局部原型构建单一全局原型,未保留领域信息;(2) 特征与原型的对齐机制为领域无关,迫使客户端无差别地对齐全局原型。为此,我们提出联邦领域感知原型学习(FedDAP),通过相似性加权融合机制,在相同领域内聚合本地原型,构建领域特定的全局原型。这些原型用于引导本地训练,使本地特征与同域原型对齐,同时与异域原型分离。双重对齐增强了本地领域的特定学习能力,并使全局模型具备跨领域泛化能力。我们在DomainNet、Office-10和PACS三个数据集上进行了大量实验,验证了该框架在应对领域偏移方面的有效性。代码已公开于https://github.com/quanghuy6997/FedDAP。
原文摘要 · Abstract (English)
Federated Learning (FL) enables decentralized model training across multiple clients without exposing private data, making it ideal for privacy-sensitive applications. However, in real-world FL scenarios, clients often hold data from distinct domains, leading to severe domain shift and degraded global model performance. To address this, prototype learning has been emerged as a promising solution, which leverages class-wise feature representations. Yet, existing methods face two key limitations: (1) Existing prototype-based FL methods typically construct a $\textit{single global prototype}$ per class by aggregating local prototypes from all clients without preserving domain information. (2) Current feature-prototype alignment is $\textit{domain-agnostic}$, forcing clients to align with global prototypes regardless of domain origin. To address these challenges, we propose Federated Domain-Aware Prototypes (FedDAP) to construct domain-specific global prototypes by aggregating local client prototypes within the same domain using a similarity-weighted fusion mechanism. These global domain-specific prototypes are then used to guide local training by aligning local features with prototypes from the same domain, while encouraging separation from prototypes of different domains. This dual alignment enhances domain-specific learning at the local level and enables the global model to generalize across diverse domains. Finally, we conduct extensive experiments on three different datasets: DomainNet, Office-10, and PACS to demonstrate the effectiveness of our proposed framework to address the domain shift challenges. The code is available at https://github.com/quanghuy6997/FedDAP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。