通过保留源域特征提升联邦域泛化能力,效果优于直接学习目标域。
FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
- 用双适配器分离本地知识与全局共识,保护源域独特信息。
- 在四个数据集上性能超越现有方法,最高提升6.2个百分点。
- 适合需要跨域泛化的联邦学习场景,尤其源域可隔离时。
传统联邦域泛化(FedDG)方法聚焦于学习域不变特征或适应未见目标域,常忽视严格隔离环境下源域中蕴含的独特知识。实验发现,从完整源域学习的特征,其泛化能力反而优于直接从目标域学习的特征。基于此,我们提出首个系统性增强FedDG的联邦源域感知框架(FedSDAF)。FedSDAF采用双适配器架构,将“本地专长”与“全局泛化共识”解耦:本地保留的域感知适配器提取并保护各源域的判别性知识,共享的域不变适配器构建鲁棒全局共识。为实现知识交换,引入双向知识蒸馏机制,促进适配器间高效对话。在OfficeHome、PACS、VLCS和DomainNet四个基准数据集上的大量实验表明,FedSDAF显著优于现有FedDG方法。源代码已开源:https://github.com/pizzareapers/FedSDAF。
原文摘要 · Abstract (English)
Traditional Federated Domain Generalization (FedDG) methods focus on learning domain-invariant features or adapting to unseen target domains, often overlooking the unique knowledge embedded within the source domain, especially in strictly isolated federated learning environments. Through experimentation, we discovered a counterintuitive phenomenon: features learned from a complete source domain have superior generalization capabilities compared to those learned directly from the target domain. This insight leads us to propose the Federated Source Domain Awareness Framework (FedSDAF), the first systematic approach to enhance FedDG by leveraging source domain-aware features. FedSDAF employs a dual-adapter architecture that decouples "local expertise" from "global generalization consensus." A Domain-Aware Adapter, retained locally, extracts and protects the unique discriminative knowledge of each source domain, while a Domain-Invariant Adapter, shared across clients, builds a robust global consensus. To enable knowledge exchange, we introduce a Bidirectional Knowledge Distillation mechanism that facilitates efficient dialogue between the adapters. Extensive experiments on four benchmark datasets (OfficeHome, PACS, VLCS, and DomainNet) show that FedSDAF significantly outperforms existing FedDG methods. The source code is available at https://github.com/pizzareapers/FedSDAF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。