arXiv:2603.14238cs.LGcs.MM2026-03中稿 · CVPR

解决联邦学习中跨域数据偏移问题,提升模型泛化能力。

Domain-Skewed Federated Learning with Feature Decoupling and Calibration

  • 通过特征解耦与校准,分离并修正客户端的领域特异性特征。
  • 在三个多域数据集上显著提升模型性能,尤其改善跨域泛化效果。
  • 适合关注隐私保护下多场景模型部署的研究者与工程师。

联邦学习(FL)允许多个客户端在保护隐私的前提下协同训练全局模型。然而,主要挑战之一是领域偏移:不同客户端的数据来自异构领域,导致聚合后的全局模型难以学习一致的表示空间,从而降低在多个领域中的泛化能力。本文认为,领域偏移体现在各客户端的领域特异性偏差特征上,致使局部模型表示坍缩至低维窄子空间。为此,提出联邦特征解耦与校准(F²DC),通过校准领域相关特征,释放关键类别信息,实现跨领域的更一致表示。F²DC引入新颖的领域特征解耦器(DFD),评估每个特征单元的鲁棒性,将局部特征划分为领域鲁棒特征与领域相关特征;进一步提出领域特征校正器(DFC),显式关联判别信号,捕获补充的类别相关信息,以增强领域鲁棒特征。最后,采用领域感知的本地模型聚合策略促进客户端间共识。在三个主流多域数据集上的实证结果验证了F²DC的有效性及其两个模块的贡献。代码已开源:https://github.com/mala-lab/F2DC。

原文摘要 · Abstract (English)

Federated learning (FL) allows distributed clients to collaboratively train a global model in a privacy-preserving manner. However, one major challenge is domain skew, where clients' data originating from diverse domains may hinder the aggregated global model from learning a consistent representation space, resulting in poor generalizable ability in multiple domains. In this paper, we argue that the domain skew is reflected in the domain-specific biased features of each client, causing the local model's representations to collapse into a narrow low-dimensional subspace. We then propose Federated Feature Decoupling and Calibration ($F^2$DC), which liberates valuable class-relevant information by calibrating the domain-specific biased features, enabling more consistent representations across domains. A novel component, Domain Feature Decoupler (DFD), is first introduced in $F^2$DC to determine the robustness of each feature unit, thereby separating the local features into domain-robust features and domain-related features. A Domain Feature Corrector (DFC) is further proposed to calibrate these domain-related features by explicitly linking discriminative signals, capturing additional class-relevant clues that complement the domain-robust features. Finally, a domain-aware aggregation of the local models is performed to promote consensus among clients. Empirical results on three popular multi-domain datasets demonstrate the effectiveness of the proposed $F^2$DC and the contributions of its two modules. Code is available at https://github.com/mala-lab/F2DC.

联邦学习特征解耦跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。