arXiv:2410.22622cs.LGcs.CV2024-10被引 1

解决联邦学习中跨域数据分布差异与隐私泄露问题,提升模型在未知领域表现。

PARDON: Privacy-Aware and Robust Federated Domain Generalization

  • 通过提取局部风格的插值特征和对比学习,实现多域表征与无偏收敛。
  • 在PACS、Office-Home等数据集上,未见域准确率提升3.64%至57.22%。
  • 适合存在数据异构与隐私敏感的现实联邦学习场景。

联邦学习(FL)在保护隐私和实现协作学习方面具有潜力,但当前多数方法仅针对单一领域数据。当客户端数据来自不同领域(即领域偏移)时,模型在未见领域上表现不佳。现有联邦域泛化方法虽解决此问题,但假设每个客户端拥有完整领域的数据,限制了其在真实场景中的实用性。此外,部分方法允许客户端间信息共享,可能引发隐私泄露风险。为此,我们提出FISC,一种新型联邦域泛化范式,能够稳健应对客户端间更复杂的领域分布,并确保安全性。FISC通过从本地风格中提取插值风格并结合对比学习,使客户端获得多域表示与无偏收敛目标。在PACS、Office-Home和IWildCam等多个数据集上的实验证明,该方法优于当前最优(SOTA)方法,在未见领域上准确率提升达3.64%至57.22%。代码已开源:https://github.com/judydnguyen/PARDON-FedDG。

原文摘要 · Abstract (English)

Federated Learning (FL) shows promise in preserving privacy and enabling collaborative learning. However, most current solutions focus on private data collected from a single domain. A significant challenge arises when client data comes from diverse domains (i.e., domain shift), leading to poor performance on unseen domains. Existing Federated Domain Generalization approaches address this problem but assume each client holds data for an entire domain, limiting their practicality in real-world scenarios with domain-based heterogeneity and client sampling. In addition, certain methods enable information sharing among clients, raising privacy concerns as this information could be used to reconstruct sensitive private data. To overcome this, we introduce FISC, a novel FedDG paradigm designed to robustly handle more complicated domain distributions between clients while ensuring security. FISC enables learning across domains by extracting an interpolative style from local styles and employing contrastive learning. This strategy gives clients multi-domain representations and unbiased convergent targets. Empirical results on multiple datasets, including PACS, Office-Home, and IWildCam, show FISC outperforms state-of-the-art (SOTA) methods. Our method achieves accuracy on unseen domains, with improvements ranging from 3.64% to 57.22% on unseen domains. Our code is available at https://github.com/judydnguyen/PARDON-FedDG.

联邦学习域泛化隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。