用梯度匹配构建全局语义原型,提升联邦学习的泛化能力
FedHPro: Federated Hyper-Prototype Learning via Gradient Matching

- 引入超原型,通过梯度匹配对齐客户端真实样本特征
- 在多个数据集上达到当前最优性能,有效缓解语义漂移
- 适合异构数据下的联邦学习场景,尤其关注分类一致性
联邦学习(FL)可在保护隐私的前提下实现分布式协作训练。为提升联邦学习的泛化能力,基于原型的方法受到关注,因为共享的全局原型可作为对齐客户端局部原型的语义锚点。然而,现有方法通常通过平均或优化局部原型来更新全局原型,常导致客户端间语义漂移,进而产生错误的全局信号。为此,我们提出超原型(hyper-prototypes),即一组可学习的全局类别原型,用于保留跨客户端的底层语义知识。超原型通过梯度匹配进行优化,使其与客户端真实样本中提取的类别相关特征对齐,而非依赖原型级描述符。我们进一步提出FedHPro框架,利用超原型通过带有客户端特定边距的互对比学习增强类间可分性,并通过一致性惩罚促进类内统一性。在多种异构场景下的全面实验表明:1)超原型生成更语义一致的全局信号;2)FedHPro在多个基准数据集上达到最先进的性能。代码已公开于 https://github.com/mala-lab/FedHPro。
原文摘要 · Abstract (English)
Federated Learning (FL) enables collaborative training of distributed clients while protecting privacy. To enhance generalization capability in FL, prototype-based FL is in the spotlight, since shared global prototypes offer semantic anchors for aligning client-specific local prototypes. However, existing methods update global prototypes at the prototype-level via averaging local prototypes or refining global anchors, which often leads to semantic drift across clients and subsequently yields a misaligned global signal. To alleviate this issue, we introduce hyper-prototypes, defined by a set of learnable global class-wise prototypes to preserve underlying semantic knowledge across clients. The hyper-prototypes are optimized via gradient matching to align with class-relevant characteristics distilled directly from clients' real samples, rather than prototype-level descriptors. We further propose FedHPro, a Federated Hyper-Prototype Learning framework, to leverage hyper-prototypes to promote inter-class separability via mutual-contrastive learning with client-specific margin, while encouraging intra-class uniformity through a consistency penalty. Comprehensive experiments under diverse heterogeneous scenarios confirm that 1) hyper-prototypes produce a more semantically consistent global signal, and 2) FedHPro achieves state-of-the-art performance on several benchmark datasets. Code is available at \href{https://github.com/mala-lab/FedHPro}{https://github.com/mala-lab/FedHPro}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。