arXiv:2608.15310cs.CRcs.LG2026-08中稿 · appear in Proceedi…

提出双分支框架缓解联邦学习中的遗忘问题。

FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting

论文配图:FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting
图 1 · 摘自论文原文
  • 用可微的类别锚点提供全局监督,平衡全局一致性与本地优化。
  • 在多个医学和自然数据集上,准确率与收敛速度均有显著提升。
  • 适合存在数据异构、需避免知识遗忘的医疗等场景应用。

异构设备收集的多模态数据用于协同训练,联邦学习(FL)是保护数据隐私的分布式建模关键范式。然而,在客户端数据异构下,本地训练易遗忘先前学到的全局知识,导致性能和收敛速度显著下降。以往研究依赖全局对齐策略保留全局知识,但阻碍了本地优化,并对缺失类别监督不足。部分研究引入代理数据集补充监督,但如何在无代理数据情况下平衡类别级全局一致性与本地优化仍具挑战。本文提出 FedADB,一种类锚驱动的双分支联邦学习框架。服务器在可微输入空间中生成类锚,并共享给各客户端。这些类锚作为全局参考,在本地训练中为缺失类别提供监督。设计双分支协作训练机制:基于类锚的全局分支关注全局一致性,通过类锚平衡采样实现知识对齐;本地校准分支聚焦学习判别性局部特征,缓解过度全局对齐导致的表示退化。在多个医学和自然数据集上的大量实验表明,FedADB 在准确率和收敛速度方面均有显著提升。

原文摘要 · Abstract (English)

Multimodal data collected by heterogeneous devices are used for collaborative training, where federated learning (FL) serves as a key paradigm for effective distributed modeling with data privacy preservation. However, local training suffers from the forgetting of previously learned global knowledge under cross-client data heterogeneity, which leads to significant declines in both performance and convergence speed. Most previous studies rely on global alignment strategies to retain global knowledge, which hinder local optimization and lead to inadequate supervision of missing classes. Some studies introduce proxy datasets to supplement supervision for missing classes. However, it remains a challenge to balance class-wise global consistency and local optimization objectives without proxy datasets. In this work, we propose FedADB, a Class Anchor-Driven Dual-Branch FL framework. Specifically, the server generates class anchors optimized in a differentiable input space, which are shared across clients. These class anchors serve as global references that provide supervision for missing classes during local training. A dual-branch collaborative training mechanism is designed for clients. In this mechanism, the anchor-based global branch focuses on learning with global consistency, achieving global knowledge alignment by class-anchor balanced sampling. The local calibration branch focuses on learning discriminative local features, mitigating the degradation of local representations caused by excessive global alignment. Extensive experiments across multiple medical and natural datasets demonstrate that FedADB achieves significant improvements in both accuracy and convergence speed.

联邦学习知识遗忘双分支类锚

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。