arXiv:2502.16832cs.CV2025-02中稿 · MedIA 2025被引 7

用语言模型消除联邦学习中的数据异构偏差,提升模型性能。

FedBM: Stealing Knowledge from Pre-trained Language Models for Heterogeneous Federated Learning

  • 用预训练语言模型构建类概念嵌入,生成高质量初始分类器。
  • 通过概率概念嵌入生成伪数据,校准本地特征提取器更新。
  • 适合医疗图像等数据异构场景的联邦学习,效果优于现有方法。

联邦学习在医学图像计算中展现出巨大潜力,因其能实现无隐私泄露的分布式协作训练。然而,现有研究显示,数据异构会导致客户端模型在本地训练时产生分类器和特征提取器的局部学习偏差,从而降低联邦系统性能。为此,我们提出一种新框架 FedBM,用于消除异构联邦学习中的局部学习偏差,主要包括两个模块:基于语言知识的分类器构建(LKCC)与概念引导的全局分布估计(CGDE)。具体而言,LKCC 利用类别概念、提示词和预训练语言模型(PLMs)获取概念嵌入,并在语言空间中估计每类的潜在概念分布。基于理论推导,可据此预先构建高质量分类器并冻结,避免本地训练中的分类器偏差。CGDE 从潜在概念分布中采样概率性概念嵌入,训练条件生成器以捕捉全局模型的输入空间。引入三项正则化项提升生成器质量与实用性。该生成器由所有客户端共享,生成伪数据以校准本地特征提取器的更新。在公开数据集上的大量对比实验与消融研究验证了 FedBM 在性能上优于现有最优方法,并证实各模块的有效性。代码已开源。

原文摘要 · Abstract (English)

Federated learning (FL) has shown great potential in medical image computing since it provides a decentralized learning paradigm that allows multiple clients to train a model collaboratively without privacy leakage. However, current studies have shown that data heterogeneity incurs local learning bias in classifiers and feature extractors of client models during local training, leading to the performance degradation of a federation system. To address these issues, we propose a novel framework called Federated Bias eliMinating (FedBM) to get rid of local learning bias in heterogeneous federated learning (FL), which mainly consists of two modules, i.e., Linguistic Knowledge-based Classifier Construction (LKCC) and Concept-guided Global Distribution Estimation (CGDE). Specifically, LKCC exploits class concepts, prompts and pre-trained language models (PLMs) to obtain concept embeddings. These embeddings are used to estimate the latent concept distribution of each class in the linguistic space. Based on the theoretical derivation, we can rely on these distributions to pre-construct a high-quality classifier for clients to achieve classification optimization, which is frozen to avoid classifier bias during local training. CGDE samples probabilistic concept embeddings from the latent concept distributions to learn a conditional generator to capture the input space of the global model. Three regularization terms are introduced to improve the quality and utility of the generator. The generator is shared by all clients and produces pseudo data to calibrate updates of local feature extractors. Extensive comparison experiments and ablation studies on public datasets demonstrate the superior performance of FedBM over state-of-the-arts and confirm the effectiveness of each module, respectively. The code is available at https://github.com/CUHK-AIM-Group/FedBM.

联邦学习语言模型数据异构生成对抗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。