针对医疗影像联邦学习中的特征分布差异,提出基于流形的增强方法提升模型性能。
FedMP: Tackling Medical Feature Heterogeneity in Federated Learning from a Manifold Perspective
- 通过随机特征流形补全扩充客户端训练空间
- 利用类别原型对齐跨客户端特征流形,提升决策边界清晰度
- 在多中心医疗数据上表现优于现有方法,适合医学图像联邦建模
联邦学习(FL)是一种去中心化的机器学习范式,多个客户端在不共享本地私有数据的前提下协同训练共享模型。然而,真实应用中各客户端数据分布非独立同分布(non-IID),尤其在医学影像领域,图像特征分布差异显著影响全局模型的收敛与性能。为此,我们提出FedMP,一种面向non-IID场景的新型联邦学习方法。FedMP采用随机特征流形补全技术,丰富单个客户端分类器的训练空间,并利用类别原型在语义一致子空间内引导跨客户端特征流形对齐,促进更清晰的决策边界构建。我们在多个医学影像数据集(包括具有真实多中心分布的数据集)及一个多领域自然图像数据集上验证了FedMP的有效性。实验结果表明,该方法在多种设置下均优于现有联邦学习算法。此外,我们分析了流形维度、通信效率及特征暴露带来的隐私影响。
原文摘要 · Abstract (English)
Federated learning (FL) is a decentralized machine learning paradigm in which multiple clients collaboratively train a shared model without sharing their local private data. However, real-world applications of FL frequently encounter challenges arising from the non-identically and independently distributed (non-IID) local datasets across participating clients, which is particularly pronounced in the field of medical imaging, where shifts in image feature distributions significantly hinder the global model's convergence and performance. To address this challenge, we propose FedMP, a novel method designed to enhance FL under non-IID scenarios. FedMP employs stochastic feature manifold completion to enrich the training space of individual client classifiers, and leverages class-prototypes to guide the alignment of feature manifolds across clients within semantically consistent subspaces, facilitating the construction of more distinct decision boundaries. We validate the effectiveness of FedMP on multiple medical imaging datasets, including those with real-world multi-center distributions, as well as on a multi-domain natural image dataset. The experimental results demonstrate that FedMP outperforms existing FL algorithms. Additionally, we analyze the impact of manifold dimensionality, communication efficiency, and privacy implications of feature exposure in our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。