解决跨模态医疗图像分割中的联邦学习难题,提升模型泛化能力。
Adversarial Versus Federated: An Adversarial Learning based Multi-Modality Cross-Domain Federated Medical Segmentation
- 通过客户端间特征级对抗学习对齐多模态特征图。
- 在三个数据集上实现跨域联邦聚合,性能优于现有算法。
- 适合医疗图像分割中存在模态差异的场景使用。
联邦学习在保护数据隐私的前提下实现多方协作建模,成为破解医疗数据孤岛的主流方案。然而,医疗资源不均、数据损坏或保存不当可能导致不同客户端拥有不同模态的医学影像,这种异质性给联邦学习框架下的跨域医学图像分割带来重大挑战。为此,本文提出一种基于对抗学习的联邦域适应(FedDA)分割训练框架。具体而言,通过在客户端间嵌入对抗训练机制,对齐各客户端的特征图,实现特征层面的对抗学习。该设计增强了模型在多域环境下的泛化能力,缓解了域偏移带来的负面影响。在三个医学图像数据集上的综合实验表明,所提出的FedDA能有效实现跨域联邦聚合,使仅具备单一模态数据的客户端也具备处理多模态的能力,并在客观与主观评估中持续表现稳健,优于当前最优的联邦聚合算法。代码已开源:https://github.com/GGbond-study/FedDA。
原文摘要 · Abstract (English)
Federated learning enables collaborative training of machine learning models among different clients while ensuring data privacy, emerging as the mainstream for breaking data silos in the healthcare domain. However, the imbalance of medical resources, data corruption or improper data preservation may lead to a situation where different clients possess medical images of different modality. This heterogeneity poses a significant challenge for cross-domain medical image segmentation within the federated learning framework. To address this challenge, we propose a new Federated Domain Adaptation (FedDA) segmentation training framework. Specifically, we propose a feature-level adversarial learning among clients by aligning feature maps across clients through embedding an adversarial training mechanism. This design can enhance the model's generalization on multiple domains and alleviate the negative impact from domain-shift. Comprehensive experiments on three medical image datasets demonstrate that our proposed FedDA substantially achieves cross-domain federated aggregation, endowing single modality client with cross-modality processing capabilities, and consistently delivers robust performance compared to state-of-the-art federated aggregation algorithms in objective and subjective assessment. Our code are available at https://github.com/GGbond-study/FedDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。