FedGIN通过动态强度增强,实现多模态医学图像分割的隐私保护协同训练。
FedGIN: Federated Learning with Dynamic Global Intensity Non-linear Augmentation for Organ Segmentation using Multi-modal Images
- 引入轻量级非线性全局强度增强模块,统一不同模态图像的亮度分布。
- 在有限数据下,MRI测试集Dice提升12%-18%;全数据下接近集中式训练效果。
- 适合医疗数据隐私敏感场景,尤其适用于跨模态(如MRI/CT)协同建模。
医学图像分割在辅助诊断、手术规划和治疗监测中至关重要。准确可靠的分割模型对跨多种成像模态的数据驱动临床决策至关重要。由于模态间图像特征存在固有差异,开发能有效泛化到多模态的统一模型极具价值。然而,实际部署面临数据稀缺、模态间域偏移(如CT vs. MRI)以及隐私限制导致的数据无法共享等问题。为此,我们提出FedGIN,一种无需共享原始患者数据的联邦学习框架,实现多模态器官分割。该方法集成轻量级全局强度非线性(GIN)增强模块,在本地训练中统一模态特异性强度分布。我们在两种数据集上评估:插补数据集与完整数据集。在数据受限场景中,模型初始仅用MRI训练,再加入CT数据以评估性能提升;在完整数据场景中,所有客户端均使用完整MRI与CT数据训练。在有限数据场景下,FedGIN在MRI测试集上3D Dice分数较无GIN的联邦学习提升12至18%,且持续优于本地基线。在完整数据场景下,其表现接近集中式训练,相较于仅用MRI的基线提升30%,相较仅用CT的基线提升10%,凸显其在隐私约束下的强跨模态泛化能力。
原文摘要 · Abstract (English)
Medical image segmentation plays a crucial role in AI-assisted diagnostics, surgical planning, and treatment monitoring. Accurate and robust segmentation models are essential for enabling reliable, data-driven clinical decision making across diverse imaging modalities. Given the inherent variability in image characteristics across modalities, developing a unified model capable of generalizing effectively to multiple modalities would be highly beneficial. This model could streamline clinical workflows and reduce the need for modality-specific training. However, real-world deployment faces major challenges, including data scarcity, domain shift between modalities (e.g., CT vs. MRI), and privacy restrictions that prevent data sharing. To address these issues, we propose FedGIN, a Federated Learning (FL) framework that enables multimodal organ segmentation without sharing raw patient data. Our method integrates a lightweight Global Intensity Non-linear (GIN) augmentation module that harmonizes modality-specific intensity distributions during local training. We evaluated FedGIN using two types of datasets: an imputed dataset and a complete dataset. In the limited dataset scenario, the model was initially trained using only MRI data, and CT data was added to assess its performance improvements. In the complete dataset scenario, both MRI and CT data were fully utilized for training on all clients. In the limited-data scenario, FedGIN achieved a 12 to 18% improvement in 3D Dice scores on MRI test cases compared to FL without GIN and consistently outperformed local baselines. In the complete dataset scenario, FedGIN demonstrated near-centralized performance, with a 30% Dice score improvement over the MRI-only baseline and a 10% improvement over the CT-only baseline, highlighting its strong cross-modality generalization under privacy constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。