arXiv:2410.20102cs.CV2024-10中稿 · NeurIPS

用3D风格迁移降低联邦学习通信成本,提升多器官分割效果

Anatomical 3D Style Transfer Enabling Efficient Federated Learning with Extremely Low Communication Costs

  • 基于器官位置聚类3D风格,融合解剖结构信息
  • 通信成本仅1.25%时仍保持高精度,全局Dice提升4.3%
  • 适合低带宽、隐私敏感的医疗联邦学习场景

本研究提出一种新型联邦学习(FL)方法,用于多器官分割任务。通过整合多个数据集构建的多器官数据集具有高可扩展性,随数据量增加可提升泛化性能。然而,不同客户端因成像条件和目标器官差异导致的数据异质性,易引发本地模型过拟合。现有方法需频繁与中心服务器通信以对齐模型,造成高通信开销和隐私泄露风险。为此,我们提出解剖学3D频域泛化(A3DFDG)方法。该方法利用人体器官结构信息,基于器官位置对3D风格进行聚类,并据此混合风格,既保留解剖信息,又使模型学习器官内多样性,实现各本地模型优化对齐。实验表明,该方法在通信成本极低(仅为原始成本的1.25%)时仍能保持准确率,相比基线显著提升,全局骰子相似系数提高4.3%。尽管方法简单、计算开销极小,但其在低通信成本与简易流程需求的现实场景中展现出高度实用性。项目代码将公开。

原文摘要 · Abstract (English)

In this study, we propose a novel federated learning (FL) approach that utilizes 3D style transfer for the multi-organ segmentation task. The multi-organ dataset, obtained by integrating multiple datasets, has high scalability and can improve generalization performance as the data volume increases. However, the heterogeneity of data owing to different clients with diverse imaging conditions and target organs can lead to severe overfitting of local models. To align models that overfit to different local datasets, existing methods require frequent communication with the central server, resulting in higher communication costs and risk of privacy leakage. To achieve an efficient and safe FL, we propose an Anatomical 3D Frequency Domain Generalization (A3DFDG) method for FL. A3DFDG utilizes structural information of human organs and clusters the 3D styles based on the location of organs. By mixing styles based on these clusters, it preserves the anatomical information and leads models to learn intra-organ diversity, while aligning the optimization of each local model. Experiments indicate that our method can maintain its accuracy even in cases where the communication cost is highly limited (=1.25% of the original cost) while achieving a significant difference compared to baselines, with a higher global dice similarity coefficient score of 4.3%. Despite its simplicity and minimal computational overhead, these results demonstrate that our method has high practicality in real-world scenarios where low communication costs and a simple pipeline are required. The code used in this project will be publicly available.

联邦学习3D风格迁移医疗影像低通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。