在隐私保护下实现跨模态医学图像的少样本分割,首次将自监督学习引入联邦场景。
Federated Self-Supervised Learning for One-Shot Cross-Modal and Cross-Imaging Technique Segmentation
- 基于自监督框架CoWPro构建联邦学习方法,支持多模态数据协同训练。
- 引入融合Dice损失提升性能,在未见数据上优于基准模型。
- 适用于医疗数据分散、标注稀缺的场景,适合医学影像研究者使用。
去中心化的联邦学习可在不泄露客户端隐私的前提下,从多个数据源中学习数据表征。在医学图像分割领域,单一来源获取大规模标注数据极为困难,联邦自监督学习为此提供了可行路径。本文进一步探索了更严苛的数据稀缺场景——联邦自监督的一次性少样本分割任务。我们采用现有自监督少样本分割框架CoWPro,并将其适配至联邦学习环境。据我们所知,这是首个尝试在联邦学习中进行自监督少样本分割的工作。同时,客户端数据来自不同模态和成像技术(如MR或CT),使问题更具挑战性。此外,通过引入融合Dice损失对基线CoWPro进行强化与改进,显著提升了性能。最后,在完全未见过的客户端数据上进行评估,结果表明该框架在保留验证集上的表现与甚至优于其联邦平均(FedAvg)版本的CoWPro。
原文摘要 · Abstract (English)
Decentralized federated learning enables learning of data representations from multiple sources without compromising the privacy of the clients. In applications like medical image segmentation, where obtaining a large annotated dataset from a single source is a distressing problem, federated self-supervised learning can provide some solace. In this work, we push the limits further by exploring a federated self-supervised one-shot segmentation task representing a more data-scarce scenario. We adopt a pre-existing self-supervised few-shot segmentation framework CoWPro and adapt it to the federated learning scenario. To the best of our knowledge, this work is the first to attempt a self-supervised few-shot segmentation task in the federated learning domain. Moreover, we consider the clients to be constituted of data from different modalities and imaging techniques like MR or CT, which makes the problem even harder. Additionally, we reinforce and improve the baseline CoWPro method using a fused dice loss which shows considerable improvement in performance over the baseline CoWPro. Finally, we evaluate this novel framework on a completely unseen held-out part of the local client dataset. We observe that the proposed framework can achieve performance at par or better than the FedAvg version of the CoWPro framework on the held-out validation dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。