arXiv:2409.18340eess.IVcs.AI2024-09被引 6

通过解耦表征学习实现跨模态医学图像分割,无需标注即可提升精度。

DRL-STNet: Unsupervised Domain Adaptation for Cross-modality Medical Image Segmentation via Disentangled Representation Learning

  • 利用GAN与解耦表征学习将源模态图像转换为目标模态
  • 在FLARE数据集上Dice系数达74.21%,超越当前最优方法11.4%
  • 适合缺乏标注的医疗影像跨模态分割场景使用

无监督域自适应(UDA)对于跨模态医学图像分割至关重要。该方法旨在将带标签的源域知识迁移至无标签的目标域,从而降低对大量人工标注的依赖。本文提出DRL-STNet,一种基于生成对抗网络(GAN)、解耦表征学习(DRL)和自训练(ST)的新型跨模态医学图像分割框架。通过在GAN中引入DRL,将源域图像转换为目标模态;随后用合成的转换图像及对应源标签训练分割模型,并结合伪标签与真实标签迭代微调。在FLARE挑战数据集上的腹部器官分割任务中,该方法在Dice相似性系数上达到74.21%,超出现有最优方法11.4%;在归一化表面Dice指标上达到80.69%,提升13.1%。平均运行时间为41秒,GPU内存-时间曲线下面积为11,292 MB。结果表明DRL-STNet在跨模态医学图像分割中具有显著潜力。

原文摘要 · Abstract (English)

Unsupervised domain adaptation (UDA) is essential for medical image segmentation, especially in cross-modality data scenarios. UDA aims to transfer knowledge from a labeled source domain to an unlabeled target domain, thereby reducing the dependency on extensive manual annotations. This paper presents DRL-STNet, a novel framework for cross-modality medical image segmentation that leverages generative adversarial networks (GANs), disentangled representation learning (DRL), and self-training (ST). Our method leverages DRL within a GAN to translate images from the source to the target modality. Then, the segmentation model is initially trained with these translated images and corresponding source labels and then fine-tuned iteratively using a combination of synthetic and real images with pseudo-labels and real labels. The proposed framework exhibits superior performance in abdominal organ segmentation on the FLARE challenge dataset, surpassing state-of-the-art methods by 11.4% in the Dice similarity coefficient and by 13.1% in the Normalized Surface Dice metric, achieving scores of 74.21% and 80.69%, respectively. The average running time is 41 seconds, and the area under the GPU memory-time curve is 11,292 MB. These results indicate the potential of DRL-STNet for enhancing cross-modality medical image segmentation tasks.

医学图像跨模态分割无监督学习解耦表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。