arXiv:2502.15193cs.CV2025-02被引 3

用图像转换实现无监督跨模态医学图像分割,提升不同设备数据的适用性。

Image Translation-Based Unsupervised Cross-Modality Domain Adaptation for Medical Image Segmentation

  • 通过图像翻译将带标注源模态转为无标注目标模态
  • 在跨模态分割任务上达0.8351的Dice系数和1.6712的平均距离
  • 适合缺乏标注但存在设备差异的医学影像研究者

监督深度学习在医学图像上面临挑战,因标注需医生专业知识,成本高且耗时。部分研究转向无监督方法,但性能常下降。此外,医学图像常来自不同中心、设备及采集协议,模态差异(域偏移)也限制了模型泛化能力。为此,本文提出一种基于图像翻译的无监督跨模态域适应方法:将带标注的源模态图像转换为目标模态,并利用其标注实现目标模态的监督学习。通过自训练机制缓解翻译伪像与真实图像间的细微差异,进一步提升性能。在crossMoDA 2022挑战赛验证集上,该方法在前庭神经鞘瘤(VS)分割任务中取得0.8351±0.1152的平均骰子相似系数(DSC)和1.6712±2.1948的平均对称表面距离(ASSD),在耳蜗分割任务中达0.8098±0.0233的DSC和0.2317±0.1577的ASSD。

原文摘要 · Abstract (English)

Supervised deep learning usually faces more challenges in medical images than in natural images. Since annotations in medical images require the expertise of doctors and are more time-consuming and expensive. Thus, some researchers turn to unsupervised learning methods, which usually face inevitable performance drops. In addition, medical images may have been acquired at different medical centers with different scanners and under different image acquisition protocols, so the modalities of the medical images are often inconsistent. This modality difference (domain shift) also reduces the applicability of deep learning methods. In this regard, we propose an unsupervised crossmodality domain adaptation method based on image translation by transforming the source modality image with annotation into the unannotated target modality and using its annotation to achieve supervised learning of the target modality. In addition, the subtle differences between translated pseudo images and real images are overcome by self-training methods to further improve the task performance of deep learning. The proposed method showed mean Dice Similarity Coefficient (DSC) and Average Symmetric Surface Distance (ASSD) of $0.8351 \pm 0.1152$ and $1.6712 \pm 2.1948$ for vestibular schwannoma (VS), $0.8098 \pm 0.0233$ and $0.2317 \pm 0.1577$ for cochlea on the VS and cochlea segmentation task of the Cross-Modality Domain Adaptation (crossMoDA 2022) challenge validation phase leaderboard.

医学图像图像翻译域适应分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。