arXiv:2503.00945eess.IVcs.AI2025-03被引 6

用无配对CT生成MRI图像,提升肝脏分割精度

Cross Modality Medical Image Synthesis for Improving Liver Segmentation

  • 基于改进的CycleGAN结构生成腹部MRI图像
  • 肝脏分割模型在合成数据加持下IoU提升1.17%
  • 适合数据稀缺场景下的医学图像分析研究者

基于深度学习的医学图像辅助诊断需大量标注数据,但公开的大型标注数据集匮乏,限制了系统发展。生成对抗网络(GAN),特别是CycleGAN,可在无配对数据条件下实现跨模态图像生成。然而,多数基于CycleGAN的方法难以解决输入与生成数据间的配准与不对称问题。本文提出两阶段方法,通过腹部CT到MRI的跨模态转换生成腹部MRI图像。采用受启发于CycleGAN的变形不变网络EssNet,将未配对的CT图像转化为合成MRI图像。随后将合成图像与原始MRI图像结合,用于提升U-Net在肝脏分割任务中的性能。在真实MRI图像上训练U-Net后,再在真实与合成图像上联合训练。对比两种情形,发现交并比(IoU)提升1.17%。结果表明该方法具有缓解医学图像数据稀缺问题的潜力。

原文摘要 · Abstract (English)

Deep learning-based computer-aided diagnosis (CAD) of medical images requires large datasets. However, the lack of large publicly available labeled datasets limits the development of deep learning-based CAD systems. Generative Adversarial Networks (GANs), in particular, CycleGAN, can be used to generate new cross-domain images without paired training data. However, most CycleGAN-based synthesis methods lack the potential to overcome alignment and asymmetry between the input and generated data. We propose a two-stage technique for the synthesis of abdominal MRI using cross-modality translation of abdominal CT. We show that the synthetic data can help improve the performance of the liver segmentation network. We increase the number of abdominal MRI images through cross-modality image transformation of unpaired CT images using a CycleGAN inspired deformation invariant network called EssNet. Subsequently, we combine the synthetic MRI images with the original MRI images and use them to improve the accuracy of the U-Net on a liver segmentation task. We train the U-Net on real MRI images and then on real and synthetic MRI images. Consequently, by comparing both scenarios, we achieve an improvement in the performance of U-Net. In summary, the improvement achieved in the Intersection over Union (IoU) is 1.17%. The results show potential to address the data scarcity challenge in medical imaging.

医学图像跨模态生成数据增强肝脏分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。