用目标模态分布引导生成,提升医学图像翻译质量与效率
Cross-conditioned Diffusion Model for Medical Image to Image Translation
- 以目标模态分布为引导,改进扩散模型生成质量
- 在BraTS2023和UPenn-GBM上优于传统扩散模型
- 适合需要高效高质量图像合成的医疗影像研究者
多模态磁共振成像(MRI)为疾病分析提供了丰富互补的信息。然而,获取多种MRI模态在成本、扫描时间和安全性方面存在实际挑战,常导致数据不完整,影响诊断质量和深度学习模型性能。近年来,生成对抗网络(GAN)和去噪扩散模型在自然与医学图像翻译任务中展现出潜力。但训练复杂度高及计算开销大限制了其应用。为此,我们提出跨条件扩散模型(CDM)用于医学图像到图像翻译。核心思想是利用目标模态分布作为引导,提升生成质量并实现比传统扩散模型更高的生成效率。首先,设计模态特异性表示模型(MRM)建模目标模态分布;其次,构建模态解耦扩散网络(MDN)高效学习该分布;最后,引入带条件嵌入模块的跨条件UNet(C-UNet),以源模态为输入,目标分布为引导,合成目标模态。在BraTS2023和UPenn-GBM基准数据集上的大量实验表明本方法具有显著优势。
原文摘要 · Abstract (English)
Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often result in incomplete datasets. This affects both the quality of diagnosis and the performance of deep learning models trained on such data. Recent advancements in generative adversarial networks (GANs) and denoising diffusion models have shown promise in natural and medical image-to-image translation tasks. However, the complexity of training GANs and the computational expense associated with diffusion models hinder their development and application in this task. To address these issues, we introduce a Cross-conditioned Diffusion Model (CDM) for medical image-to-image translation. The core idea of CDM is to use the distribution of target modalities as guidance to improve synthesis quality while achieving higher generation efficiency compared to conventional diffusion models. First, we propose a Modality-specific Representation Model (MRM) to model the distribution of target modalities. Then, we design a Modality-decoupled Diffusion Network (MDN) to efficiently and effectively learn the distribution from MRM. Finally, a Cross-conditioned UNet (C-UNet) with a Condition Embedding module is designed to synthesize the target modalities with the source modalities as input and the target distribution for guidance. Extensive experiments conducted on the BraTS2023 and UPenn-GBM benchmark datasets demonstrate the superiority of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。