arXiv:2411.17203eess.IVcs.CV2024-11被引 20

用小波扩散模型补全缺失脑部MRI模态,提升分割可用性

cWDM: Conditional Wavelet Diffusion Models for Cross-Modality 3D Medical Image Synthesis

  • 基于小波扩散模型,直接生成高分辨率3D医学图像
  • 仅需3个可用模态即可合成缺失模态,保持完整体积结构
  • 适用于多种跨模态图像生成,临床实用性强

本文参与2024年BraTS脑部MR图像合成挑战,提出条件小波扩散模型(cWDM),用于直接解决高分辨率3D体数据的配对图像到图像转换任务。尽管基于深度学习的脑肿瘤分割模型已展现明确临床价值,但通常需要多模态MR扫描(T1、T1ce、T2、FLAIR)作为输入。由于时间限制或成像伪影,某些模态可能缺失,影响高性能分割算法在临床中的应用。为此,我们提出一种方法:在三个可用模态条件下合成一个缺失模态图像,从而支持下游分割模型运行。将该任务视为条件生成问题,结合小波扩散模型与简单条件策略,直接应用于全分辨率体积数据,避免了切片或分块处理带来的伪影。本方法虽聚焦特定应用,但可推广至所有配对图像到图像转换场景,如CT↔MR、MR↔PET转换,或掩码引导的解剖结构引导图像生成。

原文摘要 · Abstract (English)

This paper contributes to the "BraTS 2024 Brain MR Image Synthesis Challenge" and presents a conditional Wavelet Diffusion Model (cWDM) for directly solving a paired image-to-image translation task on high-resolution volumes. While deep learning-based brain tumor segmentation models have demonstrated clear clinical utility, they typically require MR scans from various modalities (T1, T1ce, T2, FLAIR) as input. However, due to time constraints or imaging artifacts, some of these modalities may be missing, hindering the application of well-performing segmentation algorithms in clinical routine. To address this issue, we propose a method that synthesizes one missing modality image conditioned on three available images, enabling the application of downstream segmentation models. We treat this paired image-to-image translation task as a conditional generation problem and solve it by combining a Wavelet Diffusion Model for high-resolution 3D image synthesis with a simple conditioning strategy. This approach allows us to directly apply our model to full-resolution volumes, avoiding artifacts caused by slice- or patch-wise data processing. While this work focuses on a specific application, the presented method can be applied to all kinds of paired image-to-image translation problems, such as CT $\leftrightarrow$ MR and MR $\leftrightarrow$ PET translation, or mask-conditioned anatomically guided image generation.

医学图像合成扩散模型跨模态小波变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。