用潜在扩散先验提升欠采样MRI重建质量与效率
LDPM: Towards undersampled MRI reconstruction with MR-VAE and Latent Diffusion Prior
- 构建基于MR-VAE和潜空间扩散的两阶段重建框架
- 相比SD-VAE提升约3.92 dB的PSNR,显著改善图像质量
- 适合医学影像重建研究者,尤其关注高效高保真重建
扩散模型作为强大的生成模型,在图像重建中展现出巨大潜力。然而,现有方法直接在像素空间操作,导致计算成本过高。潜空间扩散模型虽可降低计算量,但应用于MRI重建仍面临三大挑战:缺乏医学保真度控制机制、自然图像与磁共振物理间的域差距、潜空间数据一致性未定义。为此,提出一种基于潜扩散先验的欠采样MRI重建方法(LDPM)。该方法通过:(1) 基于草图引导的两阶段重建策略,平衡感知质量和解剖保真度;(2) 专为MRI优化的VAE(MR-VAE),相较SD-VAE在快速MRI数据集上实现约3.92 dB的PSNR提升;(3) 改进的双阶段采样器(Dual-Stage Sampler),强化潜空间中的高保真重建。在fastMRI数据集上的实验表明,该方法达到当前最优性能,并在多种场景下表现出强鲁棒性。消融实验验证了各模块的有效性。
原文摘要 · Abstract (English)
Diffusion models, as powerful generative models, have found a wide range of applications and shown great potential in solving image reconstruction problems. Some works attempted to solve MRI reconstruction with diffusion models, but these methods operate directly in pixel space, leading to higher computational costs for optimization and inference. Latent diffusion models, pre-trained on natural images with rich visual priors, are expected to solve the high computational cost problem in MRI reconstruction by operating in a lower-dimensional latent space. However, direct application to MRI reconstruction faces three key challenges: (1) absence of explicit control mechanisms for medical fidelity, (2) domain gap between natural images and MR physics, and (3) undefined data consistency in latent space. To address these challenges, a novel Latent Diffusion Prior-based undersampled MRI reconstruction (LDPM) method is proposed. Our LDPM framework addresses these challenges by: (1) a sketch-guided pipeline with a two-step reconstruction strategy, which balances perceptual quality and anatomical fidelity, (2) an MRI-optimized VAE (MR-VAE), which achieves an improvement of approximately 3.92 dB in PSNR for undersampled MRI reconstruction compared to that with SD-VAE \cite{sd}, and (3) Dual-Stage Sampler, a modified version of spaced DDPM sampler, which enforces high-fidelity reconstruction in the latent space. Experiments on the fastMRI dataset\cite{fastmri} demonstrate the state-of-the-art performance of the proposed method and its robustness across various scenarios. The effectiveness of each module is also verified through ablation experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。