arXiv:2409.13477eess.IVcs.CV2024-09被引 2

用一张MRI图指导另一张图像重建,无需训练数据即可实现高加速成像。

A Plug-and-Play Method for Guided Multi-contrast MRI Reconstruction based on Content/Style Modeling

  • 通过内容/风格解耦模型,从部分配对图像中学习跨对比度先验知识。
  • 在真实数据集上实现32.6%的加速提升,重建质量优于端到端方法。
  • 适合需要快速、可解释、跨对比度重建的临床MRI应用。

由于同一解剖结构的不同MRI对比度包含冗余信息,一种对比度可用来指导后续采集的欠采样对比度的重建。为利用多对比度辅助信息解决此问题,已有多种端到端学习方法提出,但关键挑战在于需大量包含原始k空间数据与对齐参考图像的成对训练数据。本文提出一种模块化即插即用方法(PnP-CoSMo),仅需部分配对的图像域数据,无需k空间训练数据。首先学习双对比度MRI图像的内容/风格模型,随后作为可插入的算子用于迭代重建。内容与风格的解耦使对比度无关和对比度特异因素得以显式表示。因此,将先验信息融入重建转化为用高质量内容替换估计图像中的混叠内容。结合数据一致性步骤及内容估计修正,形成迭代框架。该方法天然具备跨对比度泛化能力,并提供基于共享与非共享生成因子的可解释性框架。仿真验证了其可解释性与收敛性;在公开的NYU fastMRI DICOM数据集上展示等效或更优的重建质量,且泛化能力更强。在两个院内多线圈数据集上,相比非引导重建,最高实现32.6%的加速提升。

原文摘要 · Abstract (English)

Since the various MR contrasts of a given anatomy contain redundant information, one contrast can be used to guide the reconstruction of another undersampled contrast acquired subsequently in the same session. To solve this reconstruction problem leveraging multi-contrast side information, several end-to-end learning-based methods have been proposed. However, a key challenge is the requirement for large paired training datasets comprising raw k-space data and aligned reference images. We propose a modular plug-and-play method, which requires no k-space training data and relies solely on partially paired image-domain datasets. A content/style model of two-contrast MR image data is first learned and subsequently applied as a plug-and-play operator in iterative reconstruction. The disentanglement of content and style allows explicit representation of contrast-independent and contrast-specific factors. Consequently, incorporating prior information into the reconstruction reduces to a simple replacement operation on the aliased content of the estimated image using high-quality content derived from the reference scan. Combining this operation with an MR data consistency step, followed by a corrective procedure for the content estimate, yields an iterative scheme. We name this novel approach PnP-CoSMo. It offers, by design, cross-contrast generalizability and provides an explanatory framework based on the shared and non-shared generative factors underlying the two given contrasts. We explore various aspects, including interpretability and convergence, via simulations. Furthermore, its practicality is demonstrated on the public NYU fastMRI DICOM dataset, showing equivalent or superior quality and greater generalizability compared to end-to-end methods. On two in-house multi-coil datasets, PnP-CoSMo enabled up to 32.6% greater acceleration over non-guided reconstruction at given SSIM.

MRI重建图像生成即插即用多对比度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。