arXiv:2410.04482eess.IV2024-10被引 4

用扩散模型优化深度先验,提升医学图像重建质量

Sequential Diffusion-Guided Deep Image Prior For Medical Image Reconstruction

  • 先用扩散模型生成更优初始输入,再迭代优化深度先验网络
  • 在MRI和CT重建中优于主流扩散模型方法和原始深度先验
  • 适合需要高质量重建的医学影像领域研究者

深度学习已广泛应用于磁共振成像(MRI)和计算机断层扫描(CT)等图像恢复任务。除监督模型外,近年出现两类重要方法:无监督自适应的深度图像先验(DIP),利用网络结构作为隐式正则化,但易过拟合噪声;以及扩散模型(DMs),通过修改预训练生成模型的采样过程,实现测量条件下的分布采样。本文提出将DIP与DMs结合,基于(i)DIP网络输入的影响,(ii)使用扩散模型作为扩散净化器(DP)。我们设计一种序列化流程,迭代优化DIP网络,采用包含数据一致性与自编码项的损失函数,并以扩散模型精炼的自适应输入作为引导。该方法称为顺序扩散引导的深度先验(uDiG-DIP)。实验表明,uDiG-DIP在MRI和CT重建任务中均优于主流扩散模型基线和原始DIP方法。

原文摘要 · Abstract (English)

Deep learning (DL) methods have been extensively applied to various image recovery problems, including magnetic resonance imaging (MRI) and computed tomography (CT) reconstruction. Beyond supervised models, other approaches have been recently explored including two key recent schemes: Deep Image Prior (DIP) that is an unsupervised scan-adaptive method that leverages the network architecture as implicit regularization but can suffer from noise overfitting, and diffusion models (DMs), where the sampling procedure of a pre-trained generative model is modified to allow sampling from the measurement-conditioned distribution through approximations. In this paper, we propose combining DIP and DMs for MRI and CT reconstruction, motivated by (i) the impact of the DIP network input and (ii) the use of DMs as diffusion purifiers (DPs). Specifically, we propose a sequential procedure that iteratively optimizes the DIP network with a DM-refined adaptive input using a loss with data consistency and autoencoding terms. We term the approach Sequential Diffusion-Guided DIP (uDiG-DIP). Our experimental results demonstrate that uDiG-DIP achieves superior reconstruction results compared to leading DM-based baselines and the original DIP for MRI and CT tasks.

医学图像扩散模型深度先验图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。