扩散模型在少量投影下重建效果好,但过多投影后性能不再提升。
When are Diffusion Priors Helpful in Sparse Reconstruction? A Study with Sparse-view CT
- 用扩散模型作先验,从极少数投影中恢复图像细节。
- 少投影时(10-15次)扩散模型优于传统方法,但多投影后性能饱和。
- 适合低剂量CT重建,尤其关注图像真实性与临床可靠性。
扩散模型在图像生成中表现卓越,正被用于稀疏医学图像重建。然而,相比依赖简单解析先验的传统算法,扩散模型在观测极少时仍能生成看似真实的错误结果。本文通过改变投影数量,对比扩散先验与经典先验(稀疏与Tikhonov正则化)在像素级、结构及下游任务指标上的表现,使用低剂量胸部壁部CT进行脂肪质量量化。结果表明:当投影数足够时,传统先验更优;在极少数投影(约10-15次)下,扩散先验显著优于传统方法,可捕捉大量细节;但即便增加投影数,其性能也趋于饱和,无法完全还原所有细节。研究揭示了基于扩散模型的稀疏重建潜在风险,强调需在高风险临床场景中进一步验证。
原文摘要 · Abstract (English)
Diffusion models demonstrate state-of-the-art performance on image generation, and are gaining traction for sparse medical image reconstruction tasks. However, compared to classical reconstruction algorithms relying on simple analytical priors, diffusion models have the dangerous property of producing realistic looking results \emph{even when incorrect}, particularly with few observations. We investigate the utility of diffusion models as priors for image reconstruction by varying the number of observations and comparing their performance to classical priors (sparse and Tikhonov regularization) using pixel-based, structural, and downstream metrics. We make comparisons on low-dose chest wall computed tomography (CT) for fat mass quantification. First, we find that classical priors are superior to diffusion priors when the number of projections is ``sufficient''. Second, we find that diffusion priors can capture a large amount of detail with very few observations, significantly outperforming classical priors. However, they fall short of capturing all details, even with many observations. Finally, we find that the performance of diffusion priors plateau after extremely few ($\approx$10-15) projections. Ultimately, our work highlights potential issues with diffusion-based sparse reconstruction and underscores the importance of further investigation, particularly in high-stakes clinical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。