无需干净图像即可训练扩散模型,直接从噪声测量数据生成高质量图像。
Measurement Score-Based Diffusion Model
- 通过随机采样构建部分测量得分,学习完整测量分布
- 在多线圈MRI和自然图像上实现高质量生成与逆问题求解
- 适合无真实标签数据的医学成像等逆问题场景
扩散模型广泛应用于图像生成到逆问题求解。然而,传统训练需干净真值图像,在许多场景中不可得。我们提出测量得分扩散模型(MSM),仅使用噪声和子采样测量数据学习部分测量得分。MSM将完整测量分布建模为随机子采样所诱导的部分得分期望。为提升计算效率,我们设计了一种随机采样算法:每步仅使用部分得分的随机子集生成完整图像。此外,我们提出一种新后验采样方法,利用部分得分重建图像。理论分析表明,全采样与随机采样分布间的KL散度有界,保证算法准确性。我们在自然图像和多线圈MRI上验证了有效性,证明其在无清洁训练数据条件下仍能生成高质量图像并解决逆问题。代码开源:https://github.com/wustl-cig/MSM。
原文摘要 · Abstract (English)
Diffusion models are widely used in applications ranging from image generation to inverse problems. However, training diffusion models typically requires clean ground-truth images, which are unavailable in many applications. We introduce the Measurement Score-based diffusion Model (MSM), a novel framework that learns partial measurement scores using only noisy and subsampled measurements. MSM models the distribution of full measurements as an expectation over partial scores induced by randomized subsampling. To make the MSM representation computationally efficient, we also develop a stochastic sampling algorithm that generates full images by using a randomly selected subset of partial scores at each step. We additionally propose a new posterior sampling method for solving inverse problems that reconstructs images using these partial scores. We provide a theoretical analysis that bounds the Kullback-Leibler divergence between the distributions induced by full and stochastic sampling, establishing the accuracy of the proposed algorithm. We demonstrate the effectiveness of MSM on natural images and multi-coil MRI, showing that it can generate high-quality images and solve inverse problems -- all without access to clean training data. Code is available at https://github.com/wustl-cig/MSM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。