从噪声数据中学习扩散模型,提升图像修复质量
Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Method
- 基于理论完备的期望最大化框架,迭代优化
- 在补全、去噪、去模糊任务中均实现高质量重建
- 适用于任意类型噪声,无需干净数据训练
扩散模型在建模复杂图像分布方面表现出色,可作为解决成像逆问题的通用先验。然而,其对大规模清洁数据的依赖限制了在难以获取干净数据场景下的应用。近期方法尝试直接从受损测量值中学习扩散模型,但或缺乏理论收敛性保证,或仅适用于特定类型的退化。本文提出一种基于原理性期望最大化(EM)框架的方法,可从任意类型噪声数据中迭代学习扩散模型。该框架采用即插即用的蒙特卡洛方法准确估计干净图像,再利用重构结果训练扩散模型,交替进行估计与训练直至收敛。我们在多种成像任务(包括补全、去噪、去模糊)上评估性能,实验表明该方法能从噪声数据中学习高保真扩散先验,显著提升成像逆问题的重建质量。
原文摘要 · Abstract (English)
Diffusion models have demonstrated exceptional ability in modeling complex image distributions, making them versatile plug-and-play priors for solving imaging inverse problems. However, their reliance on large-scale clean datasets for training limits their applicability in scenarios where acquiring clean data is costly or impractical. Recent approaches have attempted to learn diffusion models directly from corrupted measurements, but these methods either lack theoretical convergence guarantees or are restricted to specific types of data corruption. In this paper, we propose a principled expectation-maximization (EM) framework that iteratively learns diffusion models from noisy data with arbitrary corruption types. Our framework employs a plug-and-play Monte Carlo method to accurately estimate clean images from noisy measurements, followed by training the diffusion model using the reconstructed images. This process alternates between estimation and training until convergence. We evaluate the performance of our method across various imaging tasks, including inpainting, denoising, and deblurring. Experimental results demonstrate that our approach enables the learning of high-fidelity diffusion priors from noisy data, significantly enhancing reconstruction quality in imaging inverse problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。