用噪声注入提升扩散模型在图像修复中的表现,解决严重病态问题。
Stochastic Generative Plug-and-Play Priors
- 引入噪声注入的生成式插件框架,直接使用预训练扩散模型作先验
- 在多线圈MRI和大区域图像补全中优于传统方法,接近扩散求解器性能
- 理论证明噪声提升优化稳定性,有助于逃离鞍点,适合逆问题求解者
插件式去噪(PnP)方法通过将去噪器嵌入优化算法广泛用于解决成像逆问题。基于得分的扩散模型(SBDM)近期在多种噪声水平下训练的去噪器上展现出强大的生成能力。尽管两者均依赖去噪器,但如何在不依赖反向扩散采样的情况下系统性地将SBDM作为先验仍不明确。本文建立了PnP的得分解释,证明可直接在PnP框架中使用预训练的SBDM。基于此,我们提出随机生成式PnP(SGPnP)框架,通过注入噪声以更好利用表达能力强的生成式SBDM先验,从而提升在严重病态逆问题中的鲁棒性。我们提供了新理论,表明该噪声注入诱导对高斯平滑目标函数的优化,并促进逃离严格鞍点。在多线圈MRI重建和大掩码自然图像补全等挑战性任务上的实验表明,该方法持续优于传统PnP方法,性能与基于扩散的求解器相当。
原文摘要 · Abstract (English)
Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into optimization algorithms. Score-based diffusion models (SBDMs) have recently demonstrated strong generative performance through a denoiser trained across a wide range of noise levels. Despite their shared reliance on denoisers, it remains unclear how to systematically use SBDMs as priors within the PnP framework without relying on reverse diffusion sampling. In this paper, we establish a score-based interpretation of PnP that justifies using pretrained SBDMs directly within PnP algorithms. Building on this connection, we introduce a stochastic generative PnP (SGPnP) framework that injects noise to better leverage the expressive generative SBDM priors, thereby improving robustness in severely ill-posed inverse problems. We provide a new theory showing that this noise injection induces optimization on a Gaussian-smoothed objective and promotes escape from strict saddle points. Experiments on challenging inverse tasks, such as multi-coil MRI reconstruction and large-mask natural image inpainting, demonstrate consistent improvement over conventional PnP methods and achieve performance competitive with diffusion-based solvers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。