用扩散模型先验+加权最小二乘,提升非高斯噪声图像修复效果。
Integrating Reweighted Least Squares with Plug-and-Play Diffusion Priors for Noisy Image Restoration
- 基于最大后验框架,设计适用于多种噪声的广义损失函数。
- 在真实数据集上对脉冲噪声等非高斯噪声修复效果显著优于传统方法。
- 适合处理复杂噪声场景,尤其适用于图像恢复中需强先验的任务。
现有插件式图像修复方法通常在变量分裂优化框架中使用现成的高斯去噪器作为近端算子。近期,基于生成先验的去噪器已被成功整合到正则化优化方法中用于高斯噪声下的图像修复。然而,其在非高斯噪声(如脉冲噪声)中的应用仍鲜有探索。本文提出一种基于生成扩散先验的插件式图像修复框架,可鲁棒地去除各类噪声,包括脉冲噪声。在最大后验(MAP)估计框架下,数据保真项根据具体噪声模型调整。不同于传统用于高斯噪声的最小二乘损失,我们引入基于广义高斯混合的损失,能近似多种噪声分布,并导出ℓ_q范数(0<q≤2)保真项。该优化问题通过迭代重加权最小二乘(IRLS)求解,其中涉及生成先验的近端步骤通过基于扩散的去噪器高效实现。在基准数据集上的实验表明,所提方法能有效去除非高斯脉冲噪声,获得更优的修复性能。
原文摘要 · Abstract (English)
Existing plug-and-play image restoration methods typically employ off-the-shelf Gaussian denoisers as proximal operators within classical optimization frameworks based on variable splitting. Recently, denoisers induced by generative priors have been successfully integrated into regularized optimization methods for image restoration under Gaussian noise. However, their application to non-Gaussian noise--such as impulse noise--remains largely unexplored. In this paper, we propose a plug-and-play image restoration framework based on generative diffusion priors for robust removal of general noise types, including impulse noise. Within the maximum a posteriori (MAP) estimation framework, the data fidelity term is adapted to the specific noise model. Departing from the conventional least-squares loss used for Gaussian noise, we introduce a generalized Gaussian scale mixture-based loss, which approximates a wide range of noise distributions and leads to an $\ell_q$-norm ($0<q\leq2$) fidelity term. This optimization problem is addressed using an iteratively reweighted least squares (IRLS) approach, wherein the proximal step involving the generative prior is efficiently performed via a diffusion-based denoiser. Experimental results on benchmark datasets demonstrate that the proposed method effectively removes non-Gaussian impulse noise and achieves superior restoration performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。