arXiv:2410.17521cs.CV2024-10NeurIPS被引 5

用扩散模型先验自适应估计噪声,提升真实图像去噪效果。

Diffusion Priors for Variational Likelihood Estimation and Image Denoising

  • 基于变分贝叶斯动态推断噪声精度后验,融合非同分布似然
  • 通过局部高斯卷积修正噪声方差,优化中间结果
  • 适合处理真实世界复杂噪声,尤其适用于高分辨率图像

真实世界中的图像去噪在低层计算机视觉中至关重要。由于扩散模型强大的生成能力,近期研究转向利用扩散先验进行图像恢复。然而,现有方法或仅考虑简单噪声类型,或依赖近似后验估计,难以有效应对真实图像中常见的结构化、信号相关噪声。本文基于扩散先验,提出在逆扩散过程中自适应似然估计与最大后验(MAP)推断,以应对真实噪声。我们引入独立但非同分布的似然项,并结合噪声精度(逆方差)先验,通过变分贝叶斯在生成过程中动态推断精度后验;同时,利用局部高斯卷积校正估计的噪声方差。最终通过传播平衡更新后的似然与扩散先验的中间MAP解获得去噪图像。此外,我们探索了低分辨率扩散模型中固有的局部扩散先验,实现对高分辨率噪声图像的直接处理。在多个真实数据集上的大量实验与分析验证了方法的有效性。代码已开源:https://github.com/HUST-Tan/DiffusionVI。

原文摘要 · Abstract (English)

Real-world noise removal is crucial in low-level computer vision. Due to the remarkable generation capabilities of diffusion models, recent attention has shifted towards leveraging diffusion priors for image restoration tasks. However, existing diffusion priors-based methods either consider simple noise types or rely on approximate posterior estimation, limiting their effectiveness in addressing structured and signal-dependent noise commonly found in real-world images. In this paper, we build upon diffusion priors and propose adaptive likelihood estimation and MAP inference during the reverse diffusion process to tackle real-world noise. We introduce an independent, non-identically distributed likelihood combined with the noise precision (inverse variance) prior and dynamically infer the precision posterior using variational Bayes during the generation process. Meanwhile, we rectify the estimated noise variance through local Gaussian convolution. The final denoised image is obtained by propagating intermediate MAP solutions that balance the updated likelihood and diffusion prior. Additionally, we explore the local diffusion prior inherent in low-resolution diffusion models, enabling direct handling of high-resolution noisy images. Extensive experiments and analyses on diverse real-world datasets demonstrate the effectiveness of our method. Code is available at https://github.com/HUST-Tan/DiffusionVI.

图像去噪扩散模型变分推断真实噪声

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。