arXiv:2502.03810cs.CV2025-02被引 11

用扩散模型+自适应卷积,让模糊照片变清晰。

DeblurDiff: Real-World Image Deblurring with Generative Diffusion Models

  • 在隐空间联合训练核预测网络,动态生成去模糊核
  • 迭代优化核估计,提升细节恢复和结构保真度
  • 适合需要高质量真实世界去模糊的开发者

扩散模型在图像生成上取得显著进展。预训练的Stable Diffusion(SD)模型可通过提供清晰图像先验辅助去模糊。然而,直接将模糊图或预去模糊图作为条件输入会阻碍结构提取或使结果过度依赖去模糊网络。本文提出隐空间核预测网络(LKPN),实现鲁棒的真实世界图像去模糊。具体而言,LKPN在隐空间中与条件扩散模型联合训练,学习空间可变核以指导隐空间中的锐化图像重建。通过逐元素自适应卷积(EAC),所学核用于自适应处理输入特征,有效保留输入结构信息,从而更有效地引导稳定扩散模型(SD)生成过程,提升去模糊效果和细节重建质量。此外,每一步扩散结果被用于迭代估计LKPN中的核,以更好地通过EAC恢复锐化隐状态。这种迭代精炼增强了去模糊过程的准确性和鲁棒性。大量实验表明,该方法在基准数据集和真实世界图像上均优于现有最先进去模糊方法。

原文摘要 · Abstract (English)

Diffusion models have achieved significant progress in image generation. The pre-trained Stable Diffusion (SD) models are helpful for image deblurring by providing clear image priors. However, directly using a blurry image or pre-deblurred one as a conditional control for SD will either hinder accurate structure extraction or make the results overly dependent on the deblurring network. In this work, we propose a Latent Kernel Prediction Network (LKPN) to achieve robust real-world image deblurring. Specifically, we co-train the LKPN in latent space with conditional diffusion. The LKPN learns a spatially variant kernel to guide the restoration of sharp images in the latent space. By applying element-wise adaptive convolution (EAC), the learned kernel is utilized to adaptively process the input feature, effectively preserving the structural information of the input. This process thereby more effectively guides the generative process of Stable Diffusion (SD), enhancing both the deblurring efficacy and the quality of detail reconstruction. Moreover, the results at each diffusion step are utilized to iteratively estimate the kernels in LKPN to better restore the sharp latent by EAC. This iterative refinement enhances the accuracy and robustness of the deblurring process. Extensive experimental results demonstrate that the proposed method outperforms state-of-the-art image deblurring methods on both benchmark and real-world images.

图像去模糊扩散模型隐空间自适应卷积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。