用频域一致性指导扩散模型,显著提升模糊图像恢复效果。
Frequency-Aware Guidance for Blind Image Restoration via Diffusion Models
- 引入基于二维离散小波变换的频域引导损失,兼顾空间与频率域一致性。
- 在图像去模糊任务中提升3.72dB PSNR,视觉质量更优。
- 可即插即用,适用于多种盲图像恢复场景,适合低层视觉研究者。
盲图像恢复是低层视觉中的重要挑战。近年来,去噪扩散模型在图像生成上表现卓越。通过利用预训练模型的强大生成先验与差异引导损失,引导扩散模型已在盲图像恢复中取得良好成果。然而,这些方法通常仅在空间域保证数据一致性,常导致图像内容失真。本文提出一种新颖的频率感知引导损失,可无缝集成至各类扩散模型。该损失基于二维离散小波变换,在空间与频率域同时强制内容一致性。实验表明,本方法在三种盲恢复任务中均有效:图像去模糊、湍流成像恢复及多退化盲恢复。尤其在图像去模糊任务中,PSNR 提升达 3.72 dB。此外,本方法生成图像细节丰富、失真更少,视觉质量最优。
原文摘要 · Abstract (English)
Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors of pre-trained models along with a differential guidance loss, have achieved promising results in blind image restoration. However, these models typically consider data consistency solely in the spatial domain, often resulting in distorted image content. In this paper, we propose a novel frequency-aware guidance loss that can be integrated into various diffusion models in a plug-and-play manner. Our proposed guidance loss, based on 2D discrete wavelet transform, simultaneously enforces content consistency in both the spatial and frequency domains. Experimental results demonstrate the effectiveness of our method in three blind restoration tasks: blind image deblurring, imaging through turbulence, and blind restoration for multiple degradations. Notably, our method achieves a significant improvement in PSNR score, with a remarkable enhancement of 3.72\,dB in image deblurring. Moreover, our method exhibits superior capability in generating images with rich details and reduced distortion, leading to the best visual quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。