提出频域引导采样,提升扩散模型图像修复精度
Frequency-Guided Posterior Sampling for Diffusion-Based Image Restoration
- 在频域引入随时间变化的低通滤波器,逐步恢复高频信息
- 在运动模糊和去雾任务上显著优于现有方法,尤其在强退化场景
- 适合关注图像修复质量与理论可靠性的研究人员
图像修复旨在从退化观测中恢复高质量图像。当退化过程已知时,该问题可形式化为逆问题,在贝叶斯框架下目标是根据退化观测采样一个干净重建。近年来,通过修改采样过程以考虑退化,预训练扩散模型被用于图像修复。然而,这些方法常依赖某些近似,可能导致显著误差并降低样本质量。本文首次在自然图像空间分布假设下,对线性逆问题中的近似误差进行严格分析,揭示了先前方法可能严重失效的情况。基于理论洞察,我们提出一种简单改进:在测量的频域引入随时间变化的低通滤波器,逐步在修复过程中融合更高频率成分。我们还设计了一种基于数据分布的自适应频率调度策略。该方法在运动模糊和去雾等挑战性任务上显著提升性能。
原文摘要 · Abstract (English)
Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean reconstruction given the degraded observation. Recently, modern pretrained diffusion models have been used for image restoration by modifying their sampling procedure to account for the degradation process. However, these methods often rely on certain approximations that can lead to significant errors and compromised sample quality. In this paper, we provide the first rigorous analysis of this approximation error for linear inverse problems under distributional assumptions on the space of natural images, demonstrating cases where previous works can fail dramatically. Motivated by our theoretical insights, we propose a simple modification to existing diffusion-based restoration methods. Our approach introduces a time-varying low-pass filter in the frequency domain of the measurements, progressively incorporating higher frequencies during the restoration process. We develop an adaptive curriculum for this frequency schedule based on the underlying data distribution. Our method significantly improves performance on challenging image restoration tasks including motion deblurring and image dehazing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。