无需训练,零样本恢复各种模糊图像,不依赖退化模型先验。
Invert2Restore: Zero-Shot Degradation-Blind Image Restoration
- 用预训练扩散模型建立清晰图与噪声的确定性映射。
- 通过将退化图像的噪声引导至高概率区域实现修复,效果优于现有方法。
- 适合无退化信息或仅有部分退化参数时的图像恢复场景。
真实场景中的图像恢复面临两大挑战:准确刻画图像先验和精确建模退化算子。预训练扩散模型在零样本图像恢复中被成功用作图像先验,但如何处理退化算子仍是开放问题。现实数据中,依赖特定参数假设的方法适用性受限。为此,我们提出Invert2Restore,一种零样本、免训练的方法,适用于完全盲和部分盲场景——既无需退化模型知识,也仅需部分已知参数形式而无需具体参数值。尽管如此,该方法仍能实现高保真恢复,并在多种退化类型下具有良好泛化能力。其核心思想是利用预训练扩散模型作为正常样本与无失真图像样本间的确定性映射。关键洞察在于,将扩散模型映射至退化图像的输入噪声位于标准正态分布的低概率密度区域。因此,可通过精细引导该噪声向高密度区域以实现图像恢复。我们在多个图像恢复任务上实验验证,结果表明Invert2Restore在退化算子未知或部分已知的场景中达到当前最优性能。
原文摘要 · Abstract (English)
Two of the main challenges of image restoration in real-world scenarios are the accurate characterization of an image prior and the precise modeling of the image degradation operator. Pre-trained diffusion models have been very successfully used as image priors in zero-shot image restoration methods. However, how to best handle the degradation operator is still an open problem. In real-world data, methods that rely on specific parametric assumptions about the degradation model often face limitations in their applicability. To address this, we introduce Invert2Restore, a zero-shot, training-free method that operates in both fully blind and partially blind settings -- requiring no prior knowledge of the degradation model or only partial knowledge of its parametric form without known parameters. Despite this, Invert2Restore achieves high-fidelity results and generalizes well across various types of image degradation. It leverages a pre-trained diffusion model as a deterministic mapping between normal samples and undistorted image samples. The key insight is that the input noise mapped by a diffusion model to a degraded image lies in a low-probability density region of the standard normal distribution. Thus, we can restore the degraded image by carefully guiding its input noise toward a higher-density region. We experimentally validate Invert2Restore across several image restoration tasks, demonstrating that it achieves state-of-the-art performance in scenarios where the degradation operator is either unknown or partially known.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。