arXiv:2503.21907cs.CV2025-03

无需假设降质核,通过图像内局部块相似性实现盲超分辨率。

KernelFusion: Assumption-Free Blind Super-Resolution via Patch Diffusion

  • 基于单张低分辨图像的块扩散模型,直接学习其特有的内部块统计特征。
  • 在重建高分辨图像的同时,恢复出能保持跨尺度块相似性的精确降质核。
  • 对复杂非标准降质场景表现优异,适合真实世界中未知退化条件下的图像修复。

传统超分辨率方法假设高分辨与低分辨图像间存在理想降质核(如双线性下采样)。此类方法在非理想降质情况下失效。现有盲超分辨率方法虽尝试摆脱此假设,但仍局限于简单降质核(如各向异性高斯核),对更复杂的分布外降质无效。而使用正确降质核比使用复杂算法更重要。本文提出KernelFusion,一种零样本扩散方法,不假设任何降质核形式。该方法从低分辨输入图像中直接恢复出唯一的图像特定降质核,同时重建高分辨图像。核心思想是:正确的降质核应使低分辨图像不同尺度间的局部块相似性最大化。我们首先在单个低分辨图像上训练一个基于块的扩散模型,捕获其独特的内部块统计特征;随后重建更大的高分辨图像,使其具有相同学习到的块分布,并同时恢复出维持跨尺度关系的正确降质核。实验证明,在复杂降质条件下,KernelFusion显著优于所有现有超分辨率基线,而现有最先进盲超分辨率方法在此类场景下完全失败。通过摆脱预设核假设,KernelFusion将盲超分辨率推进至无假设的新范式,可处理此前认为不可能的降质核。

原文摘要 · Abstract (English)

Traditional super-resolution (SR) methods assume an ``ideal'' downscaling SR-kernel (e.g., bicubic downscaling) between the high-resolution (HR) image and the low-resolution (LR) image. Such methods fail once the LR images are generated differently. Current blind-SR methods aim to remove this assumption, but are still fundamentally restricted to rather simplistic downscaling SR-kernels (e.g., anisotropic Gaussian kernels), and fail on more complex (out of distribution) downscaling degradations. However, using the correct SR-kernel is often more important than using a sophisticated SR algorithm. In ``KernelFusion'' we introduce a zero-shot diffusion-based method that makes no assumptions about the kernel. Our method recovers the unique image-specific SR-kernel directly from the LR input image, while simultaneously recovering its corresponding HR image. KernelFusion exploits the principle that the correct SR-kernel is the one that maximizes patch similarity across different scales of the LR image. We first train an image-specific patch-based diffusion model on the single LR input image, capturing its unique internal patch statistics. We then reconstruct a larger HR image with the same learned patch distribution, while simultaneously recovering the correct downscaling SR-kernel that maintains this cross-scale relation between the HR and LR images. Empirical results show that KernelFusion vastly outperforms all SR baselines on complex downscaling degradations, where existing SotA Blind-SR methods fail miserably. By breaking free from predefined kernel assumptions, KernelFusion pushes Blind-SR into a new assumption-free paradigm, handling downscaling kernels previously thought impossible.

盲超分辨率扩散模型图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。