arXiv:2511.22048cs.CVcs.AI2025-11被引 4

用图像结构信息增强超分辨率,提升真实场景图像质量。

ICM-SR: Image-Conditioned Manifold Regularization for Image Super-Resolution

  • 以颜色与边缘信息构建图像条件流形,替代文本条件流形。
  • 在真实图像超分任务中显著提升感知质量,尤其改善模糊和色偏问题。
  • 适合追求高质量真实图像生成的视觉应用开发者使用。

真实世界图像超分辨率(Real-ISR)常借助文生图扩散模型的强大生成先验,通过约束输出位于其学习的流形上实现。然而,现有方法普遍忽视正则化流形的重要性,通常默认使用文本条件流形。该方法存在两个关键缺陷:概念上与任务不符——目标是直接基于低质量图像生成高质量图像;实际上,教师模型常产生色彩失真和边缘模糊的图像,表明其生成先验不适合此任务。为修正这些缺陷并确保概念一致性,需引入更合适的流形,融合图像自身信息。直接使用原始图像条件虽直观,但因其高信息密度导致正则化过程数值不稳定。为此,我们提出图像条件流形正则化(ICM),将输出正则化至由稀疏但关键的结构信息(色彩图与Canny边缘)构成的流形。ICM提供任务对齐且稳定的正则信号,避免密集条件带来的不稳定性,从而显著提升超分辨率质量。实验验证该正则化显著提升超分辨率性能,尤其在感知质量方面表现突出,适用于真实应用场景。代码将开源以保障可复现性。

原文摘要 · Abstract (English)

Real world image super-resolution (Real-ISR) often leverages the powerful generative priors of text-to-image diffusion models by regularizing the output to lie on their learned manifold. However, existing methods often overlook the importance of the regularizing manifold, typically defaulting to a text-conditioned manifold. This approach suffers from two key limitations. Conceptually, it is misaligned with the Real-ISR task, which is to generate high quality (HQ) images directly tied to the low quality (LQ) images. Practically, the teacher model often reconstructs images with color distortions and blurred edges, indicating a flawed generative prior for this task. To correct these flaws and ensure conceptual alignment, a more suitable manifold must incorporate information from the images. While the most straightforward approach is to condition directly on the raw input images, their high information densities make the regularization process numerically unstable. To resolve this, we propose image-conditioned manifold regularization (ICM), a method that regularizes the output towards a manifold conditioned on the sparse yet essential structural information: a combination of colormap and Canny edges. ICM provides a task-aligned and stable regularization signal, thereby avoiding the instability of dense-conditioning and enhancing the final super-resolution quality. Our experiments confirm that the proposed regularization significantly enhances super-resolution performance, particularly in perceptual quality, demonstrating its effectiveness for real-world applications. We will release the source code of our work for reproducibility.

图像超分扩散模型流形正则结构信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。