arXiv:2412.00124cs.CVeess.IV2024-12CVPR被引 6

用自编码器重构空间替代像素损失,解决图像超分辨率中的模糊问题。

Auto-Encoded Supervision for Perceptual Image Super-Resolution

  • 用预训练自编码器的重构空间设计新损失函数
  • 在保持感知质量的同时显著提升重建精度
  • 可无缝集成到现有超分辨率框架中

本文针对基于GAN的感知图像超分辨率(SR)中保真度目标的挑战,指出传统像素级L_p损失(L_pix)与感知质量存在固有权衡。现有方法通过缩放系数或低通滤波缓解问题,但未触及导致模糊的根本原因。本文提出两个关键思路:精确识别导致模糊的L_pix子成分,并仅基于无此权衡的因子进行引导。通过使用以L_pix预训练的自编码器(AE),我们构建了新型损失函数L_AESOP,该函数在自编码器解码后的空间中测量距离,而非原始像素空间。仅将L_pix替换为L_AESOP,即可在不牺牲感知质量的前提下提供有效重建指导。方法设计简洁,便于集成到现有超分辨率框架中。实验表明,AESOP在感知超分辨率任务中表现优异。

原文摘要 · Abstract (English)

This work tackles the fidelity objective in the perceptual super-resolution~(SR). Specifically, we address the shortcomings of pixel-level $L_\text{p}$ loss ($\mathcal{L}_\text{pix}$) in the GAN-based SR framework. Since $L_\text{pix}$ is known to have a trade-off relationship against perceptual quality, prior methods often multiply a small scale factor or utilize low-pass filters. However, this work shows that these circumventions fail to address the fundamental factor that induces blurring. Accordingly, we focus on two points: 1) precisely discriminating the subcomponent of $L_\text{pix}$ that contributes to blurring, and 2) only guiding based on the factor that is free from this trade-off relationship. We show that they can be achieved in a surprisingly simple manner, with an Auto-Encoder (AE) pretrained with $L_\text{pix}$. Accordingly, we propose the Auto-Encoded Supervision for Optimal Penalization loss ($L_\text{AESOP}$), a novel loss function that measures distance in the AE space, instead of the raw pixel space. Note that the AE space indicates the space after the decoder, not the bottleneck. By simply substituting $L_\text{pix}$ with $L_\text{AESOP}$, we can provide effective reconstruction guidance without compromising perceptual quality. Designed for simplicity, our method enables easy integration into existing SR frameworks. Experimental results verify that AESOP can lead to favorable results in the perceptual SR task.

图像超分自编码器损失函数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。