针对图像超分中噪声过拟合问题,提出定向去噪框架提升泛化能力。
Not All Degradations Are Equal: A Targeted Feature Denoising Framework for Generalizable Image Super-Resolution
- 识别并分离噪声类退化,针对性去除模型对噪声的过拟合
- 在五个基准上超越已有正则方法,覆盖合成与真实场景
- 无需修改网络结构,可无缝集成到现有超分模型中
通用图像超分辨率旨在应对未知退化条件下的泛化挑战。为此,模型需聚焦于图像内容特征,而非过拟合各类退化。尽管近期已有如Dropout和特征对齐等方法抑制模型对退化的过拟合,但这些工作假设模型对所有退化类型(如模糊、噪声、JPEG)均存在过拟合。本文通过深入分析发现,模型主要过拟合于噪声,这归因于其退化模式与其他类型差异显著。为此,我们提出一种面向噪声的特征去噪框架,包含噪声检测与去噪模块。该方法为通用解决方案,可无修改地集成至现有超分模型。实验表明,该框架在五个传统基准数据集(涵盖合成与真实世界场景)上优于以往基于正则的方法。
原文摘要 · Abstract (English)
Generalizable Image Super-Resolution aims to enhance model generalization capabilities under unknown degradations. To achieve this goal, the models are expected to focus only on image content-related features instead of overfitting degradations. Recently, numerous approaches such as Dropout and Feature Alignment have been proposed to suppress models' natural tendency to overfit degradations and yield promising results. Nevertheless, these works have assumed that models overfit to all degradation types (e.g., blur, noise, JPEG), while through careful investigations in this paper, we discover that models predominantly overfit to noise, largely attributable to its distinct degradation pattern compared to other degradation types. In this paper, we propose a targeted feature denoising framework, comprising noise detection and denoising modules. Our approach presents a general solution that can be seamlessly integrated with existing super-resolution models without requiring architectural modifications. Our framework demonstrates superior performance compared to previous regularization-based methods across five traditional benchmarks and datasets, encompassing both synthetic and real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。