arXiv:2602.10744cs.CVcs.AI2026-02被引 1

针对真实图像超分质量评估难题,提出自监督多模型表征学习方法。

Self-Supervised Image Super-Resolution Quality Assessment based on Content-Free Multi-Model Oriented Representation Learning

  • 基于同一超分模型生成图像构建对比学习正样本,忽略内容差异
  • 在真实超分数据集上超越多数现有无参考评估指标
  • 适用于数据稀缺场景,特别适合实际应用中的超分质量判断

真实世界低分辨率图像的超分处理常导致复杂且不规则的退化,与合成数据中的可预测失真不同,其退化模式高度不可预测且跨场景差异大。本文提出一种面向此类高度病态现实场景的无参考超分图像质量评估方法(S3 RIQA)。该方法假设超分图像退化主要依赖于所用超分算法而非图像内容本身。通过自监督学习,在预训练阶段为多个超分模型构建定向表征:以相同模型生成的图像为正样本对,不同模型生成的为负样本对,实现内容无关的对比学习。进一步引入针对性预处理提取互补质量信息,并设计辅助任务以适应不同缩放因子带来的退化特征。为此构建新数据集SRMORSS,涵盖多种超分算法在大量真实低分辨率图像上的输出,填补了现有数据集空白。在真实超分质量评估基准测试中,S3 RIQA持续优于多数前沿评估指标。

原文摘要 · Abstract (English)

Super-resolution (SR) applied to real-world low-resolution (LR) images often results in complex, irregular degradations that stem from the inherent complexity of natural scene acquisition. In contrast to SR artifacts arising from synthetic LR images created under well-defined scenarios, those distortions are highly unpredictable and vary significantly across different real-life contexts. Consequently, assessing the quality of SR images (SR-IQA) obtained from realistic LR, remains a challenging and underexplored problem. In this work, we introduce a no-reference SR-IQA approach tailored for such highly ill-posed realistic settings. The proposed method enables domain-adaptive IQA for real-world SR applications, particularly in data-scarce domains. We hypothesize that degradations in super-resolved images are strongly dependent on the underlying SR algorithms, rather than being solely determined by image content. To this end, we introduce a self-supervised learning (SSL) strategy that first pretrains multiple SR model oriented representations in a pretext stage. Our contrastive learning framework forms positive pairs from images produced by the same SR model and negative pairs from those generated by different methods, independent of image content. The proposed approach S3 RIQA, further incorporates targeted preprocessing to extract complementary quality information and an auxiliary task to better handle the various degradation profiles associated with different SR scaling factors. To this end, we constructed a new dataset, SRMORSS, to support unsupervised pretext training; it includes a wide range of SR algorithms applied to numerous real LR images, which addresses a gap in existing datasets. Experiments on real SR-IQA benchmarks demonstrate that S3 RIQA consistently outperforms most state-of-the-art relevant metrics.

图像超分质量评估自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。