arXiv:2503.23265eess.IVcs.CV2025-03被引 3

轻量级Transformer仅用低分辨率图像训练,实现高质量超分辨率重建。

A Lightweight Image Super-Resolution Transformer Trained on Low-Resolution Images Only

  • 设计多尺度训练方法MSTbic,适配低分辨率仅训练场景。
  • 在4倍超分任务中,仅用6.25%的像素数据达到领先性能。
  • 适用于真实世界图像,适合资源受限的超分辨率应用。

Transformer架构在单图超分辨率(SISR)任务中表现优异,但其强大表征能力依赖大量训练数据,而现实中高质量高分辨率(HR)图像常不可得。本文首次提出一种轻量级视觉Transformer模型,仅使用低分辨率(LR)图像进行训练,应对无监督的LR-only超分辨率基准。针对4倍超分任务,可用训练数据仅为原始HR像素的6.25%,我们采用并改进来自显微成像领域的最新LR-only训练方法,构建适用于真实世界图像的多尺度训练策略(MSTbic)。在Set5、Set14、BSD100、Urban100和Manga109等经典数据集上评估,结果优于现有基于CNN的最先进LR-only方法。代码已开源:https://github.com/ifnspaml/SuperResolutionMultiscaleTraining。

原文摘要 · Abstract (English)

Transformer architectures prominently lead single-image super-resolution (SISR) benchmarks, reconstructing high-resolution (HR) images from their low-resolution (LR) counterparts. Their strong representative power, however, comes with a higher demand for training data compared to convolutional neural networks (CNNs). For many real-world SR applications, the availability of high-quality HR training images is not given, sparking interest in LR-only training methods. The LR-only SISR benchmark mimics this condition by allowing only low-resolution (LR) images for model training. For a 4x super-resolution, this effectively reduces the amount of available training data to 6.25% of the HR image pixels, which puts the employment of a data-hungry transformer model into question. In this work, we are the first to utilize a lightweight vision transformer model with LR-only training methods addressing the unsupervised SISR LR-only benchmark. We adopt and configure a recent LR-only training method from microscopy image super-resolution to macroscopic real-world data, resulting in our multi-scale training method for bicubic degradation (MSTbic). Furthermore, we compare it with reference methods and prove its effectiveness both for a transformer and a CNN model. We evaluate on the classic SR benchmark datasets Set5, Set14, BSD100, Urban100, and Manga109, and show superior performance over state-of-the-art (so far: CNN-based) LR-only SISR methods. The code is available on GitHub: https://github.com/ifnspaml/SuperResolutionMultiscaleTraining.

超分辨率轻量模型Transformer低分辨率训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。