arXiv:2412.09846eess.IVcs.CV2024-12被引 6

分两步提升图像分辨率,效果优于传统方法

A Single-Frame and Multi-Frame Cascaded Image Super-Resolution Method

  • 先用多帧信息粗放大,再用单帧精修复
  • 在Set5和Set14上平均提升0.76和0.621dB
  • 兼容多种超分模型,适合真实场景应用

图像超分辨率旨在从一张或多张低分辨率(LR)图像中,利用先验知识重建高分辨率(HR)图像。然而,在实际应用中,由于互补信息有限,随着放大倍数增加,单帧和多帧超分辨率性能均迅速下降。本文提出一种两级级联超分辨率方法,将多帧超分辨率(MFSR)与单帧超分辨率(SFSR)结合,逐步提升图像至目标分辨率。该方法采用L0范数约束重建方案与增强型残差反投影网络,融合变分模型的灵活性与深度学习的特征提取能力。通过模拟与真实序列的大量实验验证,结果表明该方法在客观与主观质量上均表现优异。在Set5和Set14数据集上的平均PSNR分别为33.413 dB和29.658 dB,分别比基线方法高出0.76 dB和0.621 dB。此外,实验显示该级联模型可稳健适配不同SFSR与MFSR方法。

原文摘要 · Abstract (English)

The objective of image super-resolution is to reconstruct a high-resolution (HR) image with the prior knowledge from one or several low-resolution (LR) images. However, in the real world, due to the limited complementary information, the performance of both single-frame and multi-frame super-resolution reconstruction degrades rapidly as the magnification increases. In this paper, we propose a novel two-step image super resolution method concatenating multi-frame super-resolution (MFSR) with single-frame super-resolution (SFSR), to progressively upsample images to the desired resolution. The proposed method consisting of an L0-norm constrained reconstruction scheme and an enhanced residual back-projection network, integrating the flexibility of the variational modelbased method and the feature learning capacity of the deep learning-based method. To verify the effectiveness of the proposed algorithm, extensive experiments with both simulated and real world sequences were implemented. The experimental results show that the proposed method yields superior performance in both objective and perceptual quality measurements. The average PSNRs of the cascade model in set5 and set14 are 33.413 dB and 29.658 dB respectively, which are 0.76 dB and 0.621 dB more than the baseline method. In addition, the experiment indicates that this cascade model can be robustly applied to different SFSR and MFSR methods.

图像超分辨级联模型多帧重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。