无需数据集和输入图像,用新方法实现高效超分辨率。
NSSR-DIL: Null-Shot Image Super-Resolution Using Deep Identity Learning
- 通过学习退化与逆退化的身份关系,重构超分模型。
- 计算量降低至少10倍,性能媲美主流方法。
- 支持多种缩放倍数,适合真实场景应用。
当前最先进的图像超分辨率(ISR)方法依赖大量图像数据进行深度学习训练,但其计算复杂度高,难以应用于真实场景。本文提出一种新型、计算高效的ISR算法——基于深度身份学习的零样本超分辨率(NSSR-DIL),该方法不依赖任何特定数据集,也不需要单个输入低分辨率图像(如自监督方法ZSSR)。它将超分辨率任务重新定义为求解退化空间基函数的逆核,利用退化模型与逆退化模型之间的身份关系,实现快速重建。所提方法计算资源需求至少降低一个数量级,在多个基准数据集上表现竞争力。此外,该框架无需针对不同缩放因子(如X2、X3、X4)重新训练,保持统一模型结构,更适用于实际部署。
原文摘要 · Abstract (English)
The present State-of-the-Art (SotA) Image Super-Resolution (ISR) methods employ Deep Learning (DL) techniques using a large amount of image data. The primary limitation to extending the existing SotA ISR works for real-world instances is their computational and time complexities. In this paper, contrary to the existing methods, we present a novel and computationally efficient ISR algorithm that is independent of the image dataset to learn the ISR task. The proposed algorithm reformulates the ISR task from generating the Super-Resolved (SR) images to computing the inverse of the kernels that span the degradation space. We introduce Deep Identity Learning, exploiting the identity relation between the degradation and inverse degradation models. The proposed approach neither relies on the ISR dataset nor on a single input low-resolution (LR) image (like the self-supervised method i.e. ZSSR) to model the ISR task. Hence we term our model as Null-Shot Super-Resolution Using Deep Identity Learning (NSSR-DIL). The proposed NSSR-DIL model requires fewer computational resources, at least by an order of 10, and demonstrates a competitive performance on benchmark ISR datasets. Another salient aspect of our proposition is that the NSSR-DIL framework detours retraining the model and remains the same for varying scale factors like X2, X3, and X4. This makes our highly efficient ISR model more suitable for real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。