提出旋转等变的任意尺度图像超分方法,提升重建结构保真度。
Rotation Equivariant Arbitrary-scale Image Super-Resolution

- 重构INR与编码器架构,实现从输入到输出的端到端旋转等变性。
- 在模拟与真实数据集上均显著减少纹理扭曲和伪影,提升结构一致性。
- 可即插即用,适配现有超分模型,提升通用性与实用性。
任意尺度图像超分辨率(ASISR)是计算机视觉中一项新兴热门任务,旨在从低分辨率输入图像中实现任意尺度的高分辨率重建。该任务通过深度网络编码器与隐式神经表示(INR)模块,将图像建模为连续隐函数来实现。尽管已有显著进展,但此类高度病态问题常导致重复纹理、边缘或形状等几何模式在低分辨率图像中严重失真,进而引发高分辨率重建中的异常伪影。因此,将旋转等变性嵌入ASISR网络至关重要,因其已被广泛证明能有效保持几何模式的原始方向与结构完整性。为此,本文精心重设计了INR与编码器的基本架构,引入超越传统ASISR网络的内在旋转等变能力。通过此改进,首次实现从输入到输出的端到端旋转等变性。我们还提供了严谨的理论分析以评估其内在等变误差,证实该结构具备固有的等变特性。实验表明,所提方法在模拟与真实数据集上均表现优越,并可无缝集成至现有ASISR框架中,以即插即用方式进一步提升性能。
原文摘要 · Abstract (English)
The arbitrary-scale image super-resolution (ASISR), a recent popular topic in computer vision, aims to achieve arbitrary-scale high-resolution recoveries from a low-resolution input image. This task is realized by representing the image as a continuous implicit function through two fundamental modules, a deep-network-based encoder and an implicit neural representation (INR) module. Despite achieving notable progress, a crucial challenge of such a highly ill-posed setting is that many common geometric patterns, such as repetitive textures, edges, or shapes, are seriously warped and deformed in the low-resolution images, naturally leading to unexpected artifacts appearing in their high-resolution recoveries. Embedding rotation equivariance into the ASISR network is thus necessary, as it has been widely demonstrated that this enhancement enables the recovery to faithfully maintain the original orientations and structural integrity of geometric patterns underlying the input image. Motivated by this, we make efforts to construct a rotation equivariant ASISR method in this study. Specifically, we elaborately redesign the basic architectures of INR and encoder modules, incorporating intrinsic rotation equivariance capabilities beyond those of conventional ASISR networks. Through such amelioration, the ASISR network can, for the first time, be implemented with end-to-end rotational equivariance maintained from input to output. We also provide a solid theoretical analysis to evaluate its intrinsic equivariance error, demonstrating its inherent nature of embedding such an equivariance structure. The superiority of the proposed method is substantiated by experiments conducted on both simulated and real datasets. We also validate that the proposed framework can be readily integrated into current ASISR methods in a plug \& play manner to further enhance their performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。