区分空间无关与空间相关退化,动态建模提升盲超分辨率效果
Adaptive Blind Super-Resolution Network for Spatial-Specific and Spatial-Agnostic Degradations
- 分两类退化:空间无关(如噪声、下采样)与空间相关(如模糊)
- 全局+局部双分支动态滤波,分别处理不同退化类型
- 在合成与真实图像上均优于当前最优方法
现有方法在图像重建中忽略不同退化类型的差异,统一使用相同网络处理多种退化。我们发现常见退化如采样、模糊和噪声可大致分为两类:第一类为空间无关主导退化,受图像空间位置影响较小,如下采样和噪声;第二类为与图像空间位置密切相关,如模糊,称为空间特定主导退化。为此,我们提出一种融合全局与局部分支的动态滤波网络。全局动态滤波层通过注意力机制生成权重,作用于多个并行标准卷积核,感知不同图像中的空间无关退化,增强网络表达能力;局部动态滤波层将特征图转化为空间特定的动态滤波算子,对图像特征进行空间特定卷积操作,以应对空间特定退化。通过有效融合全局与局部动态滤波算子,该方法在合成及真实图像数据集上均显著优于当前最先进的盲超分辨率算法。
原文摘要 · Abstract (English)
Prior methodologies have disregarded the diversities among distinct degradation types during image reconstruction, employing a uniform network model to handle multiple deteriorations. Nevertheless, we discover that prevalent degradation modalities, including sampling, blurring, and noise, can be roughly categorized into two classes. We classify the first class as spatial-agnostic dominant degradations, less affected by regional changes in image space, such as downsampling and noise degradation. The second class degradation type is intimately associated with the spatial position of the image, such as blurring, and we identify them as spatial-specific dominant degradations. We introduce a dynamic filter network integrating global and local branches to address these two degradation types. This network can greatly alleviate the practical degradation problem. Specifically, the global dynamic filtering layer can perceive the spatial-agnostic dominant degradation in different images by applying weights generated by the attention mechanism to multiple parallel standard convolution kernels, enhancing the network's representation ability. Meanwhile, the local dynamic filtering layer converts feature maps of the image into a spatially specific dynamic filtering operator, which performs spatially specific convolution operations on the image features to handle spatial-specific dominant degradations. By effectively integrating both global and local dynamic filtering operators, our proposed method outperforms state-of-the-art blind super-resolution algorithms in both synthetic and real image datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。