提出PBAN模型,让AI更像人眼评估超分图像质量。
Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment
- 用双向注意力模拟人眼感知失真,提升评估精度。
- 在5个基准数据集上超越现有方法,最高提升2.3%(PLCC)。
- 适合图像超分辨率算法研发者与质量评估研究人员使用。
许多超分辨率(SR)算法被提出以提升图像分辨率,但用于对比和评估不同SR算法的全参考(FR)图像质量评估(IQA)指标仍有限。本文提出感知导向的双向注意力网络(PBAN)用于图像超分的全参考质量评估,包含三个模块:图像编码模块、感知导向双向注意力(PBA)模块和质量预测模块。首先对输入图像进行特征编码;受人类视觉系统特性启发,设计了新型双向注意力机制,双向构建对失真的视觉注意力,符合SR图像生成与评价过程。为更精准捕捉失真信息,引入分组多尺度可变形卷积,实现自适应失真感知;同时设计子信息激励卷积,引导注意力关注子像素与子通道层级。最后通过质量预测模块整合感知特征并回归质量分数。大量实验表明,所提PBAN优于当前最先进方法。
原文摘要 · Abstract (English)
Many super-resolution (SR) algorithms have been proposed to increase image resolution. However, full-reference (FR) image quality assessment (IQA) metrics for comparing and evaluating different SR algorithms are limited. In this work, we propose the Perception-oriented Bidirectional Attention Network (PBAN) for image SR FR-IQA, which is composed of three modules: an image encoder module, a perception-oriented bidirectional attention (PBA) module, and a quality prediction module. First, we encode the input images for feature representations. Inspired by the characteristics of the human visual system, we then construct the perception-oriented PBA module. Specifically, different from existing attention-based SR IQA methods, we conceive a Bidirectional Attention to bidirectionally construct visual attention to distortion, which is consistent with the generation and evaluation processes of SR images. To further guide the quality assessment towards the perception of distorted information, we propose Grouped Multi-scale Deformable Convolution, enabling the proposed method to adaptively perceive distortion. Moreover, we design Sub-information Excitation Convolution to direct visual perception to both sub-pixel and sub-channel attention. Finally, the quality prediction module is exploited to integrate quality-aware features and regress quality scores. Extensive experiments demonstrate that our proposed PBAN outperforms state-of-the-art quality assessment methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。