提出SAAT模型,提升图像超分辨率中通道与空间信息的协同利用。
SAAT: Synergistic Alternating Aggregation Transformer for Image Super-Resolution
- 设计通道与窗口、空间与窗口双协同注意力模块,融合多维特征
- 在相同参数量下达到当前最优性能,视觉效果更佳
- 适合追求高细节还原的图像重建任务
单图超分辨率旨在将低分辨率图像恢复为高分辨率图像。现有基于Transformer的方法虽能捕捉长程依赖,但通常采用非重叠窗口计算自注意力以降低开销,仅关注最终输出,忽视了跨通道信息及中间过程中的丰富空间结构。虽然通道注意力和空间注意力分别在提取特征依赖和空间结构方面表现优异,但两者间的协同关系尚未充分探索。为此,本文提出新型模型Synergistic Alternating Aggregation Transformer (SAAT),更好挖掘特征潜在信息。SAAT引入高效通道与窗口协同注意力组(CWSAG)和空间与窗口协同注意力组(SWSAG)。CWSAG结合高效通道注意力与移位窗口注意力,增强非局部特征融合,生成更自然的视觉结果;SWSAG利用空间注意力捕获丰富结构特征,提升结构信息提取能力。大量实验与消融研究验证了SAAT的有效性,在相同参数量下性能媲美当前最优方法。
原文摘要 · Abstract (English)
Single image super-resolution is a well-known downstream task which aims to restore low-resolution images into high-resolution images. At present, models based on Transformers have shone brightly in the field of super-resolution due to their ability to capture long-term dependencies in information. However, current methods typically compute self-attention in nonoverlapping windows to save computational costs, and the standard self-attention computation only focuses on its results, thereby neglecting the useful information across channels and the rich spatial structural information generated in the intermediate process. Channel attention and spatial attention have, respectively, brought significant improvements to various downstream visual tasks in terms of extracting feature dependency and spatial structure relationships, but the synergistic relationship between channel and spatial attention has not been fully explored yet.To address these issues, we propose a novel model. Synergistic Alternating Aggregation Transformer (SAAT), which can better utilize the potential information of features. In SAAT, we introduce the Efficient Channel & Window Synergistic Attention Group (CWSAG) and the Spatial & Window Synergistic Attention Group (SWSAG). On the one hand, CWSAG combines efficient channel attention with shifted window attention, enhancing non-local feature fusion, and producing more visually appealing results. On the other hand, SWSAG leverages spatial attention to capture rich structured feature information, thereby enabling SAAT to more effectively extract structural features.Extensive experimental results and ablation studies demonstrate the effectiveness of SAAT in the field of super-resolution. SAAT achieves performance comparable to that of the state-of-the-art (SOTA) under the same quantity of parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。