提出多尺度注意力结构,高效提升图像超分辨率质量与速度
MAT: Multi-Range Attention Transformer for Efficient Image Super-Resolution
- 用空洞操作融合不同空间范围的注意力,降低计算开销
- 在Real-ESRGAN数据集上达到34.89dB PSNR,比SRFormer-light快3.3倍
- 适合追求高效率超分辨率的开发者和部署场景
图像超分辨率(SR)因采用Transformer架构而取得显著进展。然而,传统方法通过扩大自注意力窗口以捕捉更广上下文,会带来显著的计算负担。此外,现有模型固定大小窗口内的特征感知限制了有效感受野(ERF)和中间特征多样性。我们证明,灵活整合不同空间尺度的注意力可带来性能显著提升。基于此,我们提出用于SR任务的多范围注意力变换器(MAT)。MAT利用空洞操作的计算优势,结合自注意力机制,实现多范围注意力(MA)与稀疏多范围注意力(SMA),高效捕获局部与稀疏全局特征。结合局部特征提取,MAT能有效捕捉跨多种空间范围的依赖关系,增强特征表示的多样性和有效性。我们还引入MSConvStar模块,进一步提升多范围表征学习能力。大量实验表明,所提MAT在性能上优于现有最先进模型,且效率突出——相比SRFormer-light快约3.3倍。
原文摘要 · Abstract (English)
Image super-resolution (SR) has significantly advanced through the adoption of Transformer architectures. However, conventional techniques aimed at enlarging the self-attention window to capture broader contexts come with inherent drawbacks, especially the significantly increased computational demands. Moreover, the feature perception within a fixed-size window of existing models restricts the effective receptive field (ERF) and the intermediate feature diversity. We demonstrate that a flexible integration of attention across diverse spatial extents can yield significant performance enhancements. In line with this insight, we introduce Multi-Range Attention Transformer (MAT) for SR tasks. MAT leverages the computational advantages inherent in dilation operation, in conjunction with self-attention mechanism, to facilitate both multi-range attention (MA) and sparse multi-range attention (SMA), enabling efficient capture of both regional and sparse global features. Combined with local feature extraction, MAT adeptly capture dependencies across various spatial ranges, improving the diversity and efficacy of its feature representations. We also introduce the MSConvStar module, which augments the model's ability for multi-range representation learning. Comprehensive experiments show that our MAT exhibits superior performance to existing state-of-the-art SR models with remarkable efficiency (~3.3 faster than SRFormer-light).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。