提出轻量级图像超分辨率网络,提升细节还原与计算效率。
Efficient Star Distillation Attention Network for Lightweight Image Super-Resolution
- 设计星形信息蒸馏模块,增强高维非线性特征表示能力。
- 引入多形状多尺度注意力机制,低开销捕捉长程依赖关系。
- 适合移动端或边缘设备部署,兼顾性能与推理速度。
近年来,基于卷积神经网络(CNN)和大核注意力(LKA)的轻量级单图像超分辨率(SISR)方法显著提升了性能。然而,现有信息蒸馏模块难以将输入映射至高维非线性(HDNL)特征空间,限制了表征学习能力;同时其LKA模块在捕捉多形状多尺度长程依赖时能力受限,并伴随深度可分离卷积核尺寸增大导致计算开销呈二次增长。为此,本文首次提出星形蒸馏模块(SDM),通过在HDNL特征空间中进行信息蒸馏,增强判别性表征学习。此外,提出多形状多尺度大核注意力(MM-LKA)模块,以低计算与内存开销实现代表性长程依赖建模,显著提升基于CNN的自注意力性能。将SDM与MM-LKA集成,构建残差星形蒸馏注意力模块(RSDAM),并以此为基石构建高效的星形蒸馏注意力网络(SDAN),能高效重建高质量图像。大量实验表明,相比其他轻量级SISR先进方法,所提SDAN在模型复杂度低的前提下,实现了更优的定量与视觉表现。
原文摘要 · Abstract (English)
In recent years, the performance of lightweight Single-Image Super-Resolution (SISR) has been improved significantly with the application of Convolutional Neural Networks (CNNs) and Large Kernel Attention (LKA). However, existing information distillation modules for lightweight SISR struggle to map inputs into High-Dimensional Non-Linear (HDNL) feature spaces, limiting their representation learning. And their LKA modules possess restricted ability to capture the multi-shape multi-scale information for long-range dependencies while encountering a quadratic increase in the computational burden with increasing convolutional kernel size of its depth-wise convolutional layer. To address these issues, we firstly propose a Star Distillation Module (SDM) to enhance the discriminative representation learning via information distillation in the HDNL feature spaces. Besides, we present a Multi-shape Multi-scale Large Kernel Attention (MM-LKA) module to learn representative long-range dependencies while incurring low computational and memory footprints, leading to improving the performance of CNN-based self-attention significantly. Integrating SDM and MM-LKA, we develop a Residual Star Distillation Attention Module (RSDAM) and take it as the building block of the proposed efficient Star Distillation Attention Network (SDAN) which possesses high reconstruction efficiency to recover a higher-quality image from the corresponding low-resolution (LR) counterpart. When compared with other lightweight state-of-the-art SISR methods, extensive experiments show that our SDAN with low model complexity yields superior performance quantitatively and visually.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。