arXiv:2410.09844eess.IVcs.CV2024-10中稿 · Visual Computer被引 9

轻量级图像超分网络,用分离卷积与混合注意力提升效率

HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution

  • 用深度可分离卷积和全连接层简化结构,降低参数量
  • 引入混合注意力块,结合通道与空间注意力提升特征表达
  • 适合资源受限场景,如移动端图像增强

针对单图像超分辨率(SISR)在硬件资源有限下的需求,本文提出轻量级的混合注意力可分离网络(HASN)。通过采用深度可分离卷积与全连接层作为基础特征提取模块,显著减少计算量与参数数量,同时保持强特征提取能力。为提升性能,设计了混合注意力可分离块(HASB),融合通道注意力与空间注意力,利用其互补优势。训练阶段引入热启动重训练策略,进一步挖掘模型潜力。大量实验表明,该方法在保持高性能的同时,实现更小模型尺寸与更低计算复杂度。代码已开源。

原文摘要 · Abstract (English)

Recently, lightweight methods for single image super-resolution (SISR) have gained significant popularity and achieved impressive performance due to limited hardware resources. These methods demonstrate that adopting residual feature distillation is an effective way to enhance performance. However, we find that using residual connections after each block increases the model's storage and computational cost. Therefore, to simplify the network structure and learn higher-level features and relationships between features, we use depthwise separable convolutions, fully connected layers, and activation functions as the basic feature extraction modules. This significantly reduces computational load and the number of parameters while maintaining strong feature extraction capabilities. To further enhance model performance, we propose the Hybrid Attention Separable Block (HASB), which combines channel attention and spatial attention, thus making use of their complementary advantages. Additionally, we use depthwise separable convolutions instead of standard convolutions, significantly reducing the computational load and the number of parameters while maintaining strong feature extraction capabilities. During the training phase, we also adopt a warm-start retraining strategy to exploit the potential of the model further. Extensive experiments demonstrate the effectiveness of our approach. Our method achieves a smaller model size and reduced computational complexity without compromising performance. Code can be available at https://github.com/nathan66666/HASN.git

图像超分轻量模型注意力机制可分离卷积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。