提出轻量级模块STEAM,同时增强通道与空间注意力。
STEAM: Squeeze and Transform Enhanced Attention Module
- 基于图关系建模,统一建模通道与空间注意力
- 比ResNet-50高2%准确率,计算开销微增
- 相比ECA/GCT精度更高、耗时降低三倍
早期的通道与空间注意力机制虽提升了深度卷积神经网络的表征能力,但常伴随参数和计算成本上升。现有方法多聚焦于高效通道注意力建模,而本文旨在以极少参数和更低计算量,全面建模通道与空间注意力。受图关系建模启发,提出恒定参数模块STEAM(Squeeze and Transform Enhanced Attention Module),融合通道与空间注意力以增强CNN表示能力。据我们所知,这是首个采用图基方法建模双重视觉注意力的工作,借鉴多头图变压器思想。此外,提出输出引导池化(Output Guided Pooling, OGP),高效捕捉空间上下文以强化空间注意力。在大规模图像分类、目标检测与实例分割标准数据集上广泛评估。STEAM相较标准ResNet-50提升2%准确率,仅小幅增加GFLOPs;优于领先模块ECA与GCT,在精度上更优且计算量降低三倍。代码将在录用后公开。
原文摘要 · Abstract (English)
Channel and spatial attention mechanisms introduced in earlier work enhance the representational capabilities of deep convolutional neural networks (CNNs) but often increase parameter and computational costs. While recent approaches focus solely on efficient feature context modeling for channel attention, we aim to model both channel and spatial attention comprehensively with minimal parameters and reduced computation. Leveraging the principles of relational modeling in graphs, we introduce a constant-parameter module, \textit{STEAM: Squeeze and Transform Enhanced Attention Module}, which integrates channel and spatial attention to enhance the representation power of CNNs. To our knowledge, we are the first to propose a graph-based approach for modeling both channel and spatial attention, utilizing concepts from multi-head graph transformers. Additionally, we introduce \textit{Output Guided Pooling} (OGP), which efficiently captures spatial context to further enhance spatial attention. We extensively evaluate STEAM for large-scale image classification, object detection and instance segmentation on standard benchmark datasets. STEAM achieves a \(2\%\) increase in accuracy over the standard ResNet-50 model with only a meager increase in GFLOPs. Furthermore, STEAM outperforms the leading modules, ECA and GCT, in terms of accuracy while achieving a threefold reduction in GFLOPs. The code will be made available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。