arXiv:2601.07310cs.CV2026-01被引 2

不同数据规模下,注意力模块的顺序和结构影响性能,有据可依。

Revisiting the Ordering of Channel and Spatial Attention: A Comprehensive Study on Sequential and Parallel Designs

  • 统一框架对比18种注意力组合,分序列、并行、多尺度、残差四类
  • 小样本用通道-多尺度空间串联,大样本用动态门控并行结构最佳
  • 空间-通道顺序更稳定,残差连接缓解梯度消失问题

注意力机制已成为深度学习的核心组件,通道注意力与空间注意力是最具代表性的两类架构。当前关于二者融合策略的研究主要分为串行与并行两种范式,但选择仍以经验为主,缺乏系统分析与统一原则。本文在统一框架下系统比较通道-空间注意力组合,构建包含18种拓扑结构的评估套件,涵盖四类:串行、并行、多尺度、残差。在两个视觉数据集和九个医学数据集上,发现“数据规模-方法-性能”耦合规律:(1) 小样本任务中,“通道-多尺度空间”级联结构表现最优;(2) 中等规模任务中,并行可学习融合架构效果更佳;(3) 大规模任务中,并行结构结合动态门控取得最佳性能。实验还表明,“空间-通道”顺序在细粒度分类中更稳定高效,残差连接能有效缓解不同数据规模下的梯度消失问题。据此提出面向场景的注意力模块构建指南。代码已开源:https://github.com/DWlzm。

原文摘要 · Abstract (English)

Attention mechanisms have become a core component of deep learning models, with Channel Attention and Spatial Attention being the two most representative architectures. Current research on their fusion strategies primarily bifurcates into sequential and parallel paradigms, yet the selection process remains largely empirical, lacking systematic analysis and unified principles. We systematically compare channel-spatial attention combinations under a unified framework, building an evaluation suite of 18 topologies across four classes: sequential, parallel, multi-scale, and residual. Across two vision and nine medical datasets, we uncover a "data scale-method-performance" coupling law: (1) in few-shot tasks, the "Channel-Multi-scale Spatial" cascaded structure achieves optimal performance; (2) in medium-scale tasks, parallel learnable fusion architectures demonstrate superior results; (3) in large-scale tasks, parallel structures with dynamic gating yield the best performance. Additionally, experiments indicate that the "Spatial-Channel" order is more stable and effective for fine-grained classification, while residual connections mitigate vanishing gradient problems across varying data scales. We thus propose scenario-based guidelines for building future attention modules. Code is open-sourced at https://github.com/DWlzm.

注意力机制视觉模型医学图像架构设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。