通过跨层桥接注意力提升模型信息流,显著增强图像分类性能。
BA-Net: Bridge Attention in Deep Neural Networks
- 设计跨层桥接注意力机制,优化多层间信息交互
- 在ResNet50/101上分别达到80.49%和81.75%准确率
- 适用于各类视觉模型,通用性强
注意力机制,尤其是通道注意力,在众多计算机视觉任务中影响深远。尽管效果显著,现有方法多聚焦于在单个卷积层引入复杂注意力模块以提升性能,常忽视多层间的协同作用。为此,我们提出桥接注意力(Bridge Attention),旨在增强不同卷积层之间的有效整合与信息流动。在此基础上,我们改进原始模型(BAv1)并引入自适应选择算子,减少信息冗余,优化整体信息交换,形成BAv2。该模型在ImageNet分类任务中表现优异,使用ResNet50和ResNet101作为骨干网络时,Top-1准确率分别达80.49%和81.75%,超过重训练基线1.61%和0.77%。此外,相较于经典SENet101,BAv2性能高出0.52%。将BAv2集成至先进卷积网络与视觉变压器中,亦在多种计算机视觉任务中带来显著性能提升,彰显其广泛适用性。
原文摘要 · Abstract (English)
Attention mechanisms, particularly channel attention, have become highly influential in numerous computer vision tasks. Despite their effectiveness, many existing methods primarily focus on optimizing performance through complex attention modules applied at individual convolutional layers, often overlooking the synergistic interactions that can occur across multiple layers. In response to this gap, we introduce bridge attention, a novel approach designed to facilitate more effective integration and information flow between different convolutional layers. Our work extends the original bridge attention model (BAv1) by introducing an adaptive selection operator, which reduces information redundancy and optimizes the overall information exchange. This enhancement results in the development of BAv2, which achieves substantial performance improvements in the ImageNet classification task, obtaining Top-1 accuracies of 80.49% and 81.75% when using ResNet50 and ResNet101 as backbone networks, respectively. These results surpass the retrained baselines by 1.61% and 0.77%, respectively. Furthermore, BAv2 outperforms other existing channel attention techniques, such as the classical SENet101, exceeding its retrained performance by 0.52% Additionally, integrating BAv2 into advanced convolutional networks and vision transformers has led to significant gains in performance across a wide range of computer vision tasks, underscoring its broad applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。