arXiv:2510.14726cs.CV2025-10

提出跨层注意力模块,提升多尺度目标检测精度。

Cross-Layer Feature Self-Attention Module for Multi-Scale Object Detection

  • 设计跨层特征自注意力模块,融合多尺度特征的局部与全局依赖。
  • 在PASCAL VOC上达78.6% mAP(基线75.5%),COCO上达52.1% mAP(基线43.1%)。
  • 无需显著计算开销,加速训练收敛,适合多尺度检测任务。

近期目标检测方法通过注意力机制提升了特征判别力,但多数方法仅聚焦单层或双层特征融合,忽略了多尺度表示间的丰富层间依赖关系,限制了对大尺度变化物体的上下文信息捕捉能力。本文提出一种新型跨层特征自注意力模块(CFSAM),全面建模多尺度特征图中的局部与全局依赖。CFSAM包含三个关键组件:卷积局部特征提取器、基于Transformer的全局建模单元以高效捕获跨层交互,以及特征融合机制恢复并增强原始表示。将其集成至SSD300框架后,性能显著提升:在PASCAL VOC上达到78.6% mAP(基线75.5%),在COCO上达到52.1% mAP(基线43.1%),优于现有注意力模块。此外,该模块在不增加显著计算开销的前提下加速了训练收敛。本工作强调了显式跨层注意力建模在多尺度目标检测中的重要性。

原文摘要 · Abstract (English)

Recent object detection methods have made remarkable progress by leveraging attention mechanisms to improve feature discriminability. However, most existing approaches are confined to refining single-layer or fusing dual-layer features, overlooking the rich inter-layer dependencies across multi-scale representations. This limits their ability to capture comprehensive contextual information essential for detecting objects with large scale variations. In this paper, we propose a novel Cross-Layer Feature Self-Attention Module (CFSAM), which holistically models both local and global dependencies within multi-scale feature maps. CFSAM consists of three key components: a convolutional local feature extractor, a Transformer-based global modeling unit that efficiently captures cross-layer interactions, and a feature fusion mechanism to restore and enhance the original representations. When integrated into the SSD300 framework, CFSAM significantly boosts detection performance, achieving 78.6% mAP on PASCAL VOC (vs. 75.5% baseline) and 52.1% mAP on COCO (vs. 43.1% baseline), outperforming existing attention modules. Moreover, the module accelerates convergence during training without introducing substantial computational overhead. Our work highlights the importance of explicit cross-layer attention modeling in advancing multi-scale object detection.

目标检测注意力机制多尺度Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。