arXiv:2411.09604cs.CVcs.AI2024-11被引 14

提出自适应融合局部与全局特征的注意力机制,提升多尺度目标检测精度。

Local-Global Attention: An Adaptive Mechanism for Multi-Scale Feature Integration

  • 结合多尺度卷积与位置编码,动态聚焦局部细节与全局上下文。
  • 在多类及小目标检测任务中显著提升性能,优于现有注意力方法。
  • 可学习参数实现局部与全局注意力的自适应权衡,适合复杂检测场景。

近年来,注意力机制通过聚焦关键特征信息显著提升了目标检测性能。然而,现有方法在有效平衡局部与全局特征方面仍存在困难,限制了对细粒度细节和更广泛上下文信息的捕捉能力,而这二者对准确的目标检测至关重要。为此,我们提出一种新型注意力机制——局部-全局注意力(Local-Global Attention),旨在更好融合局部与全局上下文特征。具体而言,该方法结合多尺度卷积与位置编码,使模型既能关注局部细节,又能兼顾全局上下文。此外,引入可学习参数,使模型能根据任务需求动态调整局部与全局注意力的相对重要性,从而优化多尺度特征表示。我们在多个广泛应用的目标检测与分类数据集上进行了全面评估。实验结果表明,该方法显著提升了不同尺度目标的检测能力,尤其在多类别和小目标检测任务中表现突出。相较于现有注意力机制,局部-全局注意力在多个关键指标上持续领先,同时保持计算效率。

原文摘要 · Abstract (English)

In recent years, attention mechanisms have significantly enhanced the performance of object detection by focusing on key feature information. However, prevalent methods still encounter difficulties in effectively balancing local and global features. This imbalance hampers their ability to capture both fine-grained details and broader contextual information-two critical elements for achieving accurate object detection.To address these challenges, we propose a novel attention mechanism, termed Local-Global Attention, which is designed to better integrate both local and global contextual features. Specifically, our approach combines multi-scale convolutions with positional encoding, enabling the model to focus on local details while concurrently considering the broader global context. Additionally, we introduce a learnable parameters, which allow the model to dynamically adjust the relative importance of local and global attention, depending on the specific requirements of the task, thereby optimizing feature representations across multiple scales.We have thoroughly evaluated the Local-Global Attention mechanism on several widely used object detection and classification datasets. Our experimental results demonstrate that this approach significantly enhances the detection of objects at various scales, with particularly strong performance on multi-class and small object detection tasks. In comparison to existing attention mechanisms, Local-Global Attention consistently outperforms them across several key metrics, all while maintaining computational efficiency.

注意力机制目标检测多尺度特征自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。