arXiv:2511.19928cs.CV2025-11

通过智能剪枝与选择性注意力提升Transformer跟踪精度。

Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Tracking

  • 动态评估搜索区令牌关联目标概率,保留关键上下文。
  • 早期层屏蔽背景注意力,后期仅让高概率目标令牌参与计算。
  • 在GOT-10k上达到75.1%平均重叠率,适合高精度视觉跟踪场景。

单流Transformer跟踪器通过拼接模板与搜索区域令牌实现全局注意力,但大量背景搜索令牌与目标模板交互会削弱判别能力。现有剪枝方法常误删目标附近令牌,导致上下文信息丢失。此外,搜索区中的干扰项进一步降低定位准确性。为此,提出CPDATrack框架:在两个编码层间引入可学习模块,估算每个搜索令牌与目标的关联概率,剔除低信息量背景令牌并保留目标周围上下文。为抑制背景干扰,采用判别性选择注意力机制——早期层完全阻断搜索到模板的注意力;后续层仅从局部区域提取高概率目标令牌与模板交互,减少背景和干扰项影响。该方法在多个基准上达到顶尖性能,尤其在GOT-10k上实现75.1%的平均重叠率。

原文摘要 · Abstract (English)

One-stream Transformer-based trackers have demonstrated remarkable performance by concatenating template and search region tokens, thereby enabling joint attention across all tokens. However, enabling an excessive proportion of background search tokens to attend to the target template tokens weakens the tracker's discriminative capability. Several token pruning methods have been proposed to mitigate background interference; however, they often remove tokens near the target, leading to the loss of essential contextual information and degraded tracking performance. Moreover, the presence of distractors within the search tokens further reduces the tracker's ability to accurately identify the target. To address these limitations, we propose CPDATrack, a novel tracking framework designed to suppress interference from background and distractor tokens while enhancing computational efficiency. First, a learnable module is integrated between two designated encoder layers to estimate the probability of each search token being associated with the target. Based on these estimates, less-informative background tokens are pruned from the search region while preserving the contextual cues surrounding the target. To further suppress background interference, a discriminative selective attention mechanism is employed that fully blocks search-to-template attention in the early layers. In the subsequent encoder layers, high-probability target tokens are selectively extracted from a localized region to attend to the template tokens, thereby reducing the influence of background and distractor tokens. The proposed CPDATrack achieves state-of-the-art performance across multiple benchmarks, particularly on GOT-10k, where it attains an average overlap of 75.1 percent.

目标跟踪Transformer注意力机制剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。