arXiv:2605.08329cs.CVeess.IV2026-05中稿 · CVPR被引 1

通过动态压缩模板帧特征,提升视觉追踪效率与精度。

An Efficient Token Compression Framework for Visual Object Tracking

论文配图:An Efficient Token Compression Framework for Visual Object Tracking
图 1 · 摘自论文原文
  • 用自适应压缩器剔除冗余视觉令牌,生成紧凑特征
  • 在7个基准上优于当前最优模型,模板令牌减少60%
  • 适合追求高效高精度追踪的工业应用

通过消除内部特征冗余来优化视觉表示,对同时提升模型性能与计算效率至关重要。当前基于Transformer的追踪器常采用更多历史模板帧以捕捉丰富的时空线索,但导致输入视觉令牌数量剧增,带来二次计算开销并可能降低整体性能。为此,我们提出一种压缩-交互追踪框架ETCTrack,学习将历史模板帧的令牌高效压缩为鲁棒的目标表示,突破人工规则限制。首先使用自适应令牌压缩器动态构建紧凑且高度区分性的模板令牌,过滤冗余信息;随后通过分层交互编码器与搜索区域特征进行深度自适应交互,优化搜索特征以实现精准定位。在七个基准上的实验表明,该方法超越现有最先进追踪器。ETCTrack-B224使模板令牌数量减少60%,计算量(MACs)降低21.4%,准确率仅下降0.4%。代码已开源。

原文摘要 · Abstract (English)

Refining visual representations by eliminating their internal feature-level redundancy is crucial for simultaneously optimizing the performance and computational cost of models in visual tracking. To enhance their performance, many contemporary Transformer-based trackers leverage a larger number of historical template frames to capture richer spatio-temporal cues. However, this strategy leads to a massive number of input visual tokens. This creates two critical issues: it imposes a quadratic computational burden and can also degrade the tracker's overall performance. To bridge this gap, we propose a compress-then-interact tracking framework, ETCTrack, that learns to efficiently compress template tokens from historical template frames into a robust target representation, moving beyond handcrafted rules. Our method first employs the Adaptive Token Compressor to dynamically construct compact yet highly discriminative template tokens by filtering out redundant visual tokens. These refined template tokens are then processed by our Hierarchical Interaction Encoder to achieve a deep, adaptive interaction with the search features. Refined search features ensure subsequent precise target localization. Experiments on seven benchmarks demonstrate that our method outperforms current state-of-the-art trackers. ETCTrack-B224 reduces the number of template tokens by 60%, leading to a 21.4% reduction in MACs with only a 0.4% drop in accuracy. The source code are available at https://github.com/PJD-WJ/ETCTrack.

视觉追踪Transformer令牌压缩高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。