arXiv:2602.23734cs.CVcs.CL2026-02中稿 · CVPR被引 4

统一剪枝视觉追踪三组件,效率提升超65%且精度几乎不降。

UTPTrack: Towards Simple and Unified Token Pruning for Visual Tracking

  • 首次联合剪枝搜索区、动态模板和静态模板,考虑组件间依赖。
  • 在RGB追踪中剪枝65.4%视觉令牌,性能保留99.7%;多模态下剪枝67.5%,性能反超100.5%。
  • 设计简洁通用,支持多模态与语言引导任务,适合高效追踪研究者。

单流Transformer追踪器在视觉目标追踪中表现先进,但计算开销大,难以实时部署。虽然令牌剪枝可提升效率,现有方法通常孤立地剪枝搜索区域、动态模板和静态模板,忽略关键组件间的依赖关系,导致剪枝效果不佳且精度下降。为此,我们提出UTPTrack,首个统一的令牌剪枝框架,首次联合压缩三类组件。UTPTrack采用注意力引导、类型感知的策略,整体建模冗余,设计可无缝支持单一模型下的多模态与语言引导追踪任务。在10个基准上的大量实验表明,UTPTrack在剪枝型追踪器中达到新的准确率-效率平衡:在基于RGB的追踪中剪枝65.4%的视觉令牌,性能保留99.7%;在统一追踪中剪枝67.5%,性能反而提升至100.5%。该表现证明其在多模态场景下的鲁棒性,有望成为未来高效视觉追踪研究的坚实基础。代码将发布于https://github.com/EIT-NLP/UTPTrack。

原文摘要 · Abstract (English)

One-stream Transformer-based trackers achieve advanced performance in visual object tracking but suffer from significant computational overhead that hinders real-time deployment. While token pruning offers a path to efficiency, existing methods are fragmented. They typically prune the search region, dynamic template, and static template in isolation, overlooking critical inter-component dependencies, which yields suboptimal pruning and degraded accuracy. To address this, we introduce UTPTrack, a simple and Unified Token Pruning framework that, for the first time, jointly compresses all three components. UTPTrack employs an attention-guided, token type-aware strategy to holistically model redundancy, a design that seamlessly supports unified tracking across multimodal and language-guided tasks within a single model. Extensive evaluations on 10 benchmarks demonstrate that UTPTrack achieves a new state-of-the-art in the accuracy-efficiency trade-off for pruning-based trackers, pruning 65.4% of vision tokens in RGB-based tracking and 67.5% in unified tracking while preserving 99.7% and 100.5% of baseline performance, respectively. This strong performance across both RGB and multimodal scenarios underlines its potential as a robust foundation for future research in efficient visual tracking. Code will be released at https://github.com/EIT-NLP/UTPTrack.

视觉追踪令牌剪枝Transformer效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。