arXiv:2608.24365cs.CV2026-08中稿 · paper

提出轻量级稀疏跟踪框架MaST,让实时追踪更快更准。

MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking

论文配图:MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking
图 1 · 摘自论文原文
  • 引入运动先验优化注意力权重,提前稳定剪枝
  • 新设计稀疏预测头,直接处理不规则保留特征
  • 在边缘设备上达152帧/秒,精度超现有方法

基于Transformer的追踪器性能优异,但密集令牌处理导致计算开销大,难以在边缘设备实时运行。现有稀疏化方法常因早期注意力分数噪声而效果不佳,且最终仍需密集重构以适配预测头,削弱了节省效果。本文提出运动感知稀疏追踪器(MaST),从令牌到框全程实现稀疏化:首先注入轻量运动先验,提升跨注意力重要性评分稳定性,实现更早更可靠的令牌裁剪;其次设计原生稀疏预测头,采用‘先评分、再回归’策略,直接处理非结构化保留令牌,避免密集填充与重构,显著减少冗余计算。在多个基准测试中,MaST成为轻量级追踪器新标杆——MaST-tiny在LaSOT上达到63.8 AUC,TrackingNet上达80.1 SUC,分别优于先前最优的AsymTrack-S +1.0 AUC和+2.2 SUC,且在Jetson Nano上运行速度达152 FPS,接近AsymTrack-S(88 FPS)的两倍。代码已开源。

原文摘要 · Abstract (English)

Transformer-based object trackers are renowned for their strong performance, yet dense token processing often leads to prohibitive computational cost, limiting real-time deployment on edge devices. While recent works explore token pruning to reduce computation, they often stop short of an end-to-end sparse pipeline, as early-layer token scores can be noisy without a motion prior, and many trackers ultimately fall back to dense reshaping to feed the dense prediction head that partially negates the savings. We introduce Motion-aware Sparse Tracker (MaST), a sparse tracking framework that makes sparsity effective from tokens to boxes. First, MaST injects a lightweight motion prior to refine cross-attention-based importance scores, enabling earlier and more stable token reduction in the search region. Second, we introduce a natively sparse prediction head that operates directly on the retained unstructured tokens with a score-first, regress-once design, eliminating dense padding/reshaping and reducing redundant computation. Extensive experiments on multiple benchmarks demonstrate that MaST establishes new state of the art among lightweight trackers, where MaST-tiny attains 63.8 AUC on LaSOT and 80.1 SUC on TrackingNet, surpassing the prior best AsymTrack-S by +1.0 AUC and +2.2 SUC while running at 152 FPS on Jetson Nano, nearly twice as fast as AsymTrack-S at 88 FPS. Code is available at https://github.com/TsingWei/MaST.

目标追踪稀疏计算边缘部署Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。