提出通用压缩框架CompressTracker,让Transformer跟踪模型更快更小且不丢精度。
General Compression Framework for Efficient Transformer Object Tracking
- 按阶段拆分教师模型,突破结构限制,灵活压缩。
- 学生模型随机替换教师阶段,训练更简单,性能更接近教师。
- 适配任意Transformer架构,适合追求高效跟踪的开发者。
以往方法通过轻量化设计或知识蒸馏提升跟踪效率,但常以牺牲准确率为代价,且训练复杂、结构受限。为此,我们提出通用模型压缩框架CompressTracker,可在保持跟踪精度的同时减小模型规模。该方法创新性地将教师模型的Transformer层划分为不同阶段,打破结构限制;并设计替代训练机制,随机用教师模型的阶段替换学生模型对应部分,增强行为模仿能力,简化训练流程。为强化学生模型对教师模型的模仿,引入预测引导与阶段级特征拟合提供额外监督。CompressTracker结构无关,兼容任意Transformer架构。实验验证其有效性与泛化能力:基于SUTrack压缩的CompressTracker-SUTrack在LaSOT上保留约99%性能(72.2 AUC),同时实现2.42倍加速。代码已开源。
原文摘要 · Abstract (English)
Previous works have attempted to improve tracking efficiency through lightweight architecture design or knowledge distillation from teacher models to compact student trackers. However, these solutions often sacrifice accuracy for speed to a great extent, and also have the problems of complex training process and structural limitations. Thus, we propose a general model compression framework for efficient transformer object tracking, named CompressTracker, to reduce model size while preserving tracking accuracy. Our approach features a novel stage division strategy that segments the transformer layers of the teacher model into distinct stages to break the limitation of model structure. Additionally, we also design a unique replacement training technique that randomly substitutes specific stages in the student model with those from the teacher model, as opposed to training the student model in isolation. Replacement training enhances the student model's ability to replicate the teacher model's behavior and simplifies the training process. To further forcing student model to emulate teacher model, we incorporate prediction guidance and stage-wise feature mimicking to provide additional supervision during the teacher model's compression process. CompressTracker is structurally agnostic, making it compatible with any transformer architecture. We conduct a series of experiment to verify the effectiveness and generalizability of our CompressTracker. Our CompressTracker-SUTrack, compressed from SUTrack, retains about 99 performance on LaSOT (72.2 AUC) while achieves 2.42x speed up. Code is available at https://github.com/LingyiHongfd/CompressTracker.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。