arXiv:2506.20381cs.CVcs.LG2025-06IJCV被引 5

轻量级视觉追踪模型,兼顾速度与精度,适配边缘设备。

Exploiting Lightweight Hierarchical ViT and Dynamic Framework for Efficient Visual Tracking

  • 引入桥接模块与双图像位置编码,提升特征表示质量。
  • 最快达111帧/秒,LaSOT上AUC达62.4%,超越以往高效追踪器。
  • 动态路由可自适应场景复杂度,适合资源受限的实时应用。

基于Transformer的视觉追踪器虽具备强大建模能力,但在资源受限设备上因处理速度慢而实用性受限。为此,本文提出HiT系列高效追踪模型,在多种设备上实现高精度与高速运行。其核心创新在于桥接模块,连接轻量Transformer与追踪框架,增强特征表示;同时采用双图像位置编码有效捕捉空间信息。HiT在NVIDIA Jetson AGX平台实现61帧/秒的速率,且在LaSOT基准上取得64.6%的AUC,优于所有先前高效追踪器。在此基础上,提出DyHiT动态追踪器,通过骨干网络提取的搜索区域特征输入高效动态路由器进行场景分类,并采用分治策略选择不同计算路径,实现精度与速度的平衡。DyHiT最快速版本在相同平台上达到111帧/秒,保持62.4%的LaSOT AUC。此外,提出一种无需训练的加速方法,基于DyHiT的动态路由结构,显著提升多种高性能追踪器的执行速度。例如,该方法使SOTA追踪器SeqTrack-B256在RTX 2080 Ti GPU上提速2.68倍,同时保持69.9%的LaSOT AUC,无精度损失。

原文摘要 · Abstract (English)

Transformer-based visual trackers have demonstrated significant advancements due to their powerful modeling capabilities. However, their practicality is limited on resource-constrained devices because of their slow processing speeds. To address this challenge, we present HiT, a novel family of efficient tracking models that achieve high performance while maintaining fast operation across various devices. The core innovation of HiT lies in its Bridge Module, which connects lightweight transformers to the tracking framework, enhancing feature representation quality. Additionally, we introduce a dual-image position encoding approach to effectively encode spatial information. HiT achieves an impressive speed of 61 frames per second (fps) on the NVIDIA Jetson AGX platform, alongside a competitive AUC of 64.6% on the LaSOT benchmark, outperforming all previous efficient trackers.Building on HiT, we propose DyHiT, an efficient dynamic tracker that flexibly adapts to scene complexity by selecting routes with varying computational requirements. DyHiT uses search area features extracted by the backbone network and inputs them into an efficient dynamic router to classify tracking scenarios. Based on the classification, DyHiT applies a divide-and-conquer strategy, selecting appropriate routes to achieve a superior trade-off between accuracy and speed. The fastest version of DyHiT achieves 111 fps on NVIDIA Jetson AGX while maintaining an AUC of 62.4% on LaSOT.Furthermore, we introduce a training-free acceleration method based on the dynamic routing architecture of DyHiT. This method significantly improves the execution speed of various high-performance trackers without sacrificing accuracy. For instance, our acceleration method enables the state-of-the-art tracker SeqTrack-B256 to achieve a 2.68 times speedup on an NVIDIA GeForce RTX 2080 Ti GPU while maintaining the same AUC of 69.9% on the LaSOT.

视觉追踪轻量化动态路由边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。