arXiv:2503.00516cs.CV2025-03AAAI被引 46

提出新型异步孪生网络,提升轻量级视觉追踪效率与精度

Two-stream Beats One-stream: Asymmetric Siamese Network for Efficient Visual Tracking

  • 分离模板与搜索流,初始化后仅计算一次模板
  • 实现单向特征调制,提升追踪准确率至60.8% AUC
  • 适合边缘设备部署,速度比当前最优快且精度更高

高效追踪在资源受限平台上的实时部署受到广泛关注。现有高效追踪器多沿用以精度为导向的单流框架,采用轻量化模块,但盲目遵循单流范式可能导致冗余计算,且模板与搜索区域间的频繁语义交互对边缘设备构成压力。本文提出一种新型非对称孪生追踪器 AsymTrack,将模板与搜索流解耦为独立分支,模板仅在初始化时计算一次,生成调制信号。在此架构基础上,设计了一种高效的模板调制机制,单向注入关键线索至搜索特征,并引入对象感知增强模块,融合抽象语义与局部细节,弥补轻量级追踪器表征能力不足。大量实验表明,AsymTrack 在不同平台下均展现出更优的速度-精度权衡。例如,AsymTrack-T 在 LaSOT 上达到 60.8% AUC,GPU/CPU/AGX 平台分别实现 224/81/84 FPS,相较 HiT-Tiny 提升 6.0% AUC 且运行更快。

原文摘要 · Abstract (English)

Efficient tracking has garnered attention for its ability to operate on resource-constrained platforms for real-world deployment beyond desktop GPUs. Current efficient trackers mainly follow precision-oriented trackers, adopting a one-stream framework with lightweight modules. However, blindly adhering to the one-stream paradigm may not be optimal, as incorporating template computation in every frame leads to redundancy, and pervasive semantic interaction between template and search region places stress on edge devices. In this work, we propose a novel asymmetric Siamese tracker named \textbf{AsymTrack} for efficient tracking. AsymTrack disentangles template and search streams into separate branches, with template computing only once during initialization to generate modulation signals. Building on this architecture, we devise an efficient template modulation mechanism to unidirectional inject crucial cues into the search features, and design an object perception enhancement module that integrates abstract semantics and local details to overcome the limited representation in lightweight tracker. Extensive experiments demonstrate that AsymTrack offers superior speed-precision trade-offs across different platforms compared to the current state-of-the-arts. For instance, AsymTrack-T achieves 60.8\% AUC on LaSOT and 224/81/84 FPS on GPU/CPU/AGX, surpassing HiT-Tiny by 6.0\% AUC with higher speeds. The code is available at https://github.com/jiawen-zhu/AsymTrack.

视觉追踪轻量级模型边缘计算孪生网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。