提升无人机追踪的语义感知能力,增强复杂场景下的定位准确性。
Dynamic Semantic-Aware Correlation Modeling for UAV Tracking
- 动态语义相关性生成器结合Transformer特征图,捕捉模板与搜索区域的语义关联。
- 在典型挑战下(如快速运动、低分辨率)实现更优追踪精度,优于现有方法。
- 支持多版本模型灵活部署,适合不同算力条件的应用场景。
无人机追踪广泛应用于灾害救援、环境监测和物流运输等场景。然而,现有方法主要关注速度,缺乏语义感知能力,导致搜索区域难以从模板中提取精准定位信息,从而在相机运动、快速运动和低分辨率等典型挑战下表现不佳。为此,我们提出一种动态语义感知相关性建模追踪框架。其核心是动态语义相关性生成器,结合Transformer生成的相关图,挖掘模板与搜索区域间的语义关联,增强搜索区域对关键信息的提取能力,显著提升在上述挑战下的追踪准确性和鲁棒性。此外,为提升追踪速度,设计了适配该框架的剪枝方法,实现多个速度-精度权衡的模型变体,支持根据计算资源灵活部署。实验结果验证了方法的有效性,在多个无人机追踪数据集上取得具有竞争力的性能。代码已公开于 https://github.com/zxyyxzz/DSATrack。
原文摘要 · Abstract (English)
UAV tracking can be widely applied in scenarios such as disaster rescue, environmental monitoring, and logistics transportation. However, existing UAV tracking methods predominantly emphasize speed and lack exploration in semantic awareness, which hinders the search region from extracting accurate localization information from the template. The limitation results in suboptimal performance under typical UAV tracking challenges such as camera motion, fast motion, and low resolution, etc. To address this issue, we propose a dynamic semantic aware correlation modeling tracking framework. The core of our framework is a Dynamic Semantic Relevance Generator, which, in combination with the correlation map from the Transformer, explore semantic relevance. The approach enhances the search region's ability to extract important information from the template, improving accuracy and robustness under the aforementioned challenges. Additionally, to enhance the tracking speed, we design a pruning method for the proposed framework. Therefore, we present multiple model variants that achieve trade-offs between speed and accuracy, enabling flexible deployment according to the available computational resources. Experimental results validate the effectiveness of our method, achieving competitive performance on multiple UAV tracking datasets. The code is available at https://github.com/zxyyxzz/DSATrack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。