提出双向融合变压器,提升无人机目标跟踪精度与鲁棒性。
Target-aware Bidirectional Fusion Transformer for Aerial Object Tracking
- 双向融合网络结合浅层细节与深层语义特征
- 目标感知位置编码增强物体属性识别能力
- 在嵌入式平台达30.5帧/秒,适合实际部署
基于轻量级神经网络的跟踪器在航空遥感领域取得显著进展,普遍通过聚合多阶段深层特征提升跟踪质量。然而,现有方法通常仅生成单阶段融合特征进行状态决策,忽略了识别与定位所需的不同特征类型,限制了跟踪的鲁棒性与精度。本文提出一种新型目标感知双向融合变压器(BFTrans),用于无人机跟踪。首先设计基于线性自注意力与交叉注意力的双流融合网络,可从正向与反向方向融合浅层与深层特征,分别提供调整后的局部细节以支持定位、全局语义以支持识别。此外,引入目标感知位置编码策略,帮助在融合阶段感知物体相关属性。最后,在UAV-123、UAV20L和UAVTrack112等多个主流无人机基准上评估所提方法。大量实验结果表明,该方法优于现有先进跟踪器,并可在嵌入式平台以平均30.5帧/秒的速度运行,适用于实际无人机部署。
原文摘要 · Abstract (English)
The trackers based on lightweight neural networks have achieved great success in the field of aerial remote sensing, most of which aggregate multi-stage deep features to lift the tracking quality. However, existing algorithms usually only generate single-stage fusion features for state decision, which ignore that diverse kinds of features are required for identifying and locating the object, limiting the robustness and precision of tracking. In this paper, we propose a novel target-aware Bidirectional Fusion transformer (BFTrans) for UAV tracking. Specifically, we first present a two-stream fusion network based on linear self and cross attentions, which can combine the shallow and the deep features from both forward and backward directions, providing the adjusted local details for location and global semantics for recognition. Besides, a target-aware positional encoding strategy is designed for the above fusion model, which is helpful to perceive the object-related attributes during the fusion phase. Finally, the proposed method is evaluated on several popular UAV benchmarks, including UAV-123, UAV20L and UAVTrack112. Massive experimental results demonstrate that our approach can exceed other state-of-the-art trackers and run with an average speed of 30.5 FPS on embedded platform, which is appropriate for practical drone deployments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。