用细粒度特征与显著性引导,提升红外目标追踪精度
FGSGT: Saliency-Guided Siamese Network Tracker Based on Key Fine-Grained Feature Information for Thermal Infrared Target Tracking
- 设计双流卷积块捕捉浅层全局特征,保留细粒度信息
- 多层特征融合用双线性矩阵乘法,提升深层与浅层特征结合
- 显著性损失约束网络聚焦关键判别特征,减少误跟踪
热红外(TIR)图像通常细节少、对比度低,传统特征提取模型难以捕获目标的判别特征,导致跟踪器易受外观相似物体干扰并产生漂移。为此,本文提出一种基于关键细粒度特征的显著性引导孪生网络跟踪器。首先,引入具有双流结构和多尺寸卷积核的细粒度特征并行学习卷积块,从浅层捕获重要全局特征,增强特征多样性,并减少残差连接中细粒度信息的丢失。其次,提出多层细粒度特征融合模块,采用双线性矩阵乘法有效整合深层与浅层特征。接着,设计孪生残差精修块,利用残差学习修正显著性图预测误差,结合深度监督,在每个递归步骤施加监督,逐步提升预测准确性。最后,引入显著性损失函数,约束显著性预测,引导网络聚焦于高判别性细粒度特征。大量实验表明,该跟踪器在PTB-TIR和LSOTB-TIR基准上达到最高精度与成功率;在VOT-TIR 2015和2017基准上分别取得0.78和0.75的最高准确率。
原文摘要 · Abstract (English)
Thermal infrared (TIR) images typically lack detailed features and have low contrast, making it challenging for conventional feature extraction models to capture discriminative target characteristics. As a result, trackers are often affected by interference from visually similar objects and are susceptible to tracking drift. To address these challenges, we propose a novel saliency-guided Siamese network tracker based on key fine-grained feature infor-mation. First, we introduce a fine-grained feature parallel learning convolu-tional block with a dual-stream architecture and convolutional kernels of varying sizes. This design captures essential global features from shallow layers, enhances feature diversity, and minimizes the loss of fine-grained in-formation typically encountered in residual connections. In addition, we propose a multi-layer fine-grained feature fusion module that uses bilinear matrix multiplication to effectively integrate features across both deep and shallow layers. Next, we introduce a Siamese residual refinement block that corrects saliency map prediction errors using residual learning. Combined with deep supervision, this mechanism progressively refines predictions, ap-plying supervision at each recursive step to ensure consistent improvements in accuracy. Finally, we present a saliency loss function to constrain the sali-ency predictions, directing the network to focus on highly discriminative fi-ne-grained features. Extensive experiment results demonstrate that the pro-posed tracker achieves the highest precision and success rates on the PTB-TIR and LSOTB-TIR benchmarks. It also achieves a top accuracy of 0.78 on the VOT-TIR 2015 benchmark and 0.75 on the VOT-TIR 2017 benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。