arXiv:2505.03507cs.CV2025-05IJCAI被引 3

通过动态图融合与时间扩散,提升无监督红外可见光跟踪的鲁棒性。

Modality-Guided Dynamic Graph Fusion and Temporal Diffusion for Self-Supervised RGB-T Tracking

  • 用动态图注意力聚焦目标区域,抑制背景干扰
  • 引入时间扩散模型,降低相似物体噪声影响
  • 在四个公开数据集上超越现有方法

为减少对大规模标注的依赖,自监督红外-可见光(RGB-T)跟踪方法受到广泛关注。然而,错误伪标签遗漏目标区域或引入背景噪声会降低模态融合效率,而相似物体噪声引发的伪标签噪声会进一步损害跟踪性能。本文提出GDSTrack,通过动态图融合与时间扩散解决上述问题。该方法利用邻近帧构建动态邻接矩阵,引导图注意力聚焦于目标连贯区域;同时将邻近帧特征视为干扰,通过生成式模型实现去噪。在四个公开的RGB-T跟踪数据集上的实验表明,GDSTrack优于现有最先进方法。代码已开源。

原文摘要 · Abstract (English)

To reduce the reliance on large-scale annotations, self-supervised RGB-T tracking approaches have garnered significant attention. However, the omission of the object region by erroneous pseudo-label or the introduction of background noise affects the efficiency of modality fusion, while pseudo-label noise triggered by similar object noise can further affect the tracking performance. In this paper, we propose GDSTrack, a novel approach that introduces dynamic graph fusion and temporal diffusion to address the above challenges in self-supervised RGB-T tracking. GDSTrack dynamically fuses the modalities of neighboring frames, treats them as distractor noise, and leverages the denoising capability of a generative model. Specifically, by constructing an adjacency matrix via an Adjacency Matrix Generator (AMG), the proposed Modality-guided Dynamic Graph Fusion (MDGF) module uses a dynamic adjacency matrix to guide graph attention, focusing on and fusing the object's coherent regions. Temporal Graph-Informed Diffusion (TGID) models MDGF features from neighboring frames as interference, and thus improving robustness against similar-object noise. Extensive experiments conducted on four public RGB-T tracking datasets demonstrate that GDSTrack outperforms the existing state-of-the-art methods. The source code is available at https://github.com/LiShenglana/GDSTrack.

RGB-T跟踪自监督学习动态图时间扩散

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。