arXiv:2608.01807cs.CV2026-08

动态调整融合参数,让跟踪更适应目标变化和环境干扰。

Parameter-Dynamic Adaptive Fusion and Calibration Network for RGBT Tracking

论文配图:Parameter-Dynamic Adaptive Fusion and Calibration Network for RGBT Tracking
图 1 · 摘自论文原文
  • 用目标特征生成融合与校准参数,实现自适应调节。
  • 在多个数据集上表现优于现有方法,提升跟踪稳定性。
  • 适合需要高鲁棒性的多模态目标跟踪场景。

现有RGBT跟踪器通常使用固定参数的融合函数,难以应对不同目标和场景的变化。尽管动态架构方法能选择预定义操作提升灵活性,但仍无法根据目标状态演化调整融合参数。为此,本文提出参数动态自适应融合与校准网络(PAFCNet),通过动态生成受目标条件影响的融合与时间校准参数,使跟踪过程能适应目标外观变化及模态质量波动。具体地,引入目标自适应超网络(TA-HyperNet),利用模板表示生成目标相关参数,该表示保留了目标身份和近期外观变化,同时减少背景干扰。基于此,设计目标感知的参数动态融合模块,利用生成参数调制融合过程,实现对目标外观和复杂场景的自适应。此外,为防止时空信息传播中噪声累积,提出动态时空校准模块,利用TA-HyperNet生成校准参数,对历史信息进行动态校准,从而提升时间表示的可靠性。实验表明,PAFCNet在多个RGBT跟踪基准上达到竞争力性能。

原文摘要 · Abstract (English)

Existing RGBT trackers typically employ fusion functions with fixed parameters across different targets and scenarios. Although dynamic-architecture methods improve fusion flexibility by selecting among predefined operations, they still cannot adapt the fusion parameters to the evolving target state. To address these issues, we propose a Parameter-Dynamic Adaptive Fusion and Calibration Network (PAFCNet) for RGBT tracking. PAFCNet dynamically generates target-conditioned parameters for multimodal fusion and temporal calibration, enabling the tracking process to adapt to target appearance variations and modality quality fluctuations. Specifically, we introduce a Target-Adaptive Hypernetwork (TA-HyperNet) that leverages template representations, which preserve stable target identity and recent appearance changes with less background interference, to generate target-conditioned parameters for subsequent fusion and calibration. Based on TA-HyperNet, we design a target-aware parameter-dynamic fusion module that uses the generated parameters to modulate the fusion process. This enables the fusion module to adapt to changes in target appearance and complex scene conditions. Furthermore, since spatio-temporal information propagation may accumulate tracking noise, we propose a dynamic spatio-temporal calibration module that employs TA-HyperNet to generate calibration parameters for spatio-temporal tokens. By dynamically calibrating historical information before propagation, the module improves the reliability of temporal representations. Experimental results demonstrate that PAFCNet achieves competitive performance on multiple RGBT tracking benchmarks.

RGBT跟踪自适应融合动态参数目标追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。