arXiv:2503.12888cs.CV2025-03被引 21

提出不确定性感知追踪框架,提升复杂场景下目标定位可靠性。

UncTrack: Reliable Visual Object Tracking with Uncertainty-Aware Prototype Memory Network

  • 引入不确定性感知解码器与原型记忆网络,联合预测定位误差
  • 在OTB100、LaSOT等数据集上均超越现有方法,最高提升2.1%成功率
  • 适合对追踪鲁棒性要求高的视觉系统开发者使用

基于Transformer的追踪器因精度与效率表现优异已成为主流范式。然而,现有方法多将目标追踪视为确定性坐标回归问题,忽视了目标定位不确定性,导致在复杂场景下难以维持可靠的追踪状态。为此,本文提出UncTrack,一种具备不确定性感知能力的Transformer追踪器,可同时预测目标定位不确定性,并利用该信息进行准确的状态推断。具体而言,UncTrack采用Transformer编码器实现模板图与搜索图之间的特征交互,输出特征送入不确定性感知定位解码器(ULD),粗略预测基于角点的目标位置及其对应不确定性。随后,该不确定性被输入原型记忆网络(PMN),挖掘历史信息以判断当前状态预测是否可信。为增强模板表征,高置信度样本会被反馈至原型记忆库用于更新,从而提升对显著外观变化的鲁棒性。大量实验表明,本方法优于当前最先进方法。代码已开源于https://github.com/ManOfStory/UncTrack。

原文摘要 · Abstract (English)

Transformer-based trackers have achieved promising success and become the dominant tracking paradigm due to their accuracy and efficiency. Despite the substantial progress, most of the existing approaches tackle object tracking as a deterministic coordinate regression problem, while the target localization uncertainty has been greatly overlooked, which hampers trackers' ability to maintain reliable target state prediction in challenging scenarios. To address this issue, we propose UncTrack, a novel uncertainty-aware transformer tracker that predicts the target localization uncertainty and incorporates this uncertainty information for accurate target state inference. Specifically, UncTrack utilizes a transformer encoder to perform feature interaction between template and search images. The output features are passed into an uncertainty-aware localization decoder (ULD) to coarsely predict the corner-based localization and the corresponding localization uncertainty. Then the localization uncertainty is sent into a prototype memory network (PMN) to excavate valuable historical information to identify whether the target state prediction is reliable or not. To enhance the template representation, the samples with high confidence are fed back into the prototype memory bank for memory updating, making the tracker more robust to challenging appearance variations. Extensive experiments demonstrate that our method outperforms other state-of-the-art methods. Our code is available at https://github.com/ManOfStory/UncTrack.

目标追踪不确定性建模Transformer原型记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。