通过显式监督提升视觉跟踪中的上下文推理一致性
Explicit Context Reasoning with Supervision for Visual Tracking
- 设计三机制:状态推理、前向监督、压缩重建
- 在多个数据集上达到顶尖性能,且实时运行
- 适合需要高精度长期跟踪的应用场景
上下文推理与约束对提升视觉跟踪中跨帧建模的时间一致性至关重要。然而,主流跟踪算法通常仅简单堆叠历史信息,未显式监督关联过程,难以有效建模目标动态演变。为此,我们提出RSTrack,通过三种核心机制显式建模并监督上下文推理:1)上下文推理机制:构建目标状态推理流程,将无约束的上下文关联转化为基于历史目标状态预测当前表示的时序推理过程,增强时间一致性;2)前向监督策略:利用真实目标特征作为锚点,约束推理流程,引导预测输出趋近真实目标分布,抑制上下文推理过程中的漂移;3)高效状态建模:采用压缩-重构机制提取目标核心特征,去除帧间冗余信息,防止无效上下文关联。三种机制协同作用,有效缓解传统时序建模中的上下文关联发散问题。实验结果表明,RSTrack在多个基准数据集上达到最新性能,同时保持实时运行速度。
原文摘要 · Abstract (English)
Contextual reasoning with constraints is crucial for enhancing temporal consistency in cross-frame modeling for visual tracking. However, mainstream tracking algorithms typically associate context by merely stacking historical information without explicitly supervising the association process, making it difficult to effectively model the target's evolving dynamics. To alleviate this problem, we propose RSTrack, which explicitly models and supervises context reasoning via three core mechanisms. \textit{1) Context Reasoning Mechanism}: Constructs a target state reasoning pipeline, converting unconstrained contextual associations into a temporal reasoning process that predicts the current representation based on historical target states, thereby enhancing temporal consistency. \textit{2) Forward Supervision Strategy}: Utilizes true target features as anchors to constrain the reasoning pipeline, guiding the predicted output toward the true target distribution and suppressing drift in the context reasoning process. \textit{3) Efficient State Modeling}: Employs a compression-reconstruction mechanism to extract the core features of the target, removing redundant information across frames and preventing ineffective contextual associations. These three mechanisms collaborate to effectively alleviate the issue of contextual association divergence in traditional temporal modeling. Experimental results show that RSTrack achieves state-of-the-art performance on multiple benchmark datasets while maintaining real-time running speeds. Our code is available at https://github.com/GXNU-ZhongLab/RSTrack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。