arXiv:2602.14771cs.CVcs.AI2026-02中稿 · IEEE Transactions …

通过预测追踪模型提升目标跟踪的泛化能力与遮挡感知精度

GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture

  • 用教师-学生框架预测追踪模型而非图像特征,增强鲁棒性
  • 在7个基准上显著提升跟踪器在遮挡和干扰下的性能
  • 适合需要强泛化能力的复杂场景跟踪任务

人类视觉系统通过融合当前观测与历史信息来追踪目标,能自适应变化并精细推理遮挡。而现有通用跟踪器多针对训练目标优化,泛化能力弱,且遮挡推理粗糙。为此,我们提出GOT-JEPA,一种基于联合嵌入预测架构的模型预测预训练框架,将JEPA从图像特征预测扩展到追踪模型预测。给定相同历史信息,教师生成干净帧中的伪追踪模型,学生则从含噪帧中学习预测相同模型。该设计提供稳定伪监督,显式训练模型在遮挡、干扰等恶劣条件下的可靠性,提升对动态环境的泛化能力。在此基础上,我们进一步提出OccuSolver,用于增强遮挡感知。OccuSolver采用点中心点追踪器,结合追踪器迭代生成的目标先验,逐步细化可见性状态,实现更精确的遮挡模式捕捉。生成的高质量参考标签可进一步优化后续模型预测。在七个基准上的大量实验表明,该方法有效提升跟踪器的泛化性和鲁棒性。

原文摘要 · Abstract (English)

The human visual system tracks objects by integrating current observations with previously observed information, adapting to target and scene changes, and reasoning about occlusion at fine granularity. In contrast, recent generic object trackers are often optimized for training targets, which limits robustness and generalization in unseen scenarios, and their occlusion reasoning remains coarse, lacking detailed modeling of occlusion patterns. To address these limitations in generalization and occlusion perception, we propose GOT-JEPA, a model-predictive pretraining framework that extends JEPA from predicting image features to predicting tracking models. Given identical historical information, a teacher predictor generates pseudo-tracking models from a clean current frame, and a student predictor learns to predict the same pseudo-tracking models from a corrupted version of the current frame. This design provides stable pseudo supervision and explicitly trains the predictor to produce reliable tracking models under occlusions, distractors, and other adverse observations, improving generalization to dynamic environments. Building on GOT-JEPA, we further propose OccuSolver to enhance occlusion perception for object tracking. OccuSolver adapts a point-centric point tracker for object-aware visibility estimation and detailed occlusion-pattern capture. Conditioned on object priors iteratively generated by the tracker, OccuSolver incrementally refines visibility states, strengthens occlusion handling, and produces higher-quality reference labels that progressively improve subsequent model predictions. Extensive evaluations on seven benchmarks show that our method effectively enhances tracker generalization and robustness.

目标跟踪遮挡处理模型预测泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。