arXiv:2603.21629cs.CV2026-03中稿 · CVPR被引 2

通过经验与直觉双机制,提升目标跟踪在分布偏移下的适应能力。

Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition

  • 引入直觉与经验双系统,利用短期记忆和历史视频经验进行测试时校准。
  • 在多个基准数据集上显著提升跟踪性能,有效缓解分布偏移导致的性能下降。
  • 适合需要在线适应真实场景变化的目标跟踪应用,如自动驾驶、监控系统。

多目标跟踪(MOT)是计算机视觉中的基础任务,广泛应用于各类实际场景。然而,由于训练与测试数据在外观、运动模式和类别上的分布差异,模型在在线推理时性能显著下降。测试时自适应(TTA)成为缓解此类分布偏移的有前景范式。但现有方法大多仅关注帧级适应,忽视了跨帧与跨视频的时间一致性及身份关联。受人类决策过程启发,本文提出一种从经验与直觉中进行测试时校准(TCEI)的框架。其中,直觉系统利用瞬时记忆快速回忆近期观测目标以实现快速预测;经验系统则基于先前测试视频积累的经验重新评估并校准这些直觉预测。同时,测试过程中高置信度与低置信度目标分别作为历史先验与反思案例,帮助模型适应测试环境,缓解性能退化。大量实验表明,所提TCEI框架在多个基准数据集上持续取得优异表现,显著增强模型在分布偏移下的适应性。代码将发布于 https://github.com/1941Zpf/TCEI。

原文摘要 · Abstract (English)

Multiple Object Tracking (MOT) has long been a fundamental task in computer vision, with broad applications in various real-world scenarios. However, due to distribution shifts in appearance, motion pattern, and catagory between the training and testing data, model performance degrades considerably during online inference in MOT. Test-Time Adaptation (TTA) has emerged as a promising paradigm to alleviate such distribution shifts. However, existing TTA methods often fail to deliver satisfactory results in MOT, as they primarily focus solely on frame-level adaptation while neglecting temporal consistency and identity association across frames and videos. Inspired by human decision-making process, this paper propose a Test-time Calibration from Experience and Intuition (TCEI) framework. In this framework, the Intuitive system utilizes transient memory to recall recently observed objects for rapid predictions, while the Experiential system leverages the accumulated experience from prior test videos to reassess and calibrate these intuitive predictions. Furthermore, both confident and uncertain objects during online testing are exploited as historical priors and reflective cases, respectively, enabling the model to adapt to the testing environment and alleviate performance degradation. Extensive experiments demonstrate that the proposed TCEI framework consistently achieves superior performance across multiple benchmark datasets and significantly enhances the model's adaptability under distribution shifts. The code will be released at https://github.com/1941Zpf/TCEI.

多目标跟踪测试时自适应在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。