arXiv:2503.12562cs.CV2025-03中稿 · ECCV被引 4

为多目标跟踪定制视频特定特征空间,提升识别精度

History-Aware Transformation of ReID Features for Multiple Object Tracking

  • 用历史轨迹特征作为上下文,动态构建专属特征空间
  • 无需训练,显著提升多种主流重识别模型的追踪准确率
  • 适合关注视频上下文建模与特征自适应的研究者

在多目标跟踪(MOT)中,重识别(ReID)特征常被当作通用线索,通过简单相似度度量统一应用于所有视频。然而,这忽略了核心事实:MOT并非通用检索任务,而是针对单个视频序列中的目标进行区分的任务。为此,本文提出一种历史感知的特征变换方法,基于每个视频序列的历史特征动态构建更具判别力的子空间。具体地,将已建立轨迹的历史特征视为上下文,采用定制化的Fisher线性判别(FLD)将原始ReID特征映射到序列特定的表示空间。大量实验表明,该无训练方法显著增强了来自不同ReID主干网络的特征判别能力,在多个数据集上实现显著且一致的追踪性能提升。结果表明,相较于直接使用通用ReID特征,上下文感知的表征更符合MOT本质需求。代码已开源:https://github.com/MCG-NJU/HATReID-MOT。

原文摘要 · Abstract (English)

In Multiple Object Tracking (MOT), Re-identification (ReID) features are widely employed as a powerful cue for object association. However, they are often wielded as a one-size-fits-all hammer, applied uniformly across all videos through simple similarity metrics. We argue that this overlooks a fundamental truth: MOT is not a general retrieval problem, but a context-specific task of discriminating targets within a single video. To this end, we advocate for the adjustment of visual features based on the context specific to each video sequence for better adaptation. In this paper, we propose a history-aware feature transformation method that dynamically crafts a more discriminative subspace tailored to each video's unique sample distribution. Specifically, we treat the historical features of established trajectories as context and employ a tailored Fisher Linear Discriminant (FLD) to project the raw ReID features into a sequence-specific representation space. Extensive experiments demonstrate that our training-free method dramatically enhances the discriminative power of features from diverse ReID backbones, resulting in marked and consistent gains in tracking accuracy. Our findings provide compelling evidence that MOT inherently favors context-specific representation over the direct application of generic ReID features. We hope our work inspires the community to move beyond the naive application of ReID features and towards a deeper exploration of their purposeful customization for MOT. Our code will be released. The code is released at https://github.com/MCG-NJU/HATReID-MOT.

多目标跟踪重识别特征变换上下文建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。