arXiv:2607.17157cs.CVcs.AI2026-07

解决密集相似物体追踪中的身份混淆问题。

VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects

论文配图:VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects
图 1 · 摘自论文原文
  • 将重识别建模为视频级关联,用历史轨迹特征查询当前所有检测框。
  • 在BEE24数据集上提升多项指标,减少28%的身份切换。
  • 无需额外标注,通过特征抑制增强相似物体的区分度。

多目标跟踪(MOT)旨在视频中定位多个目标并保持其身份一致性。当目标小、分布密集且外观高度相似时(如蜂群场景),长期身份保持仍具挑战。现有跟踪器依赖单实例分配训练的重识别(re-ID)模型,但推理时需进行多轨迹与检测框间的全局匹配,存在训练-推理不一致问题,导致相似目标间频繁身份切换。现有方法常需大量额外标注以增强外观区分能力。本文提出视频级关联重识别(VLA-ReID),将re-ID重构为视频级关联建模:以聚合的历史轨迹特征为查询,当前帧所有检测框为候选,直接优化每帧的全局关联。同时引入帧共现外观估计(FCAE)和共现特征抑制(CAS),从轨迹与检测特征中移除共性外观方向,增强相似目标间的判别差异,无需额外标注。在BEE24数据集上的实验表明,VLA-ReID相较最先进跟踪器提升HOTA 1.1、MOTA 0.3、AssR 2.6、AssA 0.7、IDF1 0.8,身份切换减少28%,验证了视频级re-ID建模在基于外观关联中的有效性。

原文摘要 · Abstract (English)

Multi-object tracking (MOT) aims to localize multiple objects in videos while preserving their identities over time. Long-term identity preservation remains difficult when objects are small, densely distributed, and highly similar in appearance, as in bee swarm scenes. Existing trackers rely on re-identification (re-ID) models trained through single-instance assignment (instance-level querying). At inference, however, MOT requires global assignment between multiple trajectories and detections, corresponding to video-level querying. This training-inference mismatch can cause identity switches among visually similar objects. Existing approaches also often require substantial additional annotations to enhance appearance discrimination. We propose Video-Level Association re-ID (VLA-ReID), which reformulates re-ID as video-level association modeling. It uses aggregated historical trajectory features as queries and all current-frame detections as candidates, enabling direct optimization of their global association at each frame. In addition, Frame-Common Appearance Estimation (FCAE) estimates a common appearance direction from current-frame detections, while Common-Appearance Suppression (CAS) removes the corresponding component along this direction from trajectory and detection features. This amplifies discriminative differences among highly similar objects without additional annotations. Experiments on BEE24 show that VLA-ReID improves HOTA by 1.1, MOTA by 0.3, AssR by 2.6, AssA by 0.7, and IDF1 by 0.8 over state-of-the-art trackers, while reducing identity switches by 28%. These results demonstrate the effectiveness of video-level re-ID modeling for appearance-based association in MOT.

多目标跟踪重识别蜂群追踪外观建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。