arXiv:2606.23604cs.CVcs.AI2026-06

让目标外观随追踪持续进化,提升多目标追踪精度与实时性

Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking

论文配图:Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking
图 1 · 摘自论文原文
  • 将外观建模转为递归估计,为每个目标维护动态外观状态
  • 在KITTI上达92.27% MOTA,身份切换显著减少
  • 适合需要高精度、实时运行的多目标追踪场景

多目标追踪中常用的检测-追踪范式依赖静态外观描述符来补充运动估计,但这些描述符与帧无关,鲁棒性受限。由于其通常来自计算量大的预训练主干网络,实时追踪系统常放弃外观线索,仅依赖运动预测与几何关联。本文提出Polycepta,一种以目标为中心的外观状态估计框架,将外观建模重构为递归估计问题而非逐帧匹配任务。Polycepta为每个追踪目标构建并持续更新独立的外观状态,使未来外观表示可基于累积观测进行估计。通过一种学习策略,鼓励模型学习对象特定表示的构造而非记忆,从而实现对未见类别的外观估计。关键优势在于:随着推理过程中目标状态演化,外观估计质量持续提升。与传统静态或退化的描述符不同,Polycepta随观测增加逐步优化外观估计。在KITTI、Waymo Open Dataset和MOT17上的大量实验表明,集成至检测-追踪流水线后,身份切换显著减少,追踪性能提升。Polycepta运行速度达90.57 Hz,在KITTI基准上取得92.27% MOTA的顶尖表现。

原文摘要 · Abstract (English)

The tracking-by-detection paradigm in multi-object tracking (MOT) typically relies on static appearance descriptors to complement motion estimation. However, these descriptors are frame-independent, limiting their robustness as visual cues. Since such descriptors are often obtained from computationally intensive pretrained backbones, real-time MOT systems frequently abandon appearance cues altogether and rely solely on motion prediction and geometric association. In this work, we introduce Polycepta, an object-centric appearance state estimation framework that reformulates appearance modeling as a recursive estimation problem rather than a frame-wise matching task. Polycepta constructs and continuously updates an independent appearance state for each tracked object, enabling future appearance representations to be estimated from accumulated observations. Polycepta is encouraged to learn the appearance-state construction of object-specific representations rather than memorize them through a proposed learning strategy, enabling appearance estimation for unseen classes. A key property of Polycepta is that the quality of appearance estimation improves as object states evolve during inference. While conventional appearance descriptors remain static or degrade over time, Polycepta progressively refines appearance estimates as additional observations are accumulated. Extensive experiments on KITTI, the Waymo Open Dataset, and MOT17 demonstrate consistent reductions in identity switches and improvements in tracking performance when integrated into the tracking-by-detection pipelines. Polycepta operates at 90.57 Hz and delivers state-of-the-art performance on the KITTI benchmark, achieving a MOTA of 92.27\%.

多目标追踪外观建模实时系统递归估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。