arXiv:2602.13772cs.CV2026-02被引 2

提出可通用的离线3D多目标跟踪框架,提升自动标注精度。

Offline-Poly: A Polyhedral Framework For Offline 3D Multi-Object Tracking

  • 基于追踪中心设计,直接处理任意追踪输出
  • 在nuScenes上达77.6% AMOTA,KITTI上83.00% HOTA
  • 无需依赖特定检测器或追踪器,模块化设计灵活

离线3D多目标跟踪(MOT)是4D自动标注(4DAL)的关键环节,通过引入时序上下文提升高性能检测器生成的伪标签质量。然而,现有方法多为在线框架的直接延伸,未能充分利用离线设置的优势,且常依赖固定上游组件与定制架构,适应性差。为此,我们提出Offline-Poly,一种以追踪为中心的通用离线3D MOT方法。引入标准化范式Tracking-by-Tracking(TBT),仅需任意现成追踪输出即可生成优化后的轨迹片段。该范式解耦了离线追踪器与特定检测器或追踪器的依赖关系。Offline-Poly采用结构化流水线:预处理、层级匹配与融合、轨迹片段优化。各模块利用离线追踪两大特性:资源无约束(支持全局优化)与未来可观测性(可全时域推理)。首先消除短时假轨迹并重新识别断裂段;其次构建场景级相似度关联多源轨迹;最后联合局部与全局运动模式精修轨迹。在nuScenes上达到77.6% AMOTA,KITTI上达83.00% HOTA。实验验证其灵活性、泛化性与模块有效性。

原文摘要 · Abstract (English)

Offline 3D multi-object tracking (MOT) is a critical component of the 4D auto-labeling (4DAL) process. It enhances pseudo-labels generated by high-performance detectors through the incorporation of temporal context. However, existing offline 3D MOT approaches are direct extensions of online frameworks and fail to fully exploit the advantages of offline setting. Moreover, these methods often depend on fixed upstream and customized architectures, limiting their adaptability. To address these limitations, we propose Offline-Poly, a general offline 3D MOT method based on a tracking-centric design. We introduce a standardized paradigm termed Tracking-by-Tracking (TBT), which operates exclusively on arbitrary off-the-shelf tracking outputs and produces offline-refined tracklets. This formulation decouples offline tracker from specific upstream detectors or trackers. Under the TBT paradigm, Offline-Poly accepts one or multiple coarse tracking results and processes them through a structured pipeline comprising pre-processing, hierarchical matching and fusion, and tracklet refinement. Each module is designed to capitalize on the two fundamental properties of offline tracking: resource unconstrainedness, which permits global optimization beyond real-time limits, and future observability, which enables tracklet reasoning over the full temporal horizon. Offline-Poly first eliminates short-term ghost tracklets and re-identifies fragmented segments using global scene context. It then constructs scene-level similarity to associate tracklets across multiple input sources. Finally, Offline-Poly refines tracklets by jointly leveraging local and global motion patterns. On nuScenes, we achieve SOTA performance with 77.6% AMOTA. On KITTI, it achieves leading results with 83.00% HOTA. Comprehensive experiments further validate the flexibility, generalizability, and modular effectiveness of Offline-Poly.

3D跟踪离线追踪自动标注多目标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。