提升多相机3D目标跟踪精度与效率,解决检测器依赖问题。
RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework
- 通过置信度引导模块提取可靠运动与视觉特征
- 在nuScenes上达59.1% AMOTA,性能领先
- 适合多相机场景下高效部署的跟踪系统
3D多目标跟踪(MOT)随着3D目标检测技术的快速发展,在低成本多相机设置中取得了显著进步。然而,当前主流端到端训练方法导致追踪器与特定检测器绑定,限制了通用性。同时,现有通用追踪器忽略了多相机检测器的独特特性,如运动观测不可靠、视觉信息可利用等。为此,我们提出RockTrack,一种面向多相机检测器的3D MOT方法。基于Tracking-By-Detection框架,RockTrack兼容各类现成检测器。其通过置信度引导预处理模块,从单一检测器的不同表征空间中提取可靠的运动与图像观测。这些观测在关联模块中融合,利用几何与外观线索减少误匹配。结果匹配通过分阶段估计过程传播,用于启发式噪声建模。此外,我们提出一种新型外观相似性度量,显式刻画多相机场景下的物体亲和关系。RockTrack在nuScenes纯视觉追踪排行榜上取得59.1% AMOTA的顶尖表现,同时展现出色的计算效率。
原文摘要 · Abstract (English)
3D Multi-Object Tracking (MOT) obtains significant performance improvements with the rapid advancements in 3D object detection, particularly in cost-effective multi-camera setups. However, the prevalent end-to-end training approach for multi-camera trackers results in detector-specific models, limiting their versatility. Moreover, current generic trackers overlook the unique features of multi-camera detectors, i.e., the unreliability of motion observations and the feasibility of visual information. To address these challenges, we propose RockTrack, a 3D MOT method for multi-camera detectors. Following the Tracking-By-Detection framework, RockTrack is compatible with various off-the-shelf detectors. RockTrack incorporates a confidence-guided preprocessing module to extract reliable motion and image observations from distinct representation spaces from a single detector. These observations are then fused in an association module that leverages geometric and appearance cues to minimize mismatches. The resulting matches are propagated through a staged estimation process, forming the basis for heuristic noise modeling. Additionally, we introduce a novel appearance similarity metric for explicitly characterizing object affinities in multi-camera settings. RockTrack achieves state-of-the-art performance on the nuScenes vision-only tracking leaderboard with 59.1% AMOTA while demonstrating impressive computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。