arXiv:2409.02562cs.CV2024-09被引 3

仅用一个初始单应矩阵,实现相机运动与多目标状态联合估计

One Homography is All You Need: IMM-based Joint Homography and Multiple Object State Estimation

  • 将单应矩阵及其动态作为状态向量联合建模,避免显式补偿相机运动
  • 在DanceTrack和KITTI-car上分别提升HOTA 2.64和2.11点,超越多数2D方法
  • 适合需要轻量级3D信息的实时多目标跟踪场景,尤其适用于动态相机

本文提出一种新型在线多目标跟踪算法IMM-JHSE,仅依赖初始单应矩阵作为额外3D信息,而非常规3D测量。通过将单应矩阵及其动态纳入轨迹状态向量进行联合建模,该方法消除了先前方法中相机运动补偿对预测轨迹位置的影响。结合静态与动态相机运动模型,利用交互多模型(IMM)滤波器实现融合。采用简单边界框运动模型预测图像平面位置,以融入图像平面信息。此外,创新性地在关联阶段引入基于边界框的BIoU与基于地面平面的马氏距离的非标准IMM混合机制,增强对偏离地面平面运动的鲁棒性。同时集成动态过程与测量噪声自适应估计技术。在DanceTrack和KITTI-car数据集上,相比UCMCTrack、OC-SORT、C-BIoU和ByteTrack,HOTA分别提升2.64和2.11;在MOT17、MOT20和KITTI-pedestrian上表现具竞争力。使用公开检测结果时,性能超越几乎所有2D MOT方法,仅略逊于部分离线3D方法。相较于基于注意力的追踪方法,在DanceTrack上表现相近,在MOT17上更优。代码已开源:https://github.com/Paulkie99/imm-jhse。

原文摘要 · Abstract (English)

A novel online MOT algorithm, IMM Joint Homography State Estimation (IMM-JHSE), is proposed. IMM-JHSE uses an initial homography estimate as the only additional 3D information, whereas other 3D MOT methods use regular 3D measurements. By jointly modelling the homography matrix and its dynamics as part of track state vectors, IMM-JHSE removes the explicit influence of camera motion compensation techniques on predicted track position states, which was prevalent in previous approaches. Expanding upon this, static and dynamic camera motion models are combined using an IMM filter. A simple bounding box motion model is used to predict bounding box positions to incorporate image plane information. In addition to applying an IMM to camera motion, a non-standard IMM approach is applied where bounding-box-based BIoU scores are mixed with ground-plane-based Mahalanobis distances in an IMM-like fashion to perform association only, making IMM-JHSE robust to motion away from the ground plane. Finally, IMM-JHSE makes use of dynamic process and measurement noise estimation techniques. IMM-JHSE improves upon related techniques, including UCMCTrack, OC-SORT, C-BIoU and ByteTrack on the DanceTrack and KITTI-car datasets, increasing HOTA by 2.64 and 2.11, respectively, while offering competitive performance on the MOT17, MOT20 and KITTI-pedestrian datasets. Using publicly available detections, IMM-JHSE outperforms almost all other 2D MOT methods and is outperformed only by 3D MOT methods -- some of which are offline -- on the KITTI-car dataset. Compared to tracking-by-attention methods, IMM-JHSE shows remarkably similar performance on the DanceTrack dataset and outperforms them on the MOT17 dataset. The code is publicly available: https://github.com/Paulkie99/imm-jhse.

多目标跟踪单应矩阵相机运动实时追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。