提出一种新型卡尔曼滤波器,通过概率数据关联提升多目标跟踪精度。
PKF: Probabilistic Data Association Kalman Filter for Multi-Object Tracking
- 将数据关联视为隐变量,用变分推断与EM算法优化状态估计。
- 在MOT17、MOT20等数据集上实现更高HOTA指标,且保持实时性。
- 仅用边界框信息即可达到顶尖性能,适合轻量级实时跟踪场景。
本文提出一种基于概率数据关联的卡尔曼滤波器(PKF),将未知的数据关联视为隐变量,通过变分推断近似后验分布,并利用期望最大化(EM)算法得到更新步骤与标准卡尔曼滤波一致的形式,但使用所有潜在关联的扩展测量向量。我们证明关联概率可表示为包含观测似然的矩阵的永久值。进一步提出模糊性检查机制,仅对模糊测量与状态进行概率关联,从而降低计算开销并避免低概率测量干扰估计。仿真实验表明,该滤波器相比经典的联合概率数据关联滤波器(JPDAF)具有更低的跟踪误差,且运行速度相当。在真实世界数据集MOT17、MOT20和DanceTrack上的多目标跟踪实验中,本方法在不使用深度特征或速度信息的情况下,实现了优于现有卡尔曼滤波方法的高阶跟踪准确率(HOTA),并保持实时性能。在离线检测条件下,算法在单台笔记本电脑CPU上达到250+ fps。代码已开源。
原文摘要 · Abstract (English)
In this paper, we derive a new Kalman filter with probabilistic data association between measurements and states. We formulate a variational inference problem to approximate the posterior density of the state conditioned on the measurement data. We view the unknown data association as a latent variable and apply Expectation Maximization (EM) to obtain a filter with update step in the same form as the Kalman filter but with expanded measurement vector of all potential associations. We show that the association probabilities can be computed as permanents of matrices with measurement likelihood entries. We also propose an ambiguity check that associates only a subset of ambiguous measurements and states probabilistically, thus reducing the association time and preventing low-probability measurements from harming the estimation accuracy. Experiments in simulation show that our filter achieves lower tracking errors than the well-established joint probabilistic data association filter (JPDAF), while running at comparable rate. We also demonstrate the effectiveness of our filter in multi-object tracking (MOT) on multiple real-world datasets, including MOT17, MOT20, and DanceTrack. We achieve better higher order tracking accuracy (HOTA) than previous Kalman-filter methods and remain real-time. Associating only bounding boxes without deep features or velocities, our method ranks top-10 on both MOT17 and MOT20 in terms of HOTA. Given offline detections, our algorithm tracks at 250+ fps on a single laptop CPU. Code is available at https://github.com/hwcao17/pkf.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。