融合注意力与贝叶斯滤波,提升复杂场景下多粒子追踪精度
Attention-Bayesian Hybrid Approach to Modular Multiple Particle Tracking
- 用变压器提取粒子行为特征,软性关联跨帧检测
- 显著降低轨迹假设空间,提升对虚假检测的鲁棒性
- 适合高杂波、低密度粒子追踪任务,兼具效率与可解释性
在噪声大、干扰多的场景中追踪多个粒子仍具挑战,因轨迹假设组合爆炸,随粒子数和帧数呈超指数增长。虽然变压器架构在应对高组合负载方面表现出显著鲁棒性,但在轨迹假设较少的局部稀疏场景中,其性能仍不及传统贝叶斯滤波方法。这表明,尽管变压器擅长缩小可能关联范围,却难以在局部稀疏情况下达到贝叶斯方法的最优性。为此,我们提出一种混合追踪框架,结合自注意力机制学习粒子行为潜在表示的能力与贝叶斯滤波的可靠性及可解释性。通过将轨迹-检测关联建模为标签预测问题,利用变压器编码器推断跨帧检测间的软关联,从而剪枝假设集,使贝叶斯滤波框架能高效实现多粒子追踪。实验表明,该方法在追踪准确性和抗虚假检测能力上均有提升,为高杂波环境下的多粒子追踪提供了有效解决方案。
原文摘要 · Abstract (English)
Tracking multiple particles in noisy and cluttered scenes remains challenging due to a combinatorial explosion of trajectory hypotheses, which scales super-exponentially with the number of particles and frames. The transformer architecture has shown a significant improvement in robustness against this high combinatorial load. However, its performance still falls short of the conventional Bayesian filtering approaches in scenarios presenting a reduced set of trajectory hypothesis. This suggests that while transformers excel at narrowing down possible associations, they may not be able to reach the optimality of the Bayesian approach in locally sparse scenario. Hence, we introduce a hybrid tracking framework that combines the ability of self-attention to learn the underlying representation of particle behavior with the reliability and interpretability of Bayesian filtering. We perform trajectory-to-detection association by solving a label prediction problem, using a transformer encoder to infer soft associations between detections across frames. This prunes the hypothesis set, enabling efficient multiple-particle tracking in Bayesian filtering framework. Our approach demonstrates improved tracking accuracy and robustness against spurious detections, offering a solution for high clutter multiple particle tracking scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。