通过物体间协同推理,提升多目标跟踪的运动估计稳定性。
Hypergraph-State Collaborative Reasoning for Multi-Object Tracking
- 利用超图与状态空间模型联合建模物体间空间关联和时间连续性。
- 在四个基准数据集上实现当前最优性能,尤其在遮挡场景下表现优异。
- 适合需要高鲁棒性轨迹追踪的应用,如自动驾驶与体育分析。
运动推理是多目标跟踪(MOT)的核心,可实现跨帧的目标一致关联。然而现有运动估计方法存在两大缺陷:(1) 由噪声或概率预测引发的不稳定性;(2) 在遮挡情况下轨迹易断裂。为此,本文提出一种协同推理框架,通过多个相关物体间的联合推断增强运动估计。让具有相似运动状态的物体相互约束并优化彼此,从而稳定噪声轨迹,并在目标被遮挡时仍能推断出合理的运动连续性。为此设计了HyperSSM架构,融合超图计算与状态空间模型(SSM),实现统一的空间-时间推理。超图模块通过动态超边捕捉空间运动关联,而SSM则通过结构化状态转移保证时间平滑性。该协同设计同时优化空间一致性与时间连贯性,显著提升运动估计的鲁棒性与稳定性。在MOT17、MOT20、DanceTrack和SportsMOT四个主流且多样化的基准上进行广泛实验,覆盖多种运动模式与场景复杂度,结果表明本方法在各类跟踪场景中均达到当前最优性能。
原文摘要 · Abstract (English)
Motion reasoning serves as the cornerstone of multi-object tracking (MOT), as it enables consistent association of targets across frames. However, existing motion estimation approaches face two major limitations: (1) instability caused by noisy or probabilistic predictions, and (2) vulnerability under occlusion, where trajectories often fragment once visual cues disappear. To overcome these issues, we propose a collaborative reasoning framework that enhances motion estimation through joint inference among multiple correlated objects. By allowing objects with similar motion states to mutually constrain and refine each other, our framework stabilizes noisy trajectories and infers plausible motion continuity even when target is occluded. To realize this concept, we design HyperSSM, an architecture that integrates Hypergraph computation and a State Space Model (SSM) for unified spatial-temporal reasoning. The Hypergraph module captures spatial motion correlations through dynamic hyperedges, while the SSM enforces temporal smoothness via structured state transitions. This synergistic design enables simultaneous optimization of spatial consensus and temporal coherence, resulting in robust and stable motion estimation. Extensive experiments on four mainstream and diverse benchmarks(MOT17, MOT20, DanceTrack, and SportsMOT) covering various motion patterns and scene complexities, demonstrate that our approach achieves state-of-the-art performance across a wide range of tracking scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。