arXiv:2506.03335cs.CV2025-06CVPR被引 8

用状态空间模型提升团队运动多目标追踪的准确性与稳定性。

SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sports

  • 引入Mamba注意力机制捕捉非线性运动模式。
  • 在SportsMOT上达到领先性能,ID切换显著减少。
  • 适合复杂遮挡场景下的实时体育追踪应用。

团队运动中的多目标追踪因快速运动和频繁遮挡导致运动模糊和身份混淆而极具挑战。现有方法依赖检测和外观特征,在外观线索模糊、运动模式非线性的情况下表现不佳。本文提出SportMamba,一种专为动态团队运动设计的自适应混合追踪技术。其核心贡献有二:一是引入Mamba注意力机制,通过隐式关注相关嵌入依赖来建模非线性运动;二是提出高度自适应空间关联度量,通过考虑深度变化引起的尺度差异,减少部分遮挡导致的身份切换;此外,通过自适应缓冲区扩展检测搜索空间,提升高速运动场景下的关联能力。SportMamba在SportsMOT数据集(以复杂运动和严重遮挡为特征)上实现多项指标领先,且在零样本迁移至冰球数据集VIP-HTD时展现出良好泛化能力。

原文摘要 · Abstract (English)

Multi-object tracking (MOT) in team sports is particularly challenging due to the fast-paced motion and frequent occlusions resulting in motion blur and identity switches, respectively. Predicting player positions in such scenarios is particularly difficult due to the observed highly non-linear motion patterns. Current methods are heavily reliant on object detection and appearance-based tracking, which struggle to perform in complex team sports scenarios, where appearance cues are ambiguous and motion patterns do not necessarily follow a linear pattern. To address these challenges, we introduce SportMamba, an adaptive hybrid MOT technique specifically designed for tracking in dynamic team sports. The technical contribution of SportMamba is twofold. First, we introduce a mamba-attention mechanism that models non-linear motion by implicitly focusing on relevant embedding dependencies. Second, we propose a height-adaptive spatial association metric to reduce ID switches caused by partial occlusions by accounting for scale variations due to depth changes. Additionally, we extend the detection search space with adaptive buffers to improve associations in fast-motion scenarios. Our proposed technique, SportMamba, demonstrates state-of-the-art performance on various metrics in the SportsMOT dataset, which is characterized by complex motion and severe occlusion. Furthermore, we demonstrate its generalization capability through zero-shot transfer to VIP-HTD, an ice hockey dataset.

多目标追踪状态空间模型体育视频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。