用状态空间模型统一建模轨迹运动,提升多目标跟踪的精度与效率。
TrackSSM: A General Motion Predictor by State-Space Model
- 基于历史轨迹信息设计可数据依赖的状态转移模块Flow-SSM
- 在多个基准上实现优异跟踪性能,优于主流方法
- 适合需要高效精准轨迹预测的实时多目标跟踪场景
时序运动建模是多目标跟踪(MOT)中的关键组件,有助于生成平滑轨迹并提升关联精度。然而,现有运动模型难以在不同场景下兼顾效率与效果。为此,我们提出TrackSSM,受近期流行的状态空间模型(SSM)启发,构建一个统一的编码器-解码器框架,利用数据依赖的状态空间模型对轨迹进行时序运动建模。具体地,提出Flow-SSM模块,通过历史轨迹的位置与运动信息引导目标边界框的时序状态转移;基于此设计流解码器,由级联的运动解码模块组成,利用编码的流信息完成轨迹的时间位置预测。此外,提出分步线性(S²L)训练策略,通过前一帧与当前帧间的位置线性插值生成伪标签,使轨迹流信息更好地指导边界框的时序过渡。TrackSSM采用简单Mamba-Block构建历史轨迹编码器,结合流解码器形成编码器-解码器结构。该方法适用于多种跟踪场景,在多个基准上均取得优异表现,进一步拓展了类似SSM的时序运动模型在多目标跟踪中的潜力。代码与模型已公开于https://github.com/Xavier-Lin/TrackSSM。
原文摘要 · Abstract (English)
Temporal motion modeling has always been a key component in multiple object tracking (MOT) which can ensure smooth trajectory movement and provide accurate positional information to enhance association precision. However, current motion models struggle to be both efficient and effective across different application scenarios. To this end, we propose TrackSSM inspired by the recently popular state space models (SSM), a unified encoder-decoder motion framework that uses data-dependent state space model to perform temporal motion of trajectories. Specifically, we propose Flow-SSM, a module that utilizes the position and motion information from historical trajectories to guide the temporal state transition of object bounding boxes. Based on Flow-SSM, we design a flow decoder. It is composed of a cascaded motion decoding module employing Flow-SSM, which can use the encoded flow information to complete the temporal position prediction of trajectories. Additionally, we propose a Step-by-Step Linear (S$^2$L) training strategy. By performing linear interpolation between the positions of the object in the previous frame and the current frame, we construct the pseudo labels of step-by-step linear training, ensuring that the trajectory flow information can better guide the object bounding box in completing temporal transitions. TrackSSM utilizes a simple Mamba-Block to build a motion encoder for historical trajectories, forming a temporal motion model with an encoder-decoder structure in conjunction with the flow decoder. TrackSSM is applicable to various tracking scenarios and achieves excellent tracking performance across multiple benchmarks, further extending the potential of SSM-like temporal motion models in multi-object tracking tasks. Code and models are publicly available at \url{https://github.com/Xavier-Lin/TrackSSM}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。