提升多目标追踪中时空运动与外观特征表示,显著优化跟踪精度
MOT FCG++: Enhanced Representation of Spatio-temporal Motion and Appearance Features
- 引入对角调制GIoU与均值恒速建模,更准确捕捉目标位置与运动关系
- 动态外观表示融合置信度信息,在MOT17上达63.1 HOTA、76.9 MOTA
- 适合关注长轨迹鲁棒性与高精度追踪的计算机视觉研究者
多目标追踪(MOT)旨在跨帧检测并为场景中所有物体分配唯一身份。现有方法依赖连续帧中目标的时空运动特征与外观嵌入特征。有效且鲁棒地表示长轨迹的时空与外观特征已成为影响性能的关键因素。本文提出一种新型外观与时空运动特征表示方法,改进了层次聚类关联方法MOT FCG。针对时空运动特征,提出对角调制GIoU,更精准刻画目标位置与形状关系;引入均值恒速建模,降低观测噪声对运动状态估计的影响。针对外观特征,采用融合置信度信息的动态外观表示,使轨迹外观特征更具鲁棒性与全局性。在基准模型MOT FCG基础上,全面提升了性能:在MOT17测试集上达到63.1 HOTA、76.9 MOTA、78.2 IDF1,同时在MOT20与DanceTrack数据集上也表现优异。
原文摘要 · Abstract (English)
The goal of multi-object tracking (MOT) is to detect and track all objects in a scene across frames, while maintaining a unique identity for each object. Most existing methods rely on the spatial-temporal motion features and appearance embedding features of the detected objects in consecutive frames. Effectively and robustly representing the spatial and appearance features of long trajectories has become a critical factor affecting the performance of MOT. We propose a novel approach for appearance and spatial-temporal motion feature representation, improving upon the hierarchical clustering association method MOT FCG. For spatialtemporal motion features, we first propose Diagonal Modulated GIoU, which more accurately represents the relationship between the position and shape of the objects. Second, Mean Constant Velocity Modeling is proposed to reduce the effect of observation noise on target motion state estimation. For appearance features, we utilize a dynamic appearance representation that incorporates confidence information, enabling the trajectory appearance features to be more robust and global. Based on the baseline model MOT FCG, we have realized further improvements in the performance of all. we achieved 63.1 HOTA, 76.9 MOTA and 78.2 IDF1 on the MOT17 test set, and also achieved competitive performance on the MOT20 and DanceTrack sets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。