提升多目标跟踪的关联精度,让模型更好区分相似目标。
From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking
- 引入空间、时间、身份三重适配器增强目标特征区分度
- 在DanceTrack等数据集上达到当前最佳追踪性能
- 适合需要高精度关联的实时多目标跟踪场景
端到端多目标跟踪方法虽在检测上表现优异,但关联准确率仍偏低。分析发现,共享DETR架构生成的物体嵌入存在过高的帧内相似性,缺乏跨帧实例级区分能力。为此,提出FDTA(From Detection to Association)框架,从空间连续性、时序依赖性和实例可分性三个维度显式优化嵌入特征:引入空间适配器(SA)融合深度感知线索,时间适配器(TA)聚合历史信息,身份适配器(IA)采用质量感知对比学习。在DanceTrack、SportsMOT和BFT等多个挑战性基准上,FDTA均取得领先性能,验证了其增强判别性嵌入的有效性。
原文摘要 · Abstract (English)
End-to-end multi-object tracking (MOT) methods have recently achieved remarkable progress by unifying detection and association within a single framework. Despite their strong detection performance, these methods suffer from relatively low association accuracy. Through detailed analysis, we observe that object embeddings produced by the shared DETR architecture display excessively high inter-object similarity, as it emphasizes only category-level discrimination within single frames. In contrast, tracking requires instance-level distinction across frames with spatial and temporal continuity, for which current end-to-end approaches insufficiently optimize object embeddings. To address this, we introduce FDTA (From Detection to Association), an explicit feature refinement framework that enhances object discriminativeness across three complementary perspectives. Specifically, we introduce a Spatial Adapter (SA) to integrate depth-aware cues for spatial continuity, a Temporal Adapter (TA) to aggregate historical information for temporal dependencies, and an Identity Adapter (IA) to leverage quality-aware contrastive learning for instance-level separability. Extensive experiments demonstrate that FDTA achieves state-of-the-art performance on multiple challenging MOT benchmarks, including DanceTrack, SportsMOT, and BFT, highlighting the effectiveness of our proposed discriminative embedding enhancement strategy. The code is available at https://github.com/Spongebobbbbbbbb/FDTA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。