arXiv:2512.22105cs.CV2025-12

用链接预测替代手工规则,实现高效精准的多目标跟踪。

Learning Association via Track-Detection Matching for Multi-Object Tracking

  • 通过预测轨迹与检测框的连接关系,实现帧级关联
  • 在多个数据集上超越主流跟踪方法,速度更快且精度更高
  • 适合追求高效率与高精度平衡的跟踪系统开发者

多目标跟踪旨在通过关联视频帧中的检测结果来维持目标身份。现有方法主要有两类:基于检测的跟踪方法计算效率高但依赖人工设计的关联规则;端到端方法虽能从数据中学习关联,但计算复杂度较高。本文提出轨道-检测链接预测(TDLP),一种基于检测的跟踪方法,通过预测每条轨迹在每一帧的正确延续来实现帧间关联。TDLP 主要基于几何特征(如边界框),可选融合姿态和外观等额外信息。相比启发式方法,它直接从数据中学习关联,无需手工规则;相比端到端方法,保持模块化与低计算开销。在多个基准上的实验表明,TDLP 在跟踪性能上持续领先于当前最优的基于检测与端到端方法。进一步分析显示,链接预测比基于度量学习的关联更有效,尤其在处理边界框等异构特征时优势明显。代码已开源。

原文摘要 · Abstract (English)

Multi-object tracking aims to maintain object identities over time by associating detections across video frames. Two dominant paradigms exist in literature: tracking-by-detection methods, which are computationally efficient but rely on handcrafted association heuristics, and end-to-end approaches, which learn association from data at the cost of higher computational complexity. We propose Track-Detection Link Prediction (TDLP), a tracking-by-detection method that performs per-frame association via link prediction between tracks and detections, i.e., by predicting the correct continuation of each track at every frame. TDLP is architecturally designed primarily for geometric features such as bounding boxes, while optionally incorporating additional cues, including pose and appearance. Unlike heuristic-based methods, TDLP learns association directly from data without handcrafted rules, while remaining modular and computationally efficient compared to end-to-end trackers. Extensive experiments on multiple benchmarks demonstrate that TDLP consistently surpasses state-of-the-art performance across both tracking-by-detection and end-to-end methods. Finally, we provide a detailed analysis comparing link prediction with metric learning-based association and show that link prediction is more effective, particularly when handling heterogeneous features such as detection bounding boxes. Our code is available at \href{https://github.com/Robotmurlock/TDLP}{https://github.com/Robotmurlock/TDLP}.

多目标跟踪链接预测轨迹关联高效跟踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。