用数据驱动方法替代人工规则,提升在线多目标跟踪的关联精度。
CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Tracking
- 设计基于Transformer的上下文感知模块,自动学习多线索关联策略。
- 在MOT17、MOT20等基准上达到最新最优性能,超越传统启发式方法。
- 保持检测-跟踪分离架构,可无缝接入外部预训练模型,适合工程部署。
在线多目标跟踪近年主要依赖检测-跟踪(TbD)框架,其进展依赖于复杂的启发式规则来处理轨迹表示、特征融合和多阶段匹配。尽管TbD具有模块化优势,可集成运动预测器、重识别模型等现成组件,但大量人工设计的时序关联规则限制了其对多种跟踪线索复杂交互的建模能力。本文提出CAMELTrack,一种基于上下文感知多线索挖掘的新型关联模块——CAMEL,通过两个Transformer模块与创新的以关联为中心的训练策略,直接从数据中学习鲁棒的关联机制,摆脱手工规则束缚,同时保留TbD的模块化优势。相比端到端检测-跟踪方法,本方法训练轻量快速,并能有效利用外部预训练模型。实验表明,CAMELTrack在MOT17、MOT20等多个主流跟踪基准上达到当前最优性能。代码已开源:https://github.com/TrackingLaboratory/CAMELTrack。
原文摘要 · Abstract (English)
Online multi-object tracking has been recently dominated by tracking-by-detection (TbD) methods, where recent advances rely on increasingly sophisticated heuristics for tracklet representation, feature fusion, and multi-stage matching. The key strength of TbD lies in its modular design, enabling the integration of specialized off-the-shelf models like motion predictors and re-identification. However, the extensive usage of human-crafted rules for temporal associations makes these methods inherently limited in their ability to capture the complex interplay between various tracking cues. In this work, we introduce CAMEL, a novel association module for Context-Aware Multi-Cue ExpLoitation, that learns resilient association strategies directly from data, breaking free from hand-crafted heuristics while maintaining TbD's valuable modularity. At its core, CAMEL employs two transformer-based modules and relies on a novel association-centric training scheme to effectively model the complex interactions between tracked targets and their various association cues. Unlike end-to-end detection-by-tracking approaches, our method remains lightweight and fast to train while being able to leverage external off-the-shelf models. Our proposed online tracking pipeline, CAMELTrack, achieves state-of-the-art performance on multiple tracking benchmarks. Our code is available at https://github.com/TrackingLaboratory/CAMELTrack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。