提出Q门控注意力,高效实现密集目标跟踪
GateMOT: Q-Gated Attention for Dense Object Tracking

- 用查询作可学习门控,逐元素调节关键特征
- 在BEE24上达到48.4的HOTA、67.8的MOTA
- 适合高密度遮挡场景的实时跟踪应用
尽管大型模型展现出原始注意力的强大表征能力,但其二次复杂度的全局交互在高分辨率特征上进行密集运动估计时计算开销过大,难以直接用于密集目标跟踪。为解决此问题,本文提出GateMOT框架,核心是Q-Gated Attention(Q-Attention),一种高效且具空间感知能力的注意力变体。其关键思想是将查询从相似性条件项重定义为可学习的门控单元。该门控查询(Gating-Q)生成概率门控,对键特征进行逐元素调制,实现显式的相关性选择,避免昂贵的全局聚合。基于此机制,多个并行的Q-Attention头将共享特征图转化为检测、运动与重识别任务所需的任务特定但一致的表示,构建线性复杂度的耦合多任务解码器。GateMOT在BEE24数据集上取得48.4的HOTA、67.8的MOTA和64.5的IDF1,同时在其他密集目标跟踪基准上表现优异,验证了Q-Attention作为注意力驱动跟踪的简单、有效且可迁移的核心模块。
原文摘要 · Abstract (English)
While large models demonstrate the strong representational power of vanilla attention, this core mechanism cannot be directly applied to Dense Object Tracking: its quadratic all-to-all interactions are computationally prohibitive for dense motion estimation on high-resolution features. This mismatch prevents Dense Object Tracking from fully leveraging attention-based modeling in crowded and occlusion-heavy scenes. To address this challenge, we introduce GateMOT, an online tracking framework centered on Q-Gated Attention (Q-Attention), an efficient and spatially aware attention variant. Our key idea is to repurpose the Query from a similarity-conditioning term into a learnable gating unit. This Gating-Query (Gating-Q) produces a probabilistic gate that modulates Key features in an element-wise manner, enabling explicit relevance selection instead of costly global aggregation. Built on this mechanism, parallel Q-Attention heads transform one shared feature map into task-specific yet consistent representations for detection, motion, and re-identification, yielding a tightly coupled multi-task decoder with linear-complexity gating operations. GateMOT achieves state-of-the-art HOTA of 48.4, MOTA of 67.8, and IDF1 of 64.5 on BEE24, and demonstrates strong performance on additional Dense Object Tracking benchmarks. These results show that Q-Attention is a simple, effective, and transferable building block for attention-based tracking in dense tracking scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。