arXiv:2512.13876cs.CV2025-12中稿 · ICME2026被引 1

让目标检测查询更聪明地竞争与协作,提升定位精度。

Dual-R-DETR: Resolving Query Competition with Pairwise Routing in Transformer Decoders

  • 通过成对路由区分查询的竞合关系,打破均匀竞争
  • 在COCO上比DINO高1.7% mAP,Swin-L达57.6% mAP
  • 训练时加轻量路由,推理零额外开销,适合部署

检测变压器(DETR)将目标检测建模为集合预测问题,支持端到端训练且无需后处理。然而,DETR中的对象查询通过对称自注意力相互作用,导致所有查询对间强制均等竞争,常引发查询动态效率低下:多个查询收敛至同一对象,而其他查询未能探索不同区域。我们提出Dual-R-DETR,一种竞争感知的DETR框架,通过在变压器解码器中引入成对路由显式调控查询交互。Dual-R-DETR根据外观相似性、预测置信度和空间几何关系,将查询间关系分为竞争或协作两类,并引入两种互补路由行为:抑制器路由以削弱针对同一对象的查询间交互,代理器路由以促进不同区域间的多样性。这些行为通过轻量级可学习低秩偏置注入解码器自注意力实现,支持非对称查询交互,同时保留标准注意力结构。为确保推理效率,路由偏置仅在训练阶段应用,采用双分支策略,推理时回归标准自注意力,无额外计算成本。在COCO和Cityscapes上的大量实验表明,Dual-R-DETR持续提升多个DETR变体性能,在使用ResNet-50主干网络时,相比DINO提升1.7% mAP;在类似设置下,使用Swin-L主干网络达到57.6% mAP。代码已公开于https://github.com/YZk67/Dual-R-DETR。

原文摘要 · Abstract (English)

Detection Transformers (DETR) formulate object detection as a set prediction problem and enable end-to-end training without post-processing. However, object queries in DETR interact through symmetric self-attention, which enforces uniform competition among all query pairs. This often leads to inefficient query dynamics, where multiple queries converge to the same object while others fail to explore alternative regions. We propose Dual-R-DETR, a competition-aware DETR framework that explicitly regulates query interactions via pairwise routing in transformer decoders. Dual-R-DETR distinguishes query-to-query relations as either competitive or cooperative based on appearance similarity, prediction confidence, and spatial geometry. It introduces two complementary routing behaviors: suppressor routing to attenuate interactions among queries targeting the same object, and delegator routing to encourage diversification across distinct regions. These behaviors are realized through lightweight, learnable low-rank biases injected into decoder self-attention, enabling asymmetric query interactions while preserving the standard attention formulation. To ensure inference efficiency, routing biases are applied only during training using a dual-branch strategy, and inference reverts to vanilla self-attention with no additional computational cost. Extensive experiments on COCO and Cityscapes demonstrate that Dual-R-DETR consistently improves multiple DETR variants, outperforming DINO by 1.7% mAP with a ResNet-50 backbone and achieving 57.6% mAP with Swin-L under comparable settings. Code is available at https://github.com/YZk67/Dual-R-DETR.

目标检测TransformerDETR路由机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。