用多样化的分配策略提升DETR收敛速度,不增加推理开销。
Integrating Diverse Assignment Strategies into DETRs
- 通过多个低秩分支引入不同的一对多分配规则
- 在COCO上达到64.7% AP,超越现有方法
- 轻量设计适合各类DETR模型,训练后移除分支
标签分配是目标检测器的关键组件,尤其在DETR类框架中,一对一匹配虽具端到端简洁性,却因稀疏监督导致收敛缓慢。现有工作探索一对多分配以增强监督信号,但常引入复杂、架构特定的修改,且仅聚焦单一辅助策略,缺乏统一可扩展的设计。本文首次系统研究一对多监督的影响,发现性能提升并非源于监督数量,而在于分配策略的多样性。基于此,提出LoRA-DETR:一种灵活轻量的框架,将多种分配策略无缝集成至任意DETR类检测器。训练时通过多个低秩适应(LoRA)分支实现不同一对多分配规则,作为辅助模块注入丰富多样的梯度信号,推理时移除,零额外计算开销。该设计促进稳健联合优化,同时保持原模型结构简洁。在多个基线上的实验验证了其有效性。本工作展示了一种新范式:通过多样化一对多监督,可在不牺牲模型优雅性的情况下达成顶尖性能。
原文摘要 · Abstract (English)
Label assignment is a critical component in object detectors, particularly within DETR-style frameworks where the one-to-one matching strategy, despite its end-to-end elegance, suffers from slow convergence due to sparse supervision. While recent works have explored one-to-many assignments to enrich supervisory signals, they often introduce complex, architecture-specific modifications and typically focus on a single auxiliary strategy, lacking a unified and scalable design. In this paper, we first systematically investigate the effects of ``one-to-many'' supervision and reveal a surprising insight that performance gains are driven not by the sheer quantity of supervision, but by the diversity of the assignment strategies employed. This finding suggests that a more elegant, parameter-efficient approach is attainable. Building on this insight, we propose LoRA-DETR, a flexible and lightweight framework that seamlessly integrates diverse assignment strategies into any DETR-style detector. Our method augments the primary network with multiple Low-Rank Adaptation (LoRA) branches during training, each instantiating a different one-to-many assignment rule. These branches act as auxiliary modules that inject rich, varied supervisory gradients into the main model and are discarded during inference, thus incurring no additional computational cost. This design promotes robust joint optimization while maintaining the architectural simplicity of the original detector. Extensive experiments on different baselines validate the effectiveness of our approach. Our work presents a new paradigm for enhancing detectors, demonstrating that diverse ``one-to-many'' supervision can be integrated to achieve state-of-the-art results without compromising model elegance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。