用类别查询缓解稀有类别学习信号不足问题,提升大规模目标检测性能。
CQ-DINO: Mitigating Gradient Dilution via Category Queries for Vast Vocabulary Object Detection
- 将分类转为查询对比任务,通过图像引导选择相关类别减少负样本干扰。
- 在V3Det上比之前方法高2.1%的平均精度,COCO上保持竞争力。
- 适合需要广泛类别覆盖的现实场景目标检测系统。
随着数据爆炸式增长,传统目标检测方法在处理大规模词汇量检测任务时日益乏力。我们分析了基于分类的检测器两个关键局限:正样本梯度稀释(稀有正类别获得的学习信号不足)和难负样本梯度稀释(判别性梯度被大量易负样本淹没)。为此,我们提出CQ-DINO,一种基于类别查询的目标检测框架,将分类重构为物体查询与可学习类别查询之间的对比任务。该方法引入图像引导的查询选择机制,通过交叉注意力自适应地为每张图像检索前K个相关类别,从而缩小负样本空间,重平衡梯度分布,并实现隐式难例挖掘。此外,CQ-DINO在结构化数据集(如V3Det)中灵活融合显式层级类别关系,或在通用数据集(如COCO)中通过自注意力学习隐式类别关联。实验表明,CQ-DINO在具有挑战性的V3Det基准上表现优异,平均精度超越先前方法2.1%;在COCO上仍具竞争力。本工作为需要广泛类别覆盖的真实检测系统提供了可扩展解决方案。代码已公开于https://github.com/FireRedTeam/CQ-DINO。
原文摘要 · Abstract (English)
With the exponential growth of data, traditional object detection methods are increasingly struggling to handle vast vocabulary object detection tasks effectively. We analyze two key limitations of classification-based detectors: positive gradient dilution, where rare positive categories receive insufficient learning signals, and hard negative gradient dilution, where discriminative gradients are overwhelmed by numerous easy negatives. To address these challenges, we propose CQ-DINO, a category query-based object detection framework that reformulates classification as a contrastive task between object queries and learnable category queries. Our method introduces image-guided query selection, which reduces the negative space by adaptively retrieving top-K relevant categories per image via cross-attention, thereby rebalancing gradient distributions and facilitating implicit hard example mining. Furthermore, CQ-DINO flexibly integrates explicit hierarchical category relationships in structured datasets (e.g., V3Det) or learns implicit category correlations via self-attention in generic datasets (e.g., COCO). Experiments demonstrate that CQ-DINO achieves superior performance on the challenging V3Det benchmark (surpassing previous methods by 2.1% AP) while maintaining competitiveness in COCO. Our work provides a scalable solution for real-world detection systems requiring wide category coverage. The code is publicly at https://github.com/FireRedTeam/CQ-DINO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。