通过语义对齐与去相关提升未知目标检测性能
Open-Set Object Detection By Aligning Known Class Representations
- 基于语义聚类对齐已知类别表示,增强类别分离
- 在COCO和PASCAL VOC上显著提升未知物体检测效果
- 适合关注开放集检测与模型鲁棒性的研究者
开放集目标检测(OSOD)旨在识别已知与未知目标。现有方法多采用对比聚类分离未知类别,而本文提出一种新方法:通过语义聚类对齐语义空间中的类别表示,并引入类别去相关模块增强类间分离。同时设计物体聚焦模块预测置信度,提升未知目标检测能力。此外,采用惩罚低置信输出的评估策略,降低误判风险,并提出结合已知与未知精度的调和均值指标HMP。大量实验表明,该模型在MS-COCO与PASCAL VOC数据集上的OSOD任务中取得显著提升。
原文摘要 · Abstract (English)
Open-Set Object Detection (OSOD) has emerged as a contemporary research direction to address the detection of unknown objects. Recently, few works have achieved remarkable performance in the OSOD task by employing contrastive clustering to separate unknown classes. In contrast, we propose a new semantic clustering-based approach to facilitate a meaningful alignment of clusters in semantic space and introduce a class decorrelation module to enhance inter-cluster separation. Our approach further incorporates an object focus module to predict objectness scores, which enhances the detection of unknown objects. Further, we employ i) an evaluation technique that penalizes low-confidence outputs to mitigate the risk of misclassification of the unknown objects and ii) a new metric called HMP that combines known and unknown precision using harmonic mean. Our extensive experiments demonstrate that the proposed model achieves significant improvement on the MS-COCO & PASCAL VOC dataset for the OSOD task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。