提出DANCE方法,解决弱监督目标检测中定位不准、背景缺失和收敛慢问题。
Dual-Thresholded Heatmap-Guided Proposal Clustering and Negative Certainty Supervision with Enhanced Base Network for Weakly Supervised Object Detection
- 用双阈值热图选择候选框,精准捕捉完整物体并区分相邻同类实例
- 增强基础网络引入背景类表征,缩小分支间语义差距,提升定位精度
- 对被忽略候选框施加负向确定性监督,加速模型收敛,适合无标注框场景
弱监督目标检测(WSOD)近年来受到广泛关注,因其无需框级标注。现有先进方法通常采用多模块网络,以WSDDN作为多实例检测模块,并使用多实例精炼模块提升性能。然而,这些方法存在三个关键缺陷:首先,伪真实框常仅关注判别性局部区域,无法覆盖完整物体,或虽覆盖整体却无法区分相邻同类别实例;其次,基础的WSDDN架构缺乏每个候选框的背景类表征,且分支间存在显著语义鸿沟;第三,以往方法在优化时丢弃被忽略的候选框,导致收敛缓慢。为此,本文提出双阈值热图引导的候选框聚类与负向确定性监督增强基础网络(DANCE)方法。具体而言,设计热图引导的候选框选择器(HGPS),利用热图上的双阈值预选候选框,使伪真实框既能完整覆盖物体,又能区分相邻同类别实例;构建弱监督基础检测网络(WSBDN),为每个候选框增加背景类表征,并使用热图进行预监督,以弥合分支间的语义差异;最后,在被忽略的候选框上引入负向确定性监督(NCS)损失,加速收敛。在具有挑战性的PASCAL VOC和MS COCO数据集上的大量实验表明,该方法有效且优越。代码已公开于https://github.com/gyl2565309278/DANCE。
原文摘要 · Abstract (English)
Weakly supervised object detection (WSOD) has attracted significant attention in recent years, as it does not require box-level annotations. State-of-the-art methods generally adopt a multi-module network, which employs WSDDN as the multiple instance detection network module and uses multiple instance refinement modules to refine performance. However, these approaches suffer from three key limitations. First, existing methods tend to generate pseudo GT boxes that either focus only on discriminative parts, failing to capture the whole object, or cover the entire object but fail to distinguish between adjacent intra-class instances. Second, the foundational WSDDN architecture lacks a crucial background class representation for each proposal and exhibits a large semantic gap between its branches. Third, prior methods discard ignored proposals during optimization, leading to slow convergence. To address these challenges, we propose the Dual-thresholded heAtmap-guided proposal clustering and Negative Certainty supervision with Enhanced base network (DANCE) method for WSOD. Specifically, we first devise a heatmap-guided proposal selector (HGPS) algorithm, which utilizes dual thresholds on heatmaps to pre-select proposals, enabling pseudo GT boxes to both capture the full object extent and distinguish between adjacent intra-class instances. We then construct a weakly supervised basic detection network (WSBDN), which augments each proposal with a background class representation and uses heatmaps for pre-supervision to bridge the semantic gap between matrices. At last, we introduce a negative certainty supervision (NCS) loss on ignored proposals to accelerate convergence. Extensive experiments on the challenging PASCAL VOC and MS COCO datasets demonstrate the effectiveness and superiority of our method. Our code is publicly available at https://github.com/gyl2565309278/DANCE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。