解耦检测与分类任务,提升开放世界目标检测性能
Decoupled PROB: Decoupled Query Initialization Tasks and Objectness-Class Learning for Open World Object Detection
- 分离物体存在性与类别预测,缓解学习冲突
- 在多个基准上超越现有方法,显著提升检测精度
- 模块化设计,可轻松集成到DETR类模型中
开放世界目标检测(OWOD)是计算机视觉中的挑战性任务,需在无监督条件下检测并分类未知物体,同时增量学习新类别而不遗忘旧类。由于未知物体缺乏真实标签,该任务尤为困难。许多方法依赖伪标签处理未知物体,而近期提出的基于概率物体性(PROB)的检测器无需伪标签即可预测物体存在概率。然而,其在物体存在性与类别预测间存在学习冲突。为此,本文提出Decoupled PROB,引入早期终止物体性预测(ETOP),在解码器适当层停止物体性预测,解决冲突;同时提出任务解耦查询初始化(TDQI),通过查询选择与可学习查询结合,高效提取已知和未知物体特征。该方法可无缝集成至现有DETR-based OWOD模型。大量实验表明,Decoupled PROB在多个基准上全面优于现有方法。
原文摘要 · Abstract (English)
Open World Object Detection (OWOD) is a challenging computer vision task that extends standard object detection by (1) detecting and classifying unknown objects without supervision, and (2) incrementally learning new object classes without forgetting previously learned ones. The absence of ground truths for unknown objects makes OWOD tasks particularly challenging. Many methods have addressed this by using pseudo-labels for unknown objects. The recently proposed Probabilistic Objectness transformer-based open-world detector (PROB) is a state-of-the-art model that does not require pseudo-labels for unknown objects, as it predicts probabilistic objectness. However, this method faces issues with learning conflicts between objectness and class predictions. To address this issue and further enhance performance, we propose a novel model, Decoupled PROB. Decoupled PROB introduces Early Termination of Objectness Prediction (ETOP) to stop objectness predictions at appropriate layers in the decoder, resolving the learning conflicts between class and objectness predictions in PROB. Additionally, we introduce Task-Decoupled Query Initialization (TDQI), which efficiently extracts features of known and unknown objects, thereby improving performance. TDQI is a query initialization method that combines query selection and learnable queries, and it is a module that can be easily integrated into existing DETR-based OWOD models. Extensive experiments on OWOD benchmarks demonstrate that Decoupled PROB surpasses all existing methods across several metrics, significantly improving performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。