arXiv:2412.09229cs.CV2024-12被引 2

通过感知外观与几何不确定性,提升未知目标检测效果。

UADet: A Remarkably Simple Yet Effective Uncertainty-Aware Open-Set Object Detection Framework

  • 融合外观和几何不确定性,更精准识别未知物体
  • 未知类召回率提升1.8倍,已知类性能不下降
  • 适合需要检测未知目标的现实场景应用

我们针对开放集目标检测(OSOD)这一挑战性问题展开研究,旨在从未标注图像中同时检测已知和未知物体。由于缺乏对未知类别的监督信号,如何将其与背景区分开成为难点。现有方法或未能充分利用训练数据中丰富的未标注未知样本,或过度依赖其导致性能受限。为此,我们提出UADet,一种基于不确定性的开放集目标检测框架,同时考虑外观与几何不确定性。通过融合两类不确定性度量,UADet有效减少了以往方法中误用或遗漏的未标注实例数量。在多个OSOD基准测试上,实验表明该方法显著优于现有最先进方法:未知物体召回率提升1.8倍,同时保持对已知类别的高性能。当扩展至开放世界目标检测(OWOD)时,其在M-OWODB和S-OWODB基准上分别实现13.8%和6.9%的未知召回率提升,验证了该不确定性感知策略在多种开放集场景下的有效性。

原文摘要 · Abstract (English)

We tackle the challenging problem of Open-Set Object Detection (OSOD), which aims to detect both known and unknown objects in unlabelled images. The main difficulty arises from the absence of supervision for these unknown classes, making it challenging to distinguish them from the background. Existing OSOD detectors either fail to properly exploit or inadequately leverage the abundant unlabeled unknown objects in training data, restricting their performance. To address these limitations, we propose UADet, an Uncertainty-Aware Open-Set Object Detector that considers appearance and geometric uncertainty. By integrating these uncertainty measures, UADet effectively reduces the number of unannotated instances incorrectly utilized or omitted by previous methods. Extensive experiments on OSOD benchmarks demonstrate that UADet substantially outperforms previous state-of-the-art (SOTA) methods in detecting both known and unknown objects, achieving a 1.8x improvement in unknown recall while maintaining high performance on known classes. When extended to Open World Object Detection (OWOD), our method shows significant advantages over the current SOTA method, with average improvements of 13.8% and 6.9% in unknown recall on M-OWODB and S-OWODB benchmarks, respectively. Extensive results validate the effectiveness of our uncertainty-aware approach across different open-set scenarios.

目标检测开放集不确定性机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。