通过低密度先验学习,提升零样本未知物体检测的准确性与可靠性。
OOVDet: Low-Density Prior Learning for Zero-Shot Out-of-Vocabulary Object Detection
- 在隐空间低概率区域生成未知类提示,模拟未知语义分布。
- 利用狄利克雷梯度归因挖掘高不确定性的伪未知图像样本。
- 基于核密度估计构建低密度先验边界,有效区分已知与未知类别。
零样本未知词汇检测(ZS-OOVD)旨在零样本推理时准确识别已知类别(IV),同时可靠拒绝未定义类别(OOV)。然而,现有方法易对已知类过拟合,导致未知类被误判为高置信度已知类。为此,本文提出一种零样本未知检测框架(OOVDet),通过在隐藏空间中类条件高斯分布的低似然区域采样,生成区域级未知提示,假设未知语义更可能出现在潜在空间的低密度区域。针对未知图像,进一步设计基于狄利克雷的梯度归因机制,将梯度解释为狄利克雷证据以估计预测不确定性,筛选高不确定性样本作为伪未知图像。结合合成的未知提示与伪未知图像,利用高斯核密度估计建立低密度先验约束,构建有效的未知决策边界。实验表明,该方法显著提升了零样本场景下的未知检测性能。代码已开源:https://github.com/binyisu/OOV-detector。
原文摘要 · Abstract (English)
Zero-shot out-of-vocabulary detection (ZS-OOVD) aims to accurately recognize objects of in-vocabulary (IV) categories provided at zero-shot inference, while simultaneously rejecting undefined ones (out-of-vocabulary, OOV) that lack corresponding category prompts. However, previous methods are prone to overfitting the IV classes, leading to the OOV or undefined classes being misclassified as IV ones with a high confidence score. To address this issue, this paper proposes a zero-shot OOV detector (OOVDet), a novel framework that effectively detects predefined classes while reliably rejecting undefined ones in zero-shot scenes. Specifically, due to the model's lack of prior knowledge about the distribution of OOV data, we synthesize region-level OOV prompts by sampling from the low-likelihood regions of the class-conditional Gaussian distributions in the hidden space, motivated by the assumption that unknown semantics are more likely to emerge in low-density areas of the latent space. For OOV images, we further propose a Dirichlet-based gradient attribution mechanism to mine pseudo-OOV image samples, where the attribution gradients are interpreted as Dirichlet evidence to estimate prediction uncertainty, and samples with high uncertainty are selected as pseudo-OOV images. Building on these synthesized OOV prompts and pseudo-OOV images, we construct the OOV decision boundary through a low-density prior constraint, which regularizes the optimization of OOV classes using Gaussian kernel density estimation in accordance with the above assumption. Experimental results show that our method significantly improves the OOV detection performance in zero-shot scenes. The code is available at https://github.com/binyisu/OOV-detector.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。