通过提取检测器隐含知识,实现实时可解释的异常目标检测
SPK: Eliciting Structured Prior Knowledge for Interpretable Out-of-Distribution Detection in Real-Time Object Detection

- 从预训练检测器中显式挖掘局部语义先验作为判别依据
- 在多个基准上达到当前最优性能,误检率降低12%-18%
- 适合需要高可靠性与可解释性的工业级视觉系统
目标检测器在面对训练类别外的物体时常产生过度自信的预测,导致所谓的分布外(OoD)幻觉。现有方法通常直接基于检测器表征构建评分函数或修改检测器以抑制幻觉,但其隐含的先验知识尚未被充分探索和利用。为此,我们提出结构化先验知识(SPK)框架,显式挖掘预训练检测器中与幻觉相关的先验信息。SPK利用分布内数据和诱发幻觉的样本作为诊断监督,而非仅用于拒识或模型适配,从而提取支撑检测决策的部件级语义概念。这些语义先验进一步融合几何与上下文先验,形成紧凑的五维SPK表示用于OoD检测。在多种检测器架构与多个OoD基准上的实验表明,SPK实现当前最优性能。研究揭示,预训练检测器蕴含远超现有方法利用的丰富隐含知识,且该知识可通过显式挖掘组织为紧凑、结构化、可解释的知识空间,为提升检测器可靠性提供主动路径。代码与数据已公开。
原文摘要 · Abstract (English)
Object detectors often produce over-confident predictions for objects outside their training categories, leading to so-called out-of-distribution (OoD) hallucinations. Existing approaches for detecting or mitigating such hallucinations typically either construct scoring functions directly over learned object detector representations or modify the object detector itself to suppress hallucination emergence. However, the latent priors implicitly encoded in these representations remain largely unexplored and have not been explicitly decoded for OoD detection. To uncover and exploit these latent priors, we propose Structured Prior Knowledge (SPK), a hallucination-oriented framework that explicitly elicits OoD-relevant priors from pretrained object detectors. Specifically, SPK leverages in-distribution data and hallucination-inducing samples as diagnostic supervision to elicit part-level semantic concepts underlying object detector decision-making, rather than using them merely for rejection or object detector adaptation. The elicited semantic priors are further integrated with geometric and contextual priors to form a compact five-dimensional SPK representation for OoD detection. Extensive experiments across diverse object detector architectures and multiple OoD benchmarks demonstrate that SPK achieves state-of-the-art OoD detection. Our findings reveal that pretrained object detectors already encode substantially richer latent knowledge than is typically exploited for OoD detection. More importantly, this knowledge can be explicitly elicited and organized into a compact, structured, and interpretable knowledge space for prediction reliability analysis. This suggests a promising proactive route for improving object detector reliability by explicitly uncovering and leveraging latent priors. Code and data are available at: https://gricad-gitlab.univ-grenoble-alpes.fr/dnn-safety/spk
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。