arXiv:2603.25499cs.CVcs.LG2026-03

用知识引导检测器失效预测,提升安全关键物体识别可靠性

Knowledge-Guided Failure Prediction: Detecting When Object Detectors Miss Safety-Critical Objects

  • 通过双编码器对比检测器特征与视觉模型嵌入的语义偏差
  • 在COCO数据集上将行人召回率从64.3%提升至84.5%(误报率5%)
  • 适合自动驾驶、工业安全等对漏检敏感的高风险场景

部署于安全关键环境中的目标检测器可能无声失效,例如遗漏行人或工人等关键物体而无任何警告。传统分布外(OOD)检测方法关注识别陌生输入,但无法直接预测检测器自身的功能失效。本文提出知识引导失效预测(KGFP),一种基于表征的运行时监控框架,将遗漏关键物体的检测视为需实时识别的异常。KGFP利用双编码器架构与角度距离度量,衡量目标检测器内部特征与视觉基础模型嵌入之间的语义不一致。当检测器超出其能力范围或视觉基础模型遇到新输入时,两嵌入间产生高角度信号,可靠标记出危险图像。在COCO行人检测任务中,作为选择性预测门控使用,KGFP使被接受图像中的行人召回率从64.3%提升至84.5%,在5%误报率下表现优异,并在六个COCO-O视觉域中显著优于基线OOD方法。代码、模型与特征已公开于 https://gitlab.cc-asp.fraunhofer.de/iosb_public/KGFP。

原文摘要 · Abstract (English)

Object detectors deployed in safety-critical environments can fail silently, e.g. missing pedestrians, workers, or other safety-critical objects without emitting any warning. Traditional Out Of Distribution (OOD) detection methods focus on identifying unfamiliar inputs, but do not directly predict functional failures of the detector itself. We introduce Knowledge Guided Failure Prediction (KGFP), a representation-based monitoring framework that treats missed safety-critical detections as anomalies to be detected at runtime. KGFP measures semantic misalignment between internal object detector features and visual foundation model embeddings using a dual-encoder architecture with an angular distance metric. A key property is that when either the detector is operating outside its competence or the visual foundation model itself encounters novel inputs, the two embeddings diverge, producing a high-angle signal that reliably flags unsafe images. We compare our novel KGFS method to baseline OOD detection methods. On COCO person detection, applying KGFP as a selective-prediction gate raises person recall among accepted images from 64.3% to 84.5% at 5% False Positive Rate (FPR), and maintains strong performance across six COCO-O visual domains, outperforming OOD baselines by large margins. Our code, models, and features are published at https://gitlab.cc-asp.fraunhofer.de/iosb_public/KGFP.

目标检测失效预测安全关键视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。