提出可解释目标检测框架PIEDet,让模型自动生成有依据的检测结果。
PIEDet: Prototype-Driven Intrinsically Explainable Object Detection

- 用类别原型替代黑箱分类器,实现内在可解释性
- 在ExDark、RTTS、VOC2012-FOG上提升[email protected]达4.7%~4.8%
- 适合需要可信决策过程的安全关键场景
现有目标检测器通常以黑箱方式做出预测,难以同时提供判别性证据,限制了其在安全关键场景的应用。现有事后解释方法多依赖梯度或扰动操作,不仅增加内存与计算开销,且难以保证解释忠实于模型内部决策过程。为此,我们提出PIEDet——一种基于原型的内在可解释目标检测框架。PIEDet创新地将类别原型作为显式判别单元嵌入单阶段检测器的分类分支,既提升检测性能又实现内在可解释性。首先,在不同检测层级构建分层类别原型,使模型学习尺度感知的类别语义表示;其次,提出原型驱动的特征学习方法,包含原型正则化与区域到原型匹配损失,前者增强原型间类间区分性,后者引导原型响应聚焦于目标区域;最后,引入尺度对齐的分层原型监督机制,为不同检测层级分配匹配的监督信号,强化分层原型的尺度特异性。在ExDark、RTTS和VOC2012-FOG数据集上,PIEDet相较基线分别提升[email protected] 4.7%、1.6%和4.8%,同时表现出更优的计算效率。相比主流事后解释方法,PIEDet在解释质量与成本之间取得更好平衡。
原文摘要 · Abstract (English)
Existing object detectors typically make predictions in a black-box manner and struggle to simultaneously provide discriminative evidence for their predictions, which limits their deployment in safety-critical scenarios. To explain model predictions, existing post-hoc explanation methods mostly rely on gradient-based or perturbation-based operators. These methods not only introduce additional memory and computational overhead but also make it difficult to ensure that the generated explanations faithfully reflect the model's internal decision-making process. To address these limitations, we propose PIEDet, a prototype-driven intrinsically explainable object detection framework. PIEDet innovatively embeds class prototypes as explicit discriminative units into the classification branch of a one-stage detector, thereby improving detection performance while providing intrinsic interpretability. First, PIEDet constructs hierarchical class prototypes at different detection levels, enabling the model to learn scale-aware class-semantic representations. Second, we propose a prototype-driven feature learning method consisting of prototype regularization and a region-to-prototype matching loss. The former enhances the inter-class discriminability of the prototypes, while the latter encourages prototype responses to focus on object regions. Finally, we introduce a scale-aligned hierarchical prototype supervision mechanism that assigns scale-matched supervision signals to different detection levels, thereby enhancing the scale specificity of the hierarchical prototypes. On the ExDark, RTTS, and VOC2012-FOG datasets, PIEDet improves [email protected] over the baseline by 4.7%, 1.6%, and 4.8%, respectively, while demonstrating superior computational efficiency. Compared with mainstream post-hoc explanation methods, PIEDet achieves a better balance between explanation quality and explanation cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。