提出可检测缺陷识别模型误判的可靠性指标,提升工业部署可信度。
When Can We Trust Deep Neural Networks? Towards Reliable Industrial Deployment with an Interpretability Guide

- 用类别特异性与非类别热图差异做可靠性评分
- 在两个工业数据集上实现100%误检召回率
- 适合高风险场景下需可信AI的工程应用
AI系统在工业缺陷检测、自动驾驶和医疗诊断等安全关键领域部署受限于其不可靠性。单个错误预测可能导致灾难性后果。当前系统常缺乏内部机制来标识不可靠输出,即使准确率很高也难以信赖。本文提出一种后处理解释性指标,用于检测二分类缺陷检测网络中的假阴性。这是首个能主动识别潜在错误输出的方法。核心思路是利用类别特异性与类别无关热图之间的差异,通过交并比(IoU)差值计算可靠性得分。进一步引入对抗增强方法放大该差异。在两个工业缺陷检测基准上验证,该方法有效识别假阴性;结合对抗增强后,召回率达100%,但以真负例精度下降为代价。本工作倡导新的可信部署范式:数据-模型-解释-输出,超越传统端到端系统,为真实世界可靠AI提供关键支持。
原文摘要 · Abstract (English)
The deployment of AI systems in safety-critical domains, such as industrial defect inspection, autonomous driving, and medical diagnosis, is severely hampered by their lack of reliability. A single undetected erroneous prediction can lead to catastrophic outcomes. Unfortunately, there is often no alternative but to place trust in the outputs of a trained AI system, which operates without an internal safeguard to flag unreliable predictions, even in cases of high accuracy. We propose a post-hoc explanation-based indicator to detect false negatives in binary defect detection networks. To our knowledge, this is the first method to proactively identify potentially erroneous network outputs. Our core idea leverages the difference between class-specific discriminative heatmaps and class-agnostic ones. We compute the difference in their intersection over union (IoU) as a reliability score. An adversarial enhancement method is further introduced to amplify this disparity. Evaluations on two industrial defect detection benchmarks show our method effectively identifies false negatives. With adversarial enhancement, it achieves 100\% recall, albeit with a trade-off for true negatives. Our work thus advocates for a new and trustworthy deployment paradigm: data-model-explanation-output, moving beyond conventional end-to-end systems to provide critical support for reliable AI in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。