arXiv:2411.00818cs.CVcs.AI2024-11被引 13

提出新方法提升工业检测模型的可解释性,让非专家也能看懂模型决策。

On the Black-box Explainability of Object Detection Models for Safe and Trustworthy Industrial Applications

  • 基于分割掩码改进扰动金字塔,生成模型无关的检测解释。
  • 设计新评估指标D-Deletion,更准确衡量多目标场景下的解释质量。
  • 在机器人安全工作区与电池组装场景中验证,适合高风险工业应用。

在人机交互领域,人工智能已成为加速数据建模的强大工具。目标检测方法在自动驾驶、视频监控等关键领域表现优异,但在高风险应用中因错误可能导致严重后果,其采纳仍受限。现有可解释AI方法多针对分类任务且依赖具体模型,难以适用于目标检测,且对非专业人士不友好。本文聚焦于模型无关的可解释性方法,提出基于分割掩码的D-MFPP,扩展了形态学片段扰动金字塔技术以生成解释。同时引入专为检测器设计的新指标D-Deletion,结合忠实性与定位能力。我们在真实工业与机器人数据集上评估,考察掩码数量、模型大小和图像分辨率对解释质量的影响。实验使用单阶段检测模型,在两个安全关键场景中进行:一为共享人机工作空间,安全至关重要;二为电池组装配区,高风险部件易损。结果表明,D-Deletion能有效评估同一类别多个目标共存时的解释性能;当掩码较少时,D-MFPP是D-RISE的有力替代方案。

原文摘要 · Abstract (English)

In the realm of human-machine interaction, artificial intelligence has become a powerful tool for accelerating data modeling tasks. Object detection methods have achieved outstanding results and are widely used in critical domains like autonomous driving and video surveillance. However, their adoption in high-risk applications, where errors may cause severe consequences, remains limited. Explainable Artificial Intelligence methods aim to address this issue, but many existing techniques are model-specific and designed for classification tasks, making them less effective for object detection and difficult for non-specialists to interpret. In this work we focus on model-agnostic explainability methods for object detection models and propose D-MFPP, an extension of the Morphological Fragmental Perturbation Pyramid (MFPP) technique based on segmentation-based masks to generate explanations. Additionally, we introduce D-Deletion, a novel metric combining faithfulness and localization, adapted specifically to meet the unique demands of object detectors. We evaluate these methods on real-world industrial and robotic datasets, examining the influence of parameters such as the number of masks, model size, and image resolution on the quality of explanations. Our experiments use single-stage object detection models applied to two safety-critical robotic environments: i) a shared human-robot workspace where safety is of paramount importance, and ii) an assembly area of battery kits, where safety is critical due to the potential for damage among high-risk components. Our findings evince that D-Deletion effectively gauges the performance of explanations when multiple elements of the same class appear in a scene, while D-MFPP provides a promising alternative to D-RISE when fewer masks are used.

可解释性目标检测工业应用安全系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。