arXiv:2504.12197cs.CV2025-04AAAI被引 3

提出可解释的图像局部原型,让AI决策更透明可信。

Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI

  • 从图像有意义区域自动挖掘人类可理解的视觉原型
  • 在多个分类任务中显著提升解释性与抗遮挡鲁棒性
  • 适合需要高透明度的医疗、自动驾驶等安全场景

随着AI系统能力增强,其决策的可理解性变得愈发重要。当前深度模型解释性有限:后处理方法如GradCAM仅生成热力图,缺乏概念洞察;原型方法虽提供实例解释,但依赖固定区域且语义不一致。为此,我们提出PCMNet——一种无需额外标注即可从有意义图像区域学习人类可理解原型的部分原型挖掘网络。通过聚类原型形成概念组并提取概念激活向量,PCMNet实现结构化、概念级解释,并显著提升对遮挡和复杂条件的鲁棒性,这对构建可靠、对齐的AI系统至关重要。在多个图像分类基准上的实验表明,PCMNet在可解释性、稳定性与鲁棒性方面均优于现有最优方法。本工作通过增强AI系统的透明度、可控性与可信度,推动了AI对齐研究。代码已开源:https://github.com/alehdaghi/PCMNet。

原文摘要 · Abstract (English)

As AI systems grow more capable, it becomes increasingly important that their decisions remain understandable and aligned with human expectations. A key challenge is the limited interpretability of deep models. Post-hoc methods like GradCAM offer heatmaps but provide limited conceptual insight, while prototype-based approaches offer example-based explanations but often rely on rigid region selection and lack semantic consistency. To address these limitations, we propose PCMNet, a part-prototypical concept mining network that learns human-comprehensible prototypes from meaningful image regions without additional supervision. By clustering these prototypes into concept groups and extracting concept activation vectors, PCMNet provides structured, concept-level explanations and enhances robustness to occlusion and challenging conditions, which are both critical for building reliable and aligned AI systems. Experiments across multiple image classification benchmarks show that PCMNet outperforms state-of-the-art methods in interpretability, stability, and robustness. This work contributes to AI alignment by enhancing transparency, controllability, and trustworthiness in AI systems. Our code is available at: https://github.com/alehdaghi/PCMNet.

可解释AI原型学习视觉解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。