arXiv:2501.06059cs.LG2025-01被引 1

用原型分解图像,让模型解释更贴近人类思维。

COMIX: Compositional Explanations using Prototypes

  • 将图像拆解为神经网络学出的概念原型,匹配训练集中的对应区域。
  • 在ImageNet上比最优基线提升48.82%的插入评分,解释更精准且简洁。
  • 适合需要可解释决策过程的医疗、自动驾驶等高风险场景。

让机器表示与人类理解对齐是提升机器学习模型可解释性的关键。人类在分类新图像时,常通过将图像分解为概念,并指向熟悉图像中的对应区域来解释判断。现有方法通常要么追踪决策到参考原型,生成特征重要性图,或引入中间瓶颈以对齐人类可理解概念。本文提出COMIX方法:通过分解图像为基于学习概念的区域,并将每个区域匹配到训练数据中对应的原型,确保解释完整反映实际决策过程。我们从神经网络内部表示中提取测试图像的原型部分(原语),并将其与训练数据中推导出的原语进行匹配。在一系列定性和定量实验中,我们理论证明并实证表明,相比事后分析,该方法提供更高保真度的解释,且效率优于其他内生可解释架构。尤其在保真度和稀疏性指标上表现突出,在ImageNet上相较最优基线提升48.82%的C-insertion得分。

原文摘要 · Abstract (English)

Aligning machine representations with human understanding is key to improving interpretability of machine learning (ML) models. When classifying a new image, humans often explain their decisions by decomposing the image into concepts and pointing to corresponding regions in familiar images. Current ML explanation techniques typically either trace decision-making processes to reference prototypes, generate attribution maps highlighting feature importance, or incorporate intermediate bottlenecks designed to align with human-interpretable concepts. The proposed method, named COMIX, classifies an image by decomposing it into regions based on learned concepts and tracing each region to corresponding ones in images from the training dataset, assuring that explanations fully represent the actual decision-making process. We dissect the test image into selected internal representations of a neural network to derive prototypical parts (primitives) and match them with the corresponding primitives derived from the training data. In a series of qualitative and quantitative experiments, we theoretically prove and demonstrate that our method, in contrast to post hoc analysis, provides fidelity of explanations and shows that the efficiency is competitive with other inherently interpretable architectures. Notably, it shows substantial improvements in fidelity and sparsity metrics, including 48.82% improvement in the C-insertion score on the ImageNet dataset over the best state-of-the-art baseline.

可解释性原型学习图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。