arXiv:2503.08321cs.CV2025-03被引 1

让视觉图神经网络的决策过程可解释,通过局部窗口间的稀疏注意力。

i-WiViG: Interpretable Window Vision GNN

  • 用图像局部窗口构建稀疏图,限制节点感知范围。
  • 通过可学习的稀疏注意力识别关键局部区域间交互关系。
  • 在场景分类与回归任务中实现可解释且性能不逊于黑箱模型。

视觉图神经网络因其能建模图像的全局与空间上下文而成为图像识别的热门方法。然而,这类方法缺乏对预测所依赖的空间交互关系的内在可解释性。为此,我们提出 i-WiViG,一种基于图像稀疏子图实现可解释推理的方法。该方法基于两个核心假设:1)将图节点的感受野限制在图像中互不重叠的局部窗口;2)引入可学习的稀疏注意力机制作为图瓶颈,自动识别局部窗口间的相关交互。我们在自然图像与遥感影像上的场景分类和回归任务中评估该方法。定量与定性结果均表明,所识别的子图能提供语义清晰、直观且忠实的解释。此外,大量实验验证其性能可媲美黑箱模型,即使在具有强纹理偏差的数据集上亦然。代码已开源:https://github.com/zhu-xlab/i-WiViG。

原文摘要 · Abstract (English)

Vision graph neural networks have emerged as a popular approach for modeling the global and spatial context for image recognition. However, a significant drawback of these methods is that they do not offer an inherent interpretation of the relevant spatial interactions for their prediction. We address this problem by introducing i-WiViG, an approach that enables interpretable model reasoning based on a sparse subgraph in the image. i-WiViG is based on two key postulates: 1) constraining the graph nodes' receptive field to disjoint local windows in the image, and 2) an inherently interpretable graph bottleneck with learnable sparse attention that identifies the relevant interactions among the local image windows. We evaluate our approach on both scene classification and regression tasks using natural and remote sensing imagery. Our results, supported by quantitative and qualitative evidence, demonstrate that the method delivers semantic, intuitive, and faithful explanations through the identified subgraphs. Furthermore, extensive experiments confirm that it achieves competitive performance to its black-box counterparts, even on datasets exhibiting strong texture bias. The implementation is available on https://github.com/zhu-xlab/i-WiViG.

可解释性图神经网络视觉建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。