通过博弈论方法生成更忠实的图神经网络解释子图。
GISExplainer: On Explainability of Graph Neural Networks via Game-theoretic Interaction Subgraphs
- 用多粒度联盟博弈机制量化边对预测的因果影响。
- 同时考虑正负交互作用,提升解释的完整性。
- 适合关注模型可信性与可解释性的研究人员。
可解释性对黑箱图神经网络在医疗、金融、网络安全等关键领域的应用至关重要。现有特征归因方法,尤其是基于扰动的方法,难以生成连通且反映边间因果交互的解释子图,导致解释不准确。本文提出GISExplainer,一种基于博弈论交互的新型解释方法,通过发现人类可理解的因果解释子图来揭示图神经网络在节点分类任务中的学习机制。首先,定义了一种因果归因机制,考虑候选解释子图中多粒度联盟间的博弈交互,量化边对预测的因果效应;其次,认为对预测产生负向影响的联盟同样重要,计算图的贡献来自正负交互的共同作用。然后,将解释过程建模为序列决策过程,逐个选择显著边并连接至已有子图,以形成解释子图。此外,通过联盟采样优化因果归因机制的效率。大量实验表明,GISExplainer在保真度(Fidelity)和稀疏性(Sparsity)两项指标上均优于当前最优方法。
原文摘要 · Abstract (English)
Explainability is crucial for the application of black-box Graph Neural Networks (GNNs) in critical fields such as healthcare, finance, cybersecurity, and more. Various feature attribution methods, especially the perturbation-based methods, have been proposed to indicate how much each node/edge contributes to the model predictions. However, these methods fail to generate connected explanatory subgraphs that consider the causal interaction between edges within different coalition scales, which will result in unfaithful explanations. In our study, we propose GISExplainer, a novel game-theoretic interaction based explanation method that uncovers what the underlying GNNs have learned for node classification by discovering human-interpretable causal explanatory subgraphs. First, GISExplainer defines a causal attribution mechanism that considers the game-theoretic interaction of multi-granularity coalitions in candidate explanatory subgraph to quantify the causal effect of an edge on the prediction. Second, GISExplainer assumes that the coalitions with negative effects on the predictions are also significant for model interpretation, and the contribution of the computation graph stems from the combined influence of both positive and negative interactions within the coalitions. Then, GISExplainer regards the explanation task as a sequential decision process, in which a salient edges is successively selected and connected to the previously selected subgraph based on its causal effect to form an explanatory subgraph, ultimately striving for better explanations. Additionally, an efficiency optimization scheme is proposed for the causal attribution mechanism through coalition sampling. Extensive experiments demonstrate that GISExplainer achieves better performance than state-of-the-art approaches w.r.t. two quantitative metrics: Fidelity and Sparsity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。