提出可标准化评估GNN可解释性的框架AIM,解决多模型对比难问题。
AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks

- 构建兼顾准确率、实例与模型级解释的评估框架
- 在图核网络上验证,发现原有模型局限并改进为xGKN
- 适合关注GNN可解释性提升的研究者与工程师
图神经网络(GNNs)在处理图结构数据方面取得了显著进展,但缺乏全面的可解释性评估框架。现有框架多基于事后解释,且聚焦单一模型的多个解释方法,难以跨模型比较。针对内在可解释模型的评估往往只关注特定解释维度,整体体系仍不完善。本文提出AIM框架,从准确性、实例级解释和模型级解释三个层面进行评估,设计灵活、约束少,具备广泛适用性。我们以图核网络(GKNs)和原型网络(PNs)为例,应用该框架提取并评估其解释能力,揭示其局限性,并获得关键洞察。以GKNs为案例,我们基于这些洞察开发了改进模型xGKN,其在保持高精度的同时显著提升可解释性。本方法推动了图神经网络可解释人工智能(XAI)的发展,为理解与优化复杂模型提供更稳健、实用的解决方案。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have advanced significantly in handling graph-structured data, but a comprehensive framework for evaluating explainability remains lacking. Existing evaluation frameworks primarily involve post-hoc explanations, and operate in the setting where multiple methods generate a suite of explanations for a single model. This makes comparison of explanations across models difficult. Evaluation of inherently interpretable models often targets a specific aspect of interpretability relevant to the model, but remains underdeveloped in terms of generating insight across a suite of measures. We introduce AIM, a comprehensive framework that addresses these limitations by measuring Accuracy, Instance-level explanations, and Model-level explanations. AIM is formulated with minimal constraints to enhance flexibility and facilitate broad applicability. Here, we use AIM in a pipeline, extracting explanations from inherently interpretable GNNs such as graph kernel networks (GKNs) and prototype networks (PNs), evaluating these explanations with AIM, identifying their limitations and obtaining insights to their characteristics. Taking GKNs as a case study, we show how the insights obtained from AIM can be used to develop an updated model, xGKN, that maintains high accuracy while demonstrating improved explainability. Our approach aims to advance the field of Explainable AI (XAI) for GNNs, providing more robust and practical solutions for understanding and improving complex models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。