arXiv:2410.15268cs.LGcs.CL2024-10ACL被引 8

让图神经网络说出决策理由,生成可懂的自然语言解释

GraphNarrator: Generating Textual Explanations for Graph Neural Networks

  • 用生成式语言模型将输入输出映射为解释,还原模型推理过程
  • 通过伪标签+专家迭代训练,解决缺乏真实解释标签的问题
  • 生成的解释更忠实、简洁且符合人类偏好,适合可解释性研究

图表示学习因在推荐系统、社交网络分析等领域的广泛应用而备受关注。尽管图学习方法不断进步,但当图包含语义特征时,可解释性仍是难题。本文提出GraphNarrator,首个为图神经网络生成自然语言解释的方法。该方法利用生成式语言模型,将输入-输出对映射为反映模型决策过程的解释。针对缺乏真实解释标签的问题,我们首先基于显著性解释生成伪标签,再通过专家迭代法迭代优化伪标签生成器,最终用高质量伪标签训练端到端解释生成模型。大量实验表明,GraphNarrator能生成忠实、简洁且受人类偏好的自然语言解释。

原文摘要 · Abstract (English)

Graph representation learning has garnered significant attention due to its broad applications in various domains, such as recommendation systems and social network analysis. Despite advancements in graph learning methods, challenges still remain in explainability when graphs are associated with semantic features. In this paper, we present GraphNarrator, the first method designed to generate natural language explanations for Graph Neural Networks. GraphNarrator employs a generative language model that maps input-output pairs to explanations reflecting the model's decision-making process. To address the lack of ground truth explanations to train the model, we propose first generating pseudo-labels that capture the model's decisions from saliency-based explanations, then using Expert Iteration to iteratively train the pseudo-label generator based on training objectives on explanation quality. The high-quality pseudo-labels are finally utilized to train an end-to-end explanation generator model. Extensive experiments are conducted to demonstrate the effectiveness of GraphNarrator in producing faithful, concise, and human-preferred natural language explanations.

图神经网络可解释性自然语言生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。