提出可解释的图神经网络,让大模型推理过程透明可控。
Ex-GraphRAG: Interpretable Evidence Routing for Graph-Augmented LLMs

- 用可分解的M-GNAN替代传统图神经网络,实现输出精确拆解。
- 发现关键节点在结构上不连通,依赖低贡献中间节点连接。
- 适合关注模型可解释性与图推理故障诊断的研究者。
GraphRAG 通过消息传递 GNN 编码从知识图谱中检索的子图来增强语言模型。由于这些编码器通过迭代邻域聚合纠缠节点贡献,无法以闭式方式确定每个实体对输出的影响,因而难以准确审计哪些结构证据真正传达到模型。本文提出 Ex-GraphRAG,将 GNN 编码器替换为多变量图神经加法网络(M-GNAN),该模型扩展了加法图模型至高维嵌入空间,可在无需后处理近似的情况下精确分解编码器输出中各节点和特征组的贡献。在 STaRK-Prime 数据集上,该可审计编码器性能媲美黑盒模型。利用其进行证据路由审计,发现语义重要性与结构连通性存在错位:主导输出的节点在检索子图中彼此结构分离,由低贡献中介节点连接;移除这些中介节点会导致多跳问答性能下降高达 28%。这一错位现象在任何不透明编码器下均不可见,表明语义重要性与结构连通性由不同节点集合控制,对检索剪枝、上下文构建及故障诊断具有直接启示。
原文摘要 · Abstract (English)
GraphRAG conditions language models on subgraphs retrieved from knowledge graphs, encoded via message-passing GNNs. Because these encoders entangle node contributions through iterated neighborhood aggregation, there is no closed-form way to determine how much each retrieved entity influenced the encoder's output, and therefore no way to faithfully audit what structural evidence actually reached the model. We introduce Ex-GraphRAG, which replaces the GNN encoder with a Multivariate Graph Neural Additive Network (M-GNAN), an extension of additive graph models to high-dimensional embedding spaces that yields an exact decomposition of the encoder's output across individual nodes and feature groups, without post-hoc approximation. On STaRK-Prime, this auditable encoder matches black-box performance. Using it to audit evidence routing, we uncover a semantic-structural mismatch: the nodes that dominate the encoder's output are structurally disconnected in the retrieved subgraph, held together by low-attribution intermediaries whose removal degrades multi-hop QA by up to 28%. This mismatch, invisible to any opaque encoder, reveals that semantic importance and structural connectivity are governed by disjoint sets of nodes, with direct implications for retrieval pruning, context construction, and failure diagnosis in graph-augmented LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。