XGRAG让知识图谱增强的生成模型可解释,看清每条知识如何影响答案。
XGRAG: A Graph-Native Framework for Explaining KG-based Retrieval-Augmented Generation
- 用图结构扰动量化知识节点对答案的影响
- 在三个数据集上解释质量比基线高14.81%(F1)
- 适合关注AI可解释性与知识图谱应用的研究者
基于知识图谱的检索增强生成(GraphRAG)通过结构化语义上下文提升大语言模型的答案准确性,但其推理过程仍是黑箱。现有RAG可解释性方法无法有效解析图结构中的知识关联,导致透明度不足。为此,我们提出XGRAG框架,通过图扰动策略生成因果性解释,量化各图组件对模型输出的贡献。在NarrativeQA、FairyTaleQA和TriviaQA上的实验表明,XGRAG相较基准方法RAG-Ex在解释质量上提升14.81%(以F1分数衡量),且解释结果与图中心性指标高度相关,验证了其对图结构的理解能力。XGRAG为可信AI提供了一种可扩展、通用的图结构可解释方案。
原文摘要 · Abstract (English)
Graph-based Retrieval-Augmented Generation (GraphRAG) extends traditional RAG by using knowledge graphs (KGs) to give large language models (LLMs) a structured, semantically coherent context, yielding more grounded answers. However, GraphRAG reasoning process remains a black-box, limiting our ability to understand how specific pieces of structured knowledge influence the final output. Existing explainability (XAI) methods for RAG systems, designed for text-based retrieval, are limited to interpreting an LLM response through the relational structures among knowledge components, creating a critical gap in transparency and trustworthiness. To address this, we introduce XGRAG, a novel framework that generates causally grounded explanations for GraphRAG systems by employing graph-based perturbation strategies, to quantify the contribution of individual graph components on the model answer. We conduct extensive experiments comparing XGRAG against RAG-Ex, an XAI baseline for standard RAG, and evaluate its robustness across various question types, narrative structures and LLMs. Our results demonstrate a 14.81% improvement in explanation quality over the baseline RAG-Ex across NarrativeQA, FairyTaleQA, and TriviaQA, evaluated by F1-score measuring alignment between generated explanations and original answers. Furthermore, XGRAG explanations exhibit a strong correlation with graph centrality measures, validating its ability to capture graph structure. XGRAG provides a scalable and generalizable approach towards trustworthy AI through transparent, graph-based explanations that enhance the interpretability of RAG systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。