arXiv:2505.16237cs.CL2025-05被引 1

通过锚点与推理链引导双层对齐,提升图增强生成的准确性。

Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation

  • 用大模型提取关键节点和推理链,指导图与语言间的对齐。
  • 在常识推理等任务上超越18个基线模型,准确率显著提升。
  • 适合需要高可信知识生成的研究者,如医疗、法律问答场景。

尽管大语言模型具备强大能力,但仍存在幻觉和依赖过时知识的问题,影响其在知识密集型任务中的可靠性。基于图的检索增强生成(GRAG)通过检索包含关系证据的图来增强模型知识,但面临两大挑战:邻居扩展引入结构耦合的无关信息,以及图嵌入与大模型语义之间的结构-推理差异。本文提出 extbf{Align-GRAG},一种锚点与推理链引导的精炼框架,通过提示大模型提取锚点和推理链,为 extbf{(1) 节点级对齐}提供中间监督,识别关键节点并剔除噪声证据;同时通过对比学习实现 extbf{(2) 图级对齐},弥合图与语言语义空间的差距。在常识推理、场景图理解及知识图谱推理任务上的大量实验表明,该方法持续优于18个强基线,验证了其在提升图基生成质量方面的有效性。代码已公开于https://anonymous.4open.science/r/Align-GRAG-F3D8/。

原文摘要 · Abstract (English)

Despite the strong abilities, large language models (LLMs) still suffer from hallucinations and reliance on outdated knowledge, raising concerns in knowledge-intensive tasks. Graph-based retrieval-augmented generation (GRAG) enriches LLMs with knowledge by retrieving graphs leveraging relational evidence, but it faces two challenges: structure-coupled irrelevant knowledge introduced by neighbor expansion and structure-reasoning discrepancy between graph embeddings and LLM semantics. We propose \ourmodel, an anchor-and-rationale guided refinement framework to address these challenges. It prompts an LLM to extract anchors and rationale chains, which provide intermediate supervision for \textbf{(1) node-level alignment} that identifies critical nodes and prunes noisy evidence, and \textbf{(2) graph-level alignment} that bridges graph and language semantic spaces via contrastive learning. Extensive experiments on commonsense reasoning, scene graph understanding, and knowledge graph reasoning demonstrate consistent gains over 18 strong baselines, validating the effectiveness of \ourmodel for improving graph-grounded generation. The code can be found in https://anonymous.4open.science/r/Align-GRAG-F3D8/.

图神经网络知识增强大模型推理链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。