arXiv:2412.18644cs.CLcs.AI2024-12被引 2

动态优化知识图谱子图,提升语言模型理解与生成能力

DynaGRAG | Exploring the Topology of Information for Advancing Language Understanding and Generation in Graph Retrieval-Augmented Generation

  • 通过动态相似性感知遍历算法,智能筛选相关且多样的子图
  • 结合去重与双阶段池化,增强实体与关系的表征效果
  • 适合需要精准知识推理的对话系统与问答任务

图检索增强生成(Graph RAG)旨在通过外部知识提升语言理解和生成能力,但如何有效捕捉文本与结构化数据中的丰富语义信息仍是挑战。为此,本文提出动态图检索增强生成(DynaGRAG)框架,聚焦于提升知识图谱中子图的表征能力和多样性。通过去重处理、两步均值池化嵌入、考虑唯一节点的查询感知检索,以及动态相似性感知广度优先搜索(DSA-BFS)遍历算法,实现对相关且多样子图的动态优先排序。结合图卷积网络(GCNs)与大语言模型(LLMs)的硬提示机制,进一步强化节点与边的丰富表征,同时保留子图的层级结构。实验表明,增强的子图表征与多样性显著提升了语言理解与生成性能。

原文摘要 · Abstract (English)

Graph Retrieval-Augmented Generation (GRAG or Graph RAG) architectures aim to enhance language understanding and generation by leveraging external knowledge. However, effectively capturing and integrating the rich semantic information present in textual and structured data remains a challenge. To address this, a novel GRAG framework, Dynamic Graph Retrieval-Agumented Generation (DynaGRAG), is proposed to focus on enhancing subgraph representation and diversity within the knowledge graph. By improving graph density, capturing entity and relation information more effectively, and dynamically prioritizing relevant and diverse subgraphs and information within them, the proposed approach enables a more comprehensive understanding of the underlying semantic structure. This is achieved through a combination of de-duplication processes, two-step mean pooling of embeddings, query-aware retrieval considering unique nodes, and a Dynamic Similarity-Aware BFS (DSA-BFS) traversal algorithm. Integrating Graph Convolutional Networks (GCNs) and Large Language Models (LLMs) through hard prompting further enhances the learning of rich node and edge representations while preserving the hierarchical subgraph structure. Experimental results demonstrate the effectiveness of DynaGRAG, showcasing the significance of enhanced subgraph representation and diversity for improved language understanding and generation.

知识图谱语言模型图检索生成增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。