arXiv:2501.15067cs.IRcs.LG2025-01被引 18

用引文图增强大模型,让科研问答更准更懂上下文。

CG-RAG: Research Question Answering by Citation Graph Retrieval-Augmented LLMs

  • 构建引文图的上下文表示,捕捉文献间显性和隐性关联。
  • 融合关键词与语义检索信号,提升引文图检索精度。
  • 结合图结构信息生成回答,适合需要深度理解的科研场景。

科研问题回答需要精准检索和对科学文献的上下文理解。现有检索增强生成(RAG)方法常难以平衡复杂文档关系与精确信息检索。本文提出上下文图增强生成(CG-RAG)框架,通过在图结构中融合稀疏与密集检索信号,提升检索效率并改善生成质量。首先,我们设计了引文图的上下文表示,有效捕捉文档内与跨文档的显性和隐性连接。其次,提出词汇-语义图检索(LeSeGR),将稀疏与密集检索信号无缝整合进图编码,弥合了引文图检索中关键词精度与语义理解之间的差距,具备对现有图检索与混合检索方法的泛化能力。最后,提出上下文感知生成策略,利用检索到的图结构信息,指导大语言模型生成更精确且富含上下文的回应。在多个领域的科研问答基准上进行的大量实验表明,CG-RAG显著优于结合各类先进检索方法的RAG系统,在检索准确率和生成质量上均表现更优。

原文摘要 · Abstract (English)

Research question answering requires accurate retrieval and contextual understanding of scientific literature. However, current Retrieval-Augmented Generation (RAG) methods often struggle to balance complex document relationships with precise information retrieval. In this paper, we introduce Contextualized Graph Retrieval-Augmented Generation (CG-RAG), a novel framework that integrates sparse and dense retrieval signals within graph structures to enhance retrieval efficiency and subsequently improve generation quality for research question answering. First, we propose a contextual graph representation for citation graphs, effectively capturing both explicit and implicit connections within and across documents. Next, we introduce Lexical-Semantic Graph Retrieval (LeSeGR), which seamlessly integrates sparse and dense retrieval signals with graph encoding. It bridges the gap between lexical precision and semantic understanding in citation graph retrieval, demonstrating generalizability to existing graph retrieval and hybrid retrieval methods. Finally, we present a context-aware generation strategy that utilizes the retrieved graph-structured information to generate precise and contextually enriched responses using large language models (LLMs). Extensive experiments on research question answering benchmarks across multiple domains demonstrate that our CG-RAG framework significantly outperforms RAG methods combined with various state-of-the-art retrieval approaches, delivering superior retrieval accuracy and generation quality.

科研问答引文图RAG大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。