用结构匹配提升事实类问答的准确率,避免大模型幻觉。
Structure Guided Retrieval-Augmented Generation for Factual Queries

- 将检索建模为基于嵌入的子图匹配,利用结构信息精准定位答案
- 在12万条复杂条件问答上,性能提升20.68至50.88点
- 适用于需要高精度的事实查询场景,如知识密集型任务
检索增强生成(RAG)旨在缓解大语言模型(LLM)中的幻觉问题,但现有方法主要依赖向量相似性检索,易受语义噪声干扰,难以满足事实类查询中复杂的条件约束,导致答案错误。为此,我们首次提出精确检索问题(Exact Retrieval Problem, ERP),明确将结构信息融入RAG以确保生成内容完全符合查询条件。针对该问题,我们提出结构引导的检索增强生成(SG-RAG),将检索过程建模为基于嵌入的子图匹配任务,并利用检索到的拓扑结构指导LLM生成满足所有条件的答案。为评估ERP,我们构建并公开发布大规模数据集ERQA,包含12万条面向事实的问答对,覆盖20个不同领域,每条问题均含复杂条件。实验表明,SG-RAG在ERQA上显著优于强基线,各项指标绝对提升达20.68至50.88点,且计算开销合理。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has been proposed to mitigate hallucinations in large language models (LLMs), where generated outputs may be factually incorrect. However, existing RAG approaches predominantly rely on vector similarity for retrieval, which is prone to semantic noise and fails to ensure that generated responses fully satisfy the complex conditions specified by factual queries, often leading to incorrect answers. To address this challenge, we introduce a novel research problem, named Exact Retrieval Problem (ERP). To the best of our knowledge, this is the first problem formulation that explicitly incorporates structural information into RAG for factual questions to satisfy all query conditions. For this novel problem, we propose Structure Guided Retrieval-Augmented Generation (SG-RAG), which models the retrieval process as an embedding-based subgraph matching task, and uses the retrieved topological structures to guide the LLM to generate answers that meet all specified query conditions. To facilitate evaluation of ERP, we construct and publicly release Exact Retrieval Question Answering (ERQA), a large-scale dataset comprising 120000 fact-oriented QA pairs, each involving complex conditions, spanning 20 diverse domains. The experimental results demonstrate that SG-RAG significantly outperforms strong baselines on ERQA, delivering absolute improvements from 20.68 to 50.88 points across all evaluation metrics, while maintaining reasonable computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。