用概念重构技术提升网页问答的多源信息融合效果
CoCR-RAG: Enhancing Retrieval-Augmented Generation in Web Q&A via Concept-oriented Context Reconstruction
- 从AMR中提取核心概念,实现跨文档语义整合
- 在PopQA和EntityQuestions上超越现有方法,准确率显著提升
- 适配多种大模型,可作为通用插件集成到不同RAG系统
检索增强生成(RAG)通过引入网络等外部信息,在问答任务中展现出良好效果。然而,从异构网络中检索到的支持文档来自多个来源,具有不同的写作风格、格式和粒度差异,将这些多源文档融合成连贯且知识密集的上下文仍面临挑战,冗余和无关信息会影响答案的事实一致性。本文提出概念导向的上下文重构RAG(CoCR-RAG),通过基于语言学的概念级整合解决多源信息融合问题。具体地,我们设计了一种概念提炼算法,从抽象意义表示(AMR)中提取关键概念,该表示以逻辑图形式结构化文本语义。多个文档的提炼概念经大模型融合重建为统一的信息密集型上下文,仅补充必要句段以突出核心知识。在PopQA和EntityQuestions数据集上的实验表明,CoCR-RAG显著优于现有上下文重构方法。此外,其在多种骨干大模型上均表现出鲁棒性,可作为灵活、即插即用组件适配不同RAG框架。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) has shown promising results in enhancing Q&A by incorporating information from the web and other external sources. However, the supporting documents retrieved from the heterogeneous web often originate from multiple sources with diverse writing styles, varying formats, and inconsistent granularity. Fusing such multi-source documents into a coherent and knowledge-intensive context remains a significant challenge, as the presence of irrelevant and redundant information can compromise the factual consistency of the inferred answers. This paper proposes the Concept-oriented Context Reconstruction RAG (CoCR-RAG), a framework that addresses the multi-source information fusion problem in RAG through linguistically grounded concept-level integration. Specifically, we introduce a concept distillation algorithm that extracts essential concepts from Abstract Meaning Representation (AMR), a stable semantic representation that structures the meaning of texts as logical graphs. The distilled concepts from multiple retrieved documents are then fused and reconstructed into a unified, information-intensive context by Large Language Models, which supplement only the necessary sentence elements to highlight the core knowledge. Experiments on the PopQA and EntityQuestions datasets demonstrate that CoCR-RAG significantly outperforms existing context-reconstruction methods across these Web Q&A benchmarks. Furthermore, CoCR-RAG shows robustness across various backbone LLMs, establishing itself as a flexible, plug-and-play component adaptable to different RAG frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。