用全局语义单元优化检索生成,解决局部信息歧义问题。
GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework
- 基于全局合并语义单元,消除局部文本的歧义和耦合。
- 在多任务上生成质量优于传统RAG方法。
- 适合需要精准语义理解的复杂问答与生成场景。
在标准图结构检索增强生成(RAG)基础上,引入异构图和超图以通过语义单元(SUs)概念丰富实体间关系的检索与生成。然而,仅限于局部文本块提取高层语义单元易导致歧义、复杂耦合及检索开销增加,因缺乏全局知识或忽视细粒度关系。为此,我们提出GOSU框架,通过全局层次的语义单元优化,实现高效消歧,并利用语义单元捕捉跨全局上下文的节点关联。在图构建阶段,对局部文本块预提取的语义单元进行全局合并,指导实体与关系抽取,降低共指消解难度,揭示跨文本块的全局语义对象。在检索与生成阶段,引入分层关键词提取与语义单元补全:前者挖掘被后者忽略的细粒度二元关系,后者弥补前者缺失的粗粒度多元关系。多任务评估表明,GOSU在生成质量上超越基线RAG方法。
原文摘要 · Abstract (English)
Building upon the standard graph-based Retrieval-Augmented Generation (RAG), the introduction of heterogeneous graphs and hypergraphs aims to enrich retrieval and generation by leveraging the relationships between multiple entities through the concept of semantic units (SUs). But this also raises a key issue: The extraction of high-level SUs limited to local text chunks is prone to ambiguity, complex coupling, and increased retrieval overhead due to the lack of global knowledge or the neglect of fine-grained relationships. To address these issues, we propose GOSU, a semantic unit-centric RAG framework that efficiently performs global disambiguation and utilizes SUs to capture interconnections between different nodes across the global context. In the graph construction phase, GOSU performs global merging on the pre-extracted SUs from local text chunks and guides entity and relationship extraction, reducing the difficulty of coreference resolution while uncovering global semantic objects across text chunks. In the retrieval and generation phase, we introduce hierarchical keyword extraction and semantic unit completion. The former uncovers the fine-grained binary relationships overlooked by the latter, while the latter compensates for the coarse-grained n-ary relationships missing from the former. Evaluation across multiple tasks demonstrates that GOSU outperforms the baseline RAG methods in terms of generation quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。