模仿人类记忆机制,让大模型更准地理解并检索知识。
Understand Then Memory: A Cognitive Gist-Driven RAG Framework with Global Semantic Diffusion
- 用语义核心提取和多维知识图谱重构知识库
- 复杂问题拆解+关联检索,提升长程推理能力
- 适合需要深度推理的问答与多跳任务
检索增强生成(RAG)通过引入外部知识缓解大模型幻觉问题,但现有框架中离散文本表示常导致语义失真。受人类情景记忆启发,我们提出CogitoRAG框架,模拟认知记忆过程。离线阶段,将非结构化语料转化为包含实体、关系事实和记忆节点的多维知识图谱;在线阶段,查询分解模块将复杂问题拆分为子问题,实体扩散模块基于结构相关性和实体频次奖励机制进行关联检索。此外,提出CogniRank算法,融合扩散得分与语义相似度对候选段落精排。最终以段落-记忆配对形式提供高密度证据支持生成。在五个主流QA基准及GraphBench多任务生成测试中,CogitoRAG显著优于现有SOTA RAG方法,在复杂知识整合与推理能力上表现卓越。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) effectively mitigates hallucinations in LLMs by incorporating external knowledge. However, the inherent discrete representation of text in existing frameworks often results in a loss of semantic integrity, leading to retrieval deviations. Inspired by the human episodic memory mechanism, we propose CogitoRAG, a RAG framework that simulates human cognitive memory processes. The core of this framework lies in the extraction and evolution of the Semantic Gist. During the offline indexing stage, CogitoRAG first deduces unstructured corpora into gist memory corpora, which are then transformed into a multi-dimensional knowledge graph integrating entities, relational facts, and memory nodes. In the online retrieval stage, the framework handles complex queries via Query Decomposition Module that breaks them into comprehensive sub-queries, mimicking the cognitive decomposition humans employ for complex information. Subsequently, Entity Diffusion Module performs associative retrieval across the graph, guided by structural relevance and an entity-frequency reward mechanism. Furthermore, we propose the CogniRank algorithm, which precisely reranks candidate passages by fusing diffusion-derived scores with semantic similarity. The final evidence is delivered to the generator in a passage-memory pairing format, providing high-density information support. Experimental results across five mainstream QA benchmarks and multi-task generation on GraphBench demonstrate that CogitoRAG significantly outperforms state-of-the-art RAG methods, showcasing superior capabilities in complex knowledge integration and reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。