让大模型像人一样有逻辑地检索知识,提升问答准确率。
IGMiRAG: Intuition-Guided Retrieval-Augmented Generation with Adaptive Mining of In-Depth Memory
- 构建分层异构超图,模拟人类记忆的多粒度关联结构。
- 问答时动态控制检索深度与范围,准确率提升4.8%(EM)和5.0%(F1)。
- 适合需要高精度推理的复杂问答场景,兼顾效率与成本。
检索增强生成(RAG)为大语言模型提供了可靠的知識記憶。為加強跨文本關聯,近期研究將圖與超圖引入 RAG,以捕捉成對及多實體關係。然而,其記憶組織不一致導致檢索耗時且分散。為解決此問題,我們提出 IGMiRAG,受人類直覺推理啟發,構建分層異構超圖,對齊多粒度知識,並融入演繹路徑模擬真實記憶結構。查詢時,通過問句解析器提取直覺策略,動態控制檢索深度與記憶窗口,並使用雙焦點檢索激活即時記憶作為錨點。框架根據任務複雜度自適應調整資源分配,平均消耗6.3k+ token,最低3.0k+ token。進一步設計雙向擴散算法,沿演繹路徑挖掘深度記憶,模擬人類推理過程。大量實驗表明,IGMiRAG 總體上比最優基線高出4.8% EM 和5.0% F1。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) equips large language models (LLMs) with reliable knowledge memory. To strengthen cross-text associations, recent research integrates graphs and hypergraphs into RAG to capture pairwise and multi-entity relations as structured links. However, their misaligned memory organization necessitates costly, disjointed retrieval. To address these limitations, we propose IGMiRAG, a framework inspired by human intuition-guided reasoning. It constructs a hierarchical heterogeneous hypergraph to align multi-granular knowledge, incorporating deductive pathways to simulate realistic memory structures. During querying, IGMiRAG distills intuitive strategies via a question parser to control mining depth and memory window, and activates instantaneous memories as anchors using dual-focus retrieval. Mirroring human intuition, the framework guides retrieval resource allocation dynamically. Furthermore, we design a bidirectional diffusion algorithm that navigates deductive paths to mine in-depth memories, emulating human reasoning processes. Extensive evaluations indicate IGMiRAG outperforms the state-of-the-art baseline by 4.8% EM and 5.0% F1 overall, with token costs adapting to task complexity (average 6.3k+, minimum 3.0k+). This work presents a cost-effective RAG paradigm that improves both efficiency and effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。