用动态索引锚定关键信息,让大模型更准地找证据、做推理。
Finding What Matters: Anchoring Context Knowledge with Evolving Indices for Iterative Retrieval
- 通过迭代更新知识索引,逐步锚定检索文档中的关键证据。
- 在四个多跳问答数据集上超越主流RAG基线,最高提升12.3%准确率。
- 适合需要精准推理和抗噪声的复杂问答场景,尤其擅长处理分散证据。
检索增强生成(RAG)已成为缓解大语言模型幻觉的主流范式,通过引入外部知识提升回答准确性。然而,现有RAG系统在整合和推理分散于嘈杂检索文档中的关键证据时表现不佳,尤其在多跳问答任务中更为明显。本文提出KAIR框架,通过在迭代检索过程中动态更新知识索引,将关键信息锚定在检索内容中,引导大模型精准定位核心证据。该演进索引作为导航锚点,帮助模型评估知识充分性并生成更优的后续查询。最终,系统结合检索文档与最终锚定索引生成答案。在四个多跳问答基准上的实验表明,KAIR持续优于强基线模型。进一步分析显示,该方法有效锚定关键知识,降低上下文噪声,显著提升模型对跨文档分散证据的关联与推理能力。所有代码与数据已开源。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has become a dominant paradigm for mitigating hallucinations in Large Language Models (LLMs) by incorporating external knowledge. However, existing RAG systems often struggle to effectively integrate and reason over key evidence scattered across noisy retrieved documents, particularly in multi-hop scenarios. In this paper, we propose KAIR, a Knowledge Anchoring framework for Iterative Retrieval that anchors knowledge within retrieved knowledge to guide LLMs to locate the key information. During iterative retrieval, KAIR progressively updates the knowledge index to anchor salient evidence from retrieved documents. The evolving index serves as a navigational anchoring index that enables the LLM to assess knowledge sufficiency and formulate subsequent retrieval queries. Finally, KAIR generates answers by jointly leveraging the retrieved documents and the finalized anchoring index. Experiments on four multi-hop question answering benchmarks demonstrate that KAIR consistently outperforms strong RAG baselines. Further analysis shows that KAIR effectively anchors key knowledge and alleviates the context noise during iterative retrieval, improving the LLM's ability to associate and reason over dispersed evidence across retrieved documents. All code and data are available at https://github.com/NEUIR/KAIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。