用结构化推理草图引导LLM在RAG中更高效地获取知识。
SEEK: Steering LLM Reasoning for RAG via Internal Reasoning Sketches
- 通过生成结构化推理草图,引导分步知识获取。
- 减少重复查询,提升知识利用效率,性能优于基线模型。
- 适合需要精准知识检索与推理的问答系统研究者。
检索增强生成(RAG)通过将外部知识融入生成过程,提升了大语言模型(LLM)的表现。现有方法利用LLM的推理能力实现迭代式知识获取与积累,以更好支持答案生成。然而,随着推理轨迹增长,累积的知识与先前生成的查询可能干扰后续检索决策,导致子查询意图重复和冗余知识获取。为此,我们提出SEEK——一种基于推理草图的RAG知识获取框架。SEEK首先引导LLM为给定问题构建结构化的引导草图,包含多个引导要点组,每组后预留知识填充槽。在这些引导要点的指导下,SEEK迭代式地检索并精炼知识,填充对应槽位以完成草图。最终,完整草图作为上下文输入用于生成答案。实验结果表明,SEEK在多个任务上均优于基线模型。进一步分析显示,SEEK能生成更多样化的子查询,减少冗余检索,并在外部知识利用与内部知识冲突缓解间取得更好平衡。所有代码已公开于https://github.com/OpenBMB/PAGER。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge into the generation process. Benefiting from the reasoning capabilities of LLMs, existing methods have leveraged such capabilities to enable iterative knowledge acquisition and accumulation, thereby better supporting answer generation. However, as the reasoning trajectory grows, the accumulated knowledge and previously generated queries may interfere with subsequent retrieval decisions, resulting in sub-queries with repetitive intents and redundant knowledge acquisition. To address this issue, we propose SEEK, a sketch-guided knowledge acquisition framework for RAG. SEEK first prompts the LLM to construct a structured steering sketch for the given question. It consists of multiple groups of steering gists, with each gist followed by a slot for knowledge filling. Guided by these steering gists, SEEK iteratively retrieves and refines knowledge, and fills the corresponding slots to complete the sketch. The completed sketch is then used as contextual input for final answer generation. Experimental results show that SEEK achieves better performance than baseline models across multiple tasks. Further analyses demonstrate that SEEK can generate more diverse sub-queries, reduce redundant retrieval, and achieve a better balance between external knowledge utilization and internal knowledge conflict mitigation. All codes are available at https://github.com/OpenBMB/PAGER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。