让AI智能决定何时搜、怎么搜、搜多细,提升复杂问答准确率
GRASP: GRanularity-Aware Search Policy for Agentic RAG

- 用强化学习训练AI动态选择语义搜索、关键词搜索和段落阅读三种检索方式
- 在多跳问答任务中,召回率和答对率均显著优于传统方法
- 能自动判断信息粒度,适合需要精细推理的复杂问答场景
代理式检索增强生成(Agentic RAG)通过让语言模型迭代地推理、生成搜索查询、检索证据并预测答案,扩展了静态RAG。然而,模型仍难以判断何时检索、使用词法匹配还是语义相似性,以及如何控制上下文粒度以避免无关内容干扰推理。本文提出GRASP,一种基于强化学习的框架,用于训练代理在多步推理中自适应协调互补的检索工具。GRASP提供语义搜索、关键词搜索和段落阅读三种动作,使代理仅在必要时检索句子级证据并扩展上下文。通过联合考虑答案准确率、基于证据的阅读、互补搜索和回合效率的奖励函数进行训练。在多跳推理基准上的实验表明,相比单步检索、基于提示的代理RAG和基于RL的检索基线,GRASP在检索召回率和下游问答性能上均有提升。定性和消融分析显示,学习到的策略展现出可解释的快速浏览与深度扫描行为:使用语义搜索进行广域探索,段落阅读进行局部验证,关键词搜索获取特定实体证据。结果表明,学习协调检索信号与上下文粒度对正确推理至关重要。
原文摘要 · Abstract (English)
Agentic retrieval-augmented generation (RAG) extends static RAG by allowing language models to iteratively reason, generate search queries, retrieve evidence, and predict answers. However, it remains challenging for models to decide when to retrieve, whether to use lexical matching or semantic similarity, and how to control context granularity to prevent irrelevant tokens from interfering with agent reasoning. In this paper, we introduce GRASP, a reinforcement learning (RL) framework for training agents to adaptively coordinate complementary retrieval tools during multi-step reasoning. GRASP provides the agent with semantic search, keyword search, and paragraph-reading actions, enabling it to retrieve sentence-level evidence and expand further context only when needed. We train the policy with a reward that jointly accounts for answer accuracy, grounded reading, complementary search, and turn efficiency. Experiments on multi-hop reasoning benchmarks show that GRASP improves both retrieval recall and downstream question answering performance compared with single-step retrieval, prompting-based agentic RAG, and RL-based retrieval baselines. Qualitative and ablation analyses show that the learned policy develops interpretable skimming and scanning behavior: it uses semantic search for broad exploration, paragraph reading for local verification, and keyword search for entity-specific evidence. These results suggest that learning to coordinate retrieval signals and context granularity is critical for agent's correct reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。