让大模型更聪明地搜索:减少调用次数,效率提升近一半。
LightSearcher: Efficient DeepSearch via Experiential Memory
- 引入经验记忆学习成功推理路径,生成可解释的摘要。
- 只在答对时惩罚重复调用工具,平衡准确与效率。
- 在多个问答任务上效率提升超40%,仍保持顶尖准确率。
DeepSearch范式已成为深度推理模型的核心能力,使其能够调用外部搜索工具获取超出参数边界的新颖、领域特定知识,从而提升推理深度和事实可靠性。基于此,强化学习(RL)的进展进一步赋予模型自主、策略性控制搜索工具的能力,优化何时及如何查询外部知识源。然而,这些基于RL的DeepSearch系统常面临准确率与效率间的权衡——频繁调用工具虽能提高事实正确性,却带来不必要的计算开销并降低效率。为此,我们提出LightSearcher,一种高效的强化学习框架,通过学习对比推理轨迹,构建文本化经验记忆以生成可解释的成功推理模式摘要;同时采用自适应奖励塑造机制,仅在正确答案场景下惩罚冗余工具调用。该设计有效缓解了DeepSearch中固有的准确率-效率矛盾。在四个多跳问答基准上的实验表明,LightSearcher在保持与最先进基线ReSearch相当的准确率的同时,将搜索工具调用减少39.6%,推理时间降低48.6%,令牌消耗减少21.2%,展现出显著的高效性。
原文摘要 · Abstract (English)
DeepSearch paradigms have become a core enabler for deep reasoning models, allowing them to invoke external search tools to access up-to-date, domain-specific knowledge beyond parametric boundaries, thereby enhancing the depth and factual reliability of reasoning. Building upon this foundation, recent advances in reinforcement learning (RL) have further empowered models to autonomously and strategically control search tool usage, optimizing when and how to query external knowledge sources. Yet, these RL-driven DeepSearch systems often reveal a see-saw trade-off between accuracy and efficiency-frequent tool invocations can improve factual correctness but lead to unnecessary computational overhead and diminished efficiency. To address this challenge, we propose LightSearcher, an efficient RL framework that incorporates textual experiential memory by learning contrastive reasoning trajectories to generate interpretable summaries of successful reasoning patterns. In addition, it employs an adaptive reward shaping mechanism that penalizes redundant tool calls only in correct-answer scenarios. This design effectively balances the inherent accuracy-efficiency trade-off in DeepSearch paradigms. Experiments on four multi-hop QA benchmarks show that LightSearcher maintains accuracy comparable to SOTA baseline ReSearch, while reducing search tool invocations by 39.6%, inference time by 48.6%, and token consumption by 21.2%, demonstrating its superior efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。