让搜索智能体更聪明地用工具,省计算又不丢准确率。
SlimSearcher: Training Efficiency-Aware Web Agents via Adaptive Reward Gating

- 用高效轨迹筛选训练模型,从源头培养省资源习惯。
- 减少17%到58%的工具调用次数,准确率不变或更高。
- 适合追求高效推理的AI研究者与工程落地团队。
深度研究智能体在复杂信息检索任务中表现卓越,但代价高昂。现有模型受准确率导向训练驱动,采用盲目调用工具、冗长推理的暴力策略,导致大量无效调用和令牌消耗。为突破效率瓶颈,我们提出SlimSearcher,一个在监督微调(SFT)与强化学习(RL)阶段均兼顾准确率与计算成本的系统性框架。SFT阶段通过帕累托高效过滤,提炼出成功且经济的推理轨迹,引导模型形成内在效率意识;在RL阶段引入自适应奖励门控机制,动态评估样本群体内的工具与令牌使用效率,并与严格正确性门控级联,有效避免绝对惩罚带来的简洁性偏差及奖励欺骗问题。在长时程基准测试(GAIA、BrowseComp、XBenchDeepSearch)上,SlimSearcher将平均工具调用轮次降低17%–58%,同时保持或提升准确率。
原文摘要 · Abstract (English)
Deep research agents have demonstrated remarkable capabilities in complex information-seeking tasks, yet this power comes at a steep computational cost. Driven by accuracy-focused training paradigms, current models adopt brute-force strategies characterized by blind tool dependency and performative reasoning-generating long, redundant trajectories that are far from necessary for resolving these tasks, leading to wasteful tool calls and excessive token consumption. To overcome this efficiency trap, we propose SlimSearcher, a principled framework that pushes the Pareto frontier between accuracy and computational cost across both Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). In the SFT stage, SlimSearcher employs Pareto-efficient filtration to distill trajectories that are both successful and economical, guiding the model toward inherently efficiency-aware search behaviors. During RL, we introduce Adaptive Reward Gating, a dynamic reward-shaping mechanism that evaluates relative tool and token efficiency within a sampled cohort. By cascading these adaptive efficiency metrics with a strict correctness gate, our approach effectively avoids the brevity bias associated with absolute penalties and mitigates reward hacking. Extensive experiments on long-horizon benchmarks, including GAIA, BrowseComp, and XBenchDeepSearch, demonstrate that SlimSearcher reduces average tool-call rounds by 17%-58% while maintaining or improving accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。