arXiv:2608.01867cs.CL2026-08

让搜索代理学会识别关键步骤,高效减少无用操作。

CRISP: Critical Step Perception for Training Efficient Deep Search Agents

论文配图:CRISP: Critical Step Perception for Training Efficient Deep Search Agents
图 1 · 摘自论文原文
  • 通过反向证据推理标注每步是否关键,区分必要与冗余操作。
  • 在两个数据集上分别减少15.1%和33.2%的交互轮次。
  • 适合需要高效率长流程推理的应用场景。

大型语言模型正被扩展为通过多步交互外部搜索与浏览工具解决复杂问题的深度搜索代理。然而,现有代理常产生冗长轨迹,包含重复查询、低效探索和无关观察,导致计算与交互成本高昂。现有效率方法通常降低工具使用频率,但对所有工具调用一视同仁,可能抑制获取必要证据的关键步骤。本文提出CRISP框架,通过关键步骤感知训练高效搜索代理。不同于以往统一惩罚工具使用的做法,CRISP区分必要证据获取与冗余操作,在训练奖励中保留前者、剪除后者,实现效率提升而不损失答案准确性。具体而言,CRISP首先利用强模型从最终答案反向遍历完整搜索轨迹,判断每一步工具交互是否提供或保留了答案所需证据,从而构建关键步骤标签;随后将这些步骤判断提炼为小型关键步骤识别器,支持单次遍历完成全轨迹分析。在策略优化阶段,仅对成功回放轨迹应用考虑效率的奖励。在BrowseComp和HLE-Verified数据集上的实验表明,CRISP在保持竞争性最终答案准确率的同时,平均交互轮次分别减少了15.1%和33.2%,显著提升了交互效率。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly extended into deep search agents that solve complex questions through multi-step interaction with external search and browsing tools. However, existing agents often incur substantial computational and interaction costs, generating lengthy trajectories that contain redundant queries, inefficient exploration, and irrelevant observations. Existing efficiency-oriented methods usually encourage agents to use tools less frequently, but treating all tool interactions uniformly may also suppress steps that gather necessary evidence. In this paper, we propose CRISP, a framework for training efficient deep search agents through critical step perception. Unlike prior efficiency methods that uniformly penalize tool use, CRISP distinguishes interactions that gather necessary evidence from redundant ones and shapes the training reward to preserve the former while pruning the latter, improving efficiency without sacrificing the evidence needed for correct answers. Specifically, CRISP first constructs critical-step labels with Backward Evidence Induction: starting from the final answer, a strong model traverses a completed search trajectory backward and judges whether each tool-interaction step provides or preserves evidence for the final answer. We then distill these step-wise judgments into a smaller critical-step recognizer, enabling full-trajectory analysis in a single pass. During policy optimization, an efficiency-aware reward is applied only to successful rollouts. Experiments on BrowseComp and HLE-Verified show that CRISP maintains competitive final-answer accuracy while reducing average interaction turns by 15.1% and 33.2%, respectively, demonstrating substantial improvements in interaction efficiency.

搜索代理效率优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。