arXiv:2606.12087cs.CL2026-06被引 2

提出新方法生成抗捷径的搜索任务,让深度搜索模型更难走后门。

FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents

论文配图:FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents
图 1 · 摘自论文原文
  • 设计框架识别四种捷径风险并控制其影响。
  • 生成数据使搜索路径变长,捷径使用减少60%以上。
  • 训练出的搜索代理在公开榜单表现最佳,适合研究者参考。

训练深度搜索代理需要可验证的问题,答案必须在充分检索后才能获得。现有合成方法通过丰富图结构提升难度,但结构复杂度本身无法保证实际搜索难度——搜索过程可能因更廉价的识别路径而失效。本文提出一个考虑捷径的难度评估框架,识别出四种可操作的捷径风险:证据共覆盖、单线索选择性、暴露常量和先验知识绑定。通过轨迹特征(求解成本、答案命中时间、先验捷径率)诊断其实际影响。基于此,提出FORT框架,通过控制实体选择、证据图构建、问题生成和对抗优化四个环节来生成抗捷径的训练数据。实验表明,与现有开源数据集相比,FORT生成的数据能诱导更长的预答搜索路径,且捷径模式减少超过60%。基于这些轨迹,仅用监督微调训练的FORT-Searcher在多个深度搜索基准测试中达到同等规模开源模型的最优性能。相关资源将发布于 https://github.com/RUCAIBox/FORT-Searcher。

原文摘要 · Abstract (English)

Training deep search agents requires verifiable questions whose answers remain unavailable until sufficient evidence has been acquired through search. Existing synthesis methods often increase apparent difficulty by enriching graph structures, but structural complexity alone does not guarantee realized search difficulty: the intended search process can collapse through a cheaper identifying route. We formalize this gap with a shortcut-aware difficulty framework and identify four actionable shortcut risks: evidence co-coverage, single-clue selectivity, exposed constants, and prior-knowledge binding. To diagnose their realized effects, we use trajectory signatures including solving cost, answer hit time, and prior-shortcut rate. Guided by this framework, we introduce FORT, a Framework of Shortcut-Resistant Training-Data Synthesis. FORT constructs shortcut-resistant training data by controlling shortcut risks across entity selection, evidence graph construction, question formulation, and adversarial refinement. Experiments show that FORT induces longer pre-answer search and fewer shortcut patterns than existing open-source deep search datasets. Using the resulting trajectories, we train FORT-Searcher with supervised fine-tuning (SFT) only, and it achieves the best overall performance among comparable-size open-source search agents on challenging deep search benchmarks. Relevant resources will be made available at https://github.com/RUCAIBox/FORT-Searcher.

搜索代理抗捷径数据合成深度搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。