用智能体搜索轨迹训练检索模型,提升自动化任务的准确率与效率。
Learning to Retrieve from Agent Trajectories

- 基于智能体多步交互行为生成检索监督信号,替代传统人工点击数据。
- 在多个深度研究任务中,检索召回率和端到端任务成功率显著提升。
- 适合构建自主推理与执行的智能体系统,尤其适用于大规模语言模型应用。
信息检索系统传统上针对人类用户设计,依赖大量人工交互日志(如点击、停留时间)进行学习。然而,随着大语言模型驱动的搜索智能体兴起,检索越来越多由智能体而非人类使用,并嵌入多轮推理与动作循环中。在此背景下,基于人类中心假设训练的检索模型与智能体查询方式及结果消费模式存在根本性不匹配。本文提出从智能体轨迹中直接学习检索的新范式——学习从智能体轨迹中检索(LRAT)。通过对搜索智能体轨迹的系统分析,识别出揭示文档价值的关键行为信号:浏览动作、未浏览的拒绝行为以及浏览后的推理痕迹。基于这些信号,我们提出一种简单而有效的框架,从智能体轨迹中挖掘高质量的检索监督信号,并通过加权优化引入相关性强度。在域内与域外深度研究基准上的大量实验表明,采用LRAT训练的检索器在不同智能体架构与规模下,均显著提升了证据召回率、端到端任务成功率与执行效率。结果表明,智能体轨迹是可扩展且实用的监督来源,为智能体时代的检索提供了新方向。
原文摘要 · Abstract (English)
Information retrieval (IR) systems have traditionally been designed and trained for human users, with learning-to-rank methods relying heavily on large-scale human interaction logs such as clicks and dwell time. With the rapid emergence of large language model (LLM) powered search agents, however, retrieval is increasingly consumed by agents rather than human beings, and is embedded as a core component within multi-turn reasoning and action loops. In this setting, retrieval models trained under human-centric assumptions exhibit a fundamental mismatch with the way agents issue queries and consume results. In this work, we argue that retrieval models for agentic search should be trained directly from agent interaction data. We introduce learning to retrieve from agent trajectories as a new training paradigm, where supervision is derived from multi-step agent interactions. Through a systematic analysis of search agent trajectories, we identify key behavioral signals that reveal document utility, including browsing actions, unbrowsed rejections, and post-browse reasoning traces. Guided by these insights, we propose LRAT, a simple yet effective framework that mines high-quality retrieval supervision from agent trajectories and incorporates relevance intensity through weighted optimization. Extensive experiments on both in-domain and out-of-domain deep research benchmarks demonstrate that retrievers trained with LRAT consistently improve evidence recall, end-to-end task success, and execution efficiency across diverse agent architectures and scales. Our results highlight agent trajectories as a practical and scalable supervision source, pointing to a promising direction for retrieval in the era of agentic search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。