arXiv:2608.00432cs.CL2026-08被引 1

用链接结构自动生成研究任务,让模型学会高效查资料。

Deep Research Pretraining via Predictive Navigation

论文配图:Deep Research Pretraining via Predictive Navigation
图 1 · 摘自论文原文
  • 从论文引用和网页链接中提取研究路径,构造虚拟研究任务。
  • 仅用四分之一数据量,性能超过全量训练的基线模型。
  • 适合低数据场景下提升研究型AI的检索与推理能力。

深度研究智能体通常依赖昂贵的、基于环境的工具使用轨迹进行训练,涉及重复的检索、文档查阅和报告评估。本文提出离线框架深度研究预训练(DRP),通过自然存在的证据结构生成预测性导航监督信号。给定带引用或超链接的段落,DRP 构造代理研究目标,恢复相关证据及图结构替代项,并转化为搜索-打开-写作轨迹。该方法教会模型应搜索什么、查看哪些文档、如何整合证据,无需实时检索环境或策略执行。我们在学术引用图(DRP-Paper)和维基百科超链接(DRP-Web)上实现DRP,分别在10亿个标记上持续预训练独立的Qwen3-14B-Base模型,并在13,000条智能体轨迹的可控子集上微调。在五个独立采样的低数据预算子集上,两种变体均持续优于对应的无DRP模型。仅用四分之一的SFT数据,DRP-Web即超越全量数据的固定无DRP检查点,且性能提升可迁移至ResearchQA、WebWalkerQA和SimpleQA。从匹配的低数据SFT检查点出发,DRP-Web优势在后续智能体强化学习中依然存在。源匹配与证据错配控制实验表明,这些改进源于证据条件下的导航能力,而非领域暴露或代理格式模仿。因此,DRP为轨迹式智能体训练提供了有前景的补充路径。

原文摘要 · Abstract (English)

Deep research agents are often trained on expensive, environment-grounded tool-use trajectories that require repeated retrieval, document inspection, and report evaluation. We introduce Deep Research Pretraining (DRP), an offline framework that derives predictive navigation supervision from naturally occurring evidence structures. Given a citation-bearing or hyperlinked passage, DRP constructs a proxy research objective, recovers linked evidence and graph-related alternatives, and converts them into search-open-write trajectories. This teaches models what to search for, which documents to inspect, and how to synthesize evidence, without a live retrieval environment or executed policy rollout. We instantiate DRP on scholarly citation graphs (DRP-Paper) and Wikipedia hyperlinks (DRP-Web), continually pretrain separate Qwen3-14B-Base models on 1B tokens, and fine-tune them on controlled fractions of 13K agent trajectories. Across five independently sampled subsets at each low-data budget, both variants consistently outperform matched no-DRP models on DeepResearch Bench. With one quarter of the SFT data, DRP-Web even surpasses a fixed no-DRP full-data checkpoint, with gains transferring to ResearchQA, WebWalkerQA, and SimpleQA. Starting from matched low-data SFT checkpoints, the DRP-Web advantage also persists through subsequent agentic RL. Source-matched and evidence-mismatch controls indicate that these improvements arise from evidence-conditioned navigation rather than domain exposure or agent-format imitation. DRP thus provides a promising complementary approach to trajectory-based agent training.

智能体训练预训练研究辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。