让大模型像研究者一样上网查资料写报告,提升复杂任务的推理能力。
WebThinker: Empowering Large Reasoning Models with Deep Research Capability
- 大模型遇知识缺口时自动上网搜索、跳转页面并提取信息。
- 在多个复杂推理评测中超越现有方法,科学报告生成准确率显著提升。
- 适合需要深度调研与跨源信息整合的研究型任务场景。
大型推理模型(如OpenAI-o1和DeepSeek-R1)展现出强大的长程推理能力,但其依赖静态内部知识,在面对复杂、知识密集型任务时表现受限,难以生成需融合多样网络信息的综合性研究报告。为此,我们提出WebThinker,一种可自主搜索网页、跨页面导航并实时撰写报告的深度研究代理。WebThinker集成深度网络探索模块,使模型在知识空白时动态检索、跳转与提取网页信息;采用自主式‘思考-搜索-写作’策略,实现推理、信息获取与报告生成的无缝交织。为进一步提升工具使用效率,引入基于强化学习的在线迭代直接偏好优化(DPO)训练策略。在复杂推理基准(GPQA、GAIA、WebWalkerQA、HLE)与科学报告生成任务(Glaive)上的大量实验表明,WebThinker显著优于现有方法及部分专有系统。该方法增强了大模型在复杂场景下的可靠性与适用性,为更强大、更通用的深度研究系统铺平道路。代码已开源:https://github.com/RUC-NLPIR/WebThinker。
原文摘要 · Abstract (English)
Large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, demonstrate impressive long-horizon reasoning capabilities. However, their reliance on static internal knowledge limits their performance on complex, knowledge-intensive tasks and hinders their ability to produce comprehensive research reports requiring synthesis of diverse web information. To address this, we propose WebThinker, a deep research agent that empowers LRMs to autonomously search the web, navigate among web pages, and draft reports during the reasoning process. WebThinker integrates a Deep Web Explorer module, enabling LRMs to dynamically search, navigate, and extract information from the web when encountering knowledge gaps. It also employs an Autonomous Think-Search-and-Draft strategy, allowing the model to seamlessly interleave reasoning, information gathering, and report writing in real time. To further enhance research tool utilization, we introduce an RL-based training strategy via iterative online Direct Preference Optimization (DPO). Extensive experiments on complex reasoning benchmarks (GPQA, GAIA, WebWalkerQA, HLE) and scientific report generation tasks (Glaive) demonstrate that WebThinker significantly outperforms existing methods and strong proprietary systems. Our approach enhances LRM reliability and applicability in complex scenarios, paving the way for more capable and versatile deep research systems. The code is available at https://github.com/RUC-NLPIR/WebThinker.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。