arXiv:2501.05366cs.AIcs.CL2025-01EMNLP被引 450

让大模型推理更准:动态搜索外部知识并深度分析

Search-o1: Agentic Search-Enhanced Large Reasoning Models

  • 引入智能检索机制,在推理中动态获取外部知识
  • 在科学、数学、编程等任务上显著提升准确率
  • 适合需要高可信度推理的复杂任务场景

大型推理模型(LRMs)如OpenAI-o1通过大规模强化学习展现出强大的多步推理能力,但其长期推理过程常因知识不足导致不确定性与错误。为此,我们提出Search-o1框架,通过智能体式检索增强生成(RAG)机制和文档内推理模块,提升外部知识利用效率。Search-o1将智能体搜索流程嵌入推理链,在模型遇到知识不确定时动态检索外部信息;针对检索结果冗长的问题,设计独立的‘文档内推理’模块,深入分析检索内容后再注入推理链,降低噪声并保持逻辑连贯性。在科学、数学、编码等复杂推理任务及六个开放域问答基准上进行的大量实验表明,Search-o1表现优异。该方法显著提升了LRMs在复杂任务中的可信度与适用性,为构建更可靠、通用的智能系统奠定基础。代码已开源。

原文摘要 · Abstract (English)

Large reasoning models (LRMs) like OpenAI-o1 have demonstrated impressive long stepwise reasoning capabilities through large-scale reinforcement learning. However, their extended reasoning processes often suffer from knowledge insufficiency, leading to frequent uncertainties and potential errors. To address this limitation, we introduce \textbf{Search-o1}, a framework that enhances LRMs with an agentic retrieval-augmented generation (RAG) mechanism and a Reason-in-Documents module for refining retrieved documents. Search-o1 integrates an agentic search workflow into the reasoning process, enabling dynamic retrieval of external knowledge when LRMs encounter uncertain knowledge points. Additionally, due to the verbose nature of retrieved documents, we design a separate Reason-in-Documents module to deeply analyze the retrieved information before injecting it into the reasoning chain, minimizing noise and preserving coherent reasoning flow. Extensive experiments on complex reasoning tasks in science, mathematics, and coding, as well as six open-domain QA benchmarks, demonstrate the strong performance of Search-o1. This approach enhances the trustworthiness and applicability of LRMs in complex reasoning tasks, paving the way for more reliable and versatile intelligent systems. The code is available at \url{https://github.com/sunnynexus/Search-o1}.

大模型推理检索增强智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。