arXiv:2505.16409cs.AI2025-05被引 3

让大模型自己找答案,不用外接检索器。

FREESON: Retriever-Free Retrieval-Augmented Reasoning via Corpus-Traversing MCTS

  • 用树搜索策略让模型自主遍历文档找答案
  • 在5个问答数据集上平均提升14.4%准确率
  • 适合想省去检索模块的推理系统开发者

大型推理模型在多步推理和适时调用搜索引擎方面表现出色。然而,现有检索增强推理方法依赖独立的检索模型,使大模型仅能决定何时检索和如何提问,导致硬件与运营成本上升,并因表示瓶颈(检索器嵌入空间表达能力不足)引发检索错误。为此,我们转变思路,从序列匹配转向在语料库中定位含答案路径,提出FREESON(无需检索器的检索增强推理框架)。该框架使大模型兼具生成与检索双重角色。我们引入专为检索任务设计的MCTS变体——CT-MCTS(语料库遍历蒙特卡洛树搜索),让大模型自主遍历语料库向含答案区域推进。在五个开放域问答基准测试中,包括单跳与多跳问题,FREESON相较于四种带独立检索器的多步推理模型,平均提升EM与F1达14.4%,且在PopQA和2WikiMultihopQA上分别超越最强基线3%和2%。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in multi-step reasoning and calling search engines at appropriate steps. However, existing retrieval-augmented reasoning approaches rely on separate retrieval models, limiting the LRM's role in retrieval to deciding when to retrieve and how to query. This separation not only increases hardware and operational costs but also leads to errors in the retrieval process due to the representation bottleneck, a phenomenon where the retriever's embedding space is not expressive enough to meet the generator's requirements. To address this, we shift our perspective from sequence-to-sequence matching to locating the answer-containing paths within the corpus, and propose a novel framework called FREESON (Retriever-FREE Retrieval-Augmented ReaSONing). This framework enables LRMs to retrieve relevant knowledge on their own by acting as both a generator and retriever. To achieve this, we introduce a variant of the MCTS algorithm specialized for the retrieval task, which we call CT-MCTS (Corpus-Traversing Monte Carlo Tree Search). In this algorithm, LRMs traverse through the corpus toward answer-containing regions. Our results on five open-domain QA benchmarks, including single-hop and multi-hop questions, show that FREESON achieves an average improvement of 14.4% in EM and F1 over four multi-step reasoning models with a separate retriever, and it also performs comparably to the strongest baseline, surpassing it by 3% on PopQA and 2WikiMultihopQA.

推理增强自检索树搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。