arXiv:2504.10893cs.AIcs.CL2025-04ACL被引 7

通过风险自适应搜索提升大模型在复杂推理中的表现

ARise: Towards Knowledge-Augmented Reasoning via Risk-Adaptive Search

  • 用蒙特卡洛树搜索结合风险评估,动态优化多分支推理路径
  • 在多个基准上比现有方法最高提升25.37%,误差传播问题显著缓解
  • 适合需要高可靠性推理的开放场景,如科学推演、医疗诊断

大语言模型在扩展测试时计算能力方面展现出惊人潜力,但在开放式、知识密集型复杂推理任务中仍受限。传统推理方法因假设世界知识完备而难以泛化;知识增强推理(KAR)方法则面临两大挑战:早期错误传播导致链式错误累积,以及多分支决策中探索与利用的权衡瓶颈。为此,我们提出ARise框架,将中间推理状态的风险评估与动态检索增强生成(RAG)相结合,嵌入蒙特卡洛树搜索机制,实现对多个假设分支的推理计划构建与优化。实验表明,ARise相比最先进KAR方法最高提升23.10%,相比最新RAG增强的大模型最高提升25.37%。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated impressive capabilities and are receiving increasing attention to enhance their reasoning through scaling test--time compute. However, their application in open--ended, knowledge--intensive, complex reasoning scenarios is still limited. Reasoning--oriented methods struggle to generalize to open--ended scenarios due to implicit assumptions of complete world knowledge. Meanwhile, knowledge--augmented reasoning (KAR) methods fail to address two core challenges: 1) error propagation, where errors in early steps cascade through the chain, and 2) verification bottleneck, where the explore--exploit tradeoff arises in multi--branch decision processes. To overcome these limitations, we introduce ARise, a novel framework that integrates risk assessment of intermediate reasoning states with dynamic retrieval--augmented generation (RAG) within a Monte Carlo tree search paradigm. This approach enables effective construction and optimization of reasoning plans across multiple maintained hypothesis branches. Experimental results show that ARise significantly outperforms the state--of--the--art KAR methods by up to 23.10%, and the latest RAG-equipped large reasoning models by up to 25.37%. Our project page is at https://opencausalab.github.io/ARise.

知识增强推理优化风险评估RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。