arXiv:2511.23136cs.CLcs.AI2025-11

通过多路径优化与筛选,提升大模型推理的准确性和效率

Multi-chain Graph Refinement and Selection for Reliable Reasoning in Large Language Models

  • 生成多条多样化推理路径,用自验证和交叉验证优化候选答案
  • 构建推理关系图并计算节点成功率,最终选最优解,平均准确率达82.9%
  • 在24点游戏上首次实现100%准确率,比领先方法快13.6倍

大型语言模型(LLMs)的复杂推理能力成为其实际应用的关键瓶颈。测试时扩展方法如思维树(ToT)和思维图(GoT)通过引入中间推理结构、树搜索或基于图的探索机制来增强推理。然而,这些方法存在推理策略多样性不足、冗余搜索分支以及异构推理路径间整合与纠错能力弱的问题。为此,我们提出一种新的推理框架——多链图精炼与选择(MGRS),首先为给定问题生成多条多样化的推理轨迹,利用复合自验证与交叉验证策略对候选回答进行精炼;随后构建推理关系图并估计中间节点的成功率,最终计算累积成功率以选择最可靠的答案及其对应推理路径。实验表明,MGRS显著提升了推理增强方法的推理能力和计算效率。在涵盖四个不同任务的六个基准数据集上,MGRS平均准确率达到82.9%,优于当前最优基线2.1个百分点。尤其在24点游戏中,MGRS首次实现100%准确率,同时相比领先的森林思维框架提速13.6倍。

原文摘要 · Abstract (English)

The complex reasoning ability of Large Language Models (LLMs) poses a critical bottleneck for their practical applications. Test-time expansion methods such as Tree-of-Thought (ToT) and Graph-of-Thought (GoT) enhance reasoning by introducing intermediate reasoning structures, tree search, or graph-based exploration mechanisms. However, their reasoning strategies suffer from limited diversity, redundant search branches, and inadequate integration and error correction across heterogeneous reasoning paths. To address these limitations, we propose a novel reasoning framework called Multi-chain Graph Refinement & Selection (MGRS), which first generates multiple diverse reasoning trajectories for a given problem, refines candidate responses using a composite self- and cross-verification strategy, then constructs a reasoning relation graph and estimates the success rate of intermediate nodes, and finally computes cumulative success rates to select the most reliable answer and corresponding reasoning trajectory. Experimental results demonstrate that MGRS significantly advances both the reasoning capability and computational efficiency of reasoning enhancement methods. Across six benchmark datasets spanning four distinct tasks, MGRS achieves an average accuracy of 82.9%, outperforming state-of-the-art baselines by a clear margin of 2.1%. Remarkably, on the 24-point game, MGRS attains 100% accuracy for the first time, while delivering a 13.6x speed-up compared to the leading Forest of Thoughts framework.

大模型推理思维图多路径优化高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。