arXiv:2504.14089cs.CLcs.AI2025-04EMNLP被引 1

用结构化搜索提升大模型逻辑推理能力,避免混乱与重复。

LogicTree: Structured Proof Exploration for Coherent and Rigorous Logical Reasoning with Large Language Models

  • 构建树状推理框架,分步筛选前提并缓存历史知识
  • 在五个数据集上比CoT高23.6%,比ToT高12.5%的准确率
  • 适合需要严谨推理的数学、编程等任务场景

大语言模型在多步推理中表现优异,但在复杂逻辑推理中仍面临两大挑战:一是证明寻找需系统探索并保持逻辑连贯性;二是每一步需从大量前提中选择正确组合,计算复杂。为此,我们提出LogicTree,一种推理时模块化框架,采用算法引导搜索实现结构化证明探索并保障逻辑连贯性。相比Tree-of-Thought(ToT),LogicTree引入缓存机制,有效利用历史知识,防止推理停滞与冗余。同时,通过将前提搜索分解为线性过程,将每步推导限制在最多一个结论,增强推理粒度并强制逐步推理。此外,引入两个无需大模型的启发式策略进行前提优先级排序,支持战略性搜索。在五个数据集上的实验表明,LogicTree能高效扩展推理计算,在GPT-4o上相较Chain-of-Thought(CoT)和ToT分别提升平均23.6%和12.5%的证明准确率。在LogicTree内,GPT-4o相较o3-mini平均高出7.6%。

原文摘要 · Abstract (English)

Large language models (LLMs) have achieved remarkable multi-step reasoning capabilities across various domains. However, LLMs still face distinct challenges in complex logical reasoning, as (1) proof-finding requires systematic exploration and the maintenance of logical coherence and (2) searching the right combination of premises at each reasoning step is inherently challenging in tasks with large premise space. To address this, we propose LogicTree, an inference-time modular framework employing algorithm-guided search to automate structured proof exploration and ensure logical coherence. Advancing beyond tree-of-thought (ToT), we incorporate caching mechanism into LogicTree to enable effective utilization of historical knowledge, preventing reasoning stagnation and minimizing redundancy. Furthermore, we address the combinatorial complexity of premise search by decomposing it into a linear process. The refined premise selection restricts subsequent inference to at most one derivation per step, enhancing reasoning granularity and enforcing strict step-by-step reasoning. Additionally, we introduce two LLM-free heuristics for premise prioritization, enabling strategic proof search. Experimental results on five datasets demonstrate that LogicTree optimally scales inference-time computation to achieve higher proof accuracy, surpassing chain-of-thought (CoT) and ToT with average gains of 23.6% and 12.5%, respectively, on GPT-4o. Moreover, within LogicTree, GPT-4o outperforms o3-mini by 7.6% on average.

逻辑推理大模型结构搜索推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。