arXiv:2410.21779cs.CL2024-10被引 8

用大模型自主推理逻辑题,比传统方法更准更稳。

Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach

  • 让大模型自己完成逻辑提取与推理,不再依赖外部求解器。
  • 在5个任务上表现超越现有方法,最高提升24.34%。
  • 采用假设演绎策略,避免搜索空间爆炸,适合复杂逻辑题。

大型语言模型(LLMs)在各类推理任务中展现出巨大潜力,包括逻辑推理。尽管已有大量工作通过外部符号求解器增强LLM的逻辑推理能力,但其对不同特征问题的泛化能力差以及符号求解器导致的信息丢失问题仍未解决。为此,我们提出LINA,一种由大模型驱动的神经符号方法,实现忠实的逻辑推理。通过使大模型自主完成从命题逻辑提取到复杂逻辑推理的全过程,LINA不仅增强了推理过程的鲁棒性,还消除了对外部求解器的依赖。此外,通过采用假设演绎推理范式,LINA有效规避了传统前向推理方法面临的庞大搜索空间难题。实证评估表明,LINA在五个逻辑推理任务上显著优于现有的命题逻辑框架和传统提示技术。具体而言,在FOLIO数据集上,相较于LINC提升了24.34%;同时,相比CoT和CoT-SC等提示策略,最高提升达24.02%。代码已公开于https://github.com/wufeiwuwoshihua/nshy。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have exhibited remarkable potential across a wide array of reasoning tasks, including logical reasoning. Although massive efforts have been made to empower the logical reasoning ability of LLMs via external logical symbolic solvers, crucial challenges of the poor generalization ability to questions with different features and inevitable question information loss of symbolic solver-driven approaches remain unresolved. To mitigate these issues, we introduce LINA, a LLM-driven neuro-symbolic approach for faithful logical reasoning. By enabling an LLM to autonomously perform the transition from propositional logic extraction to sophisticated logical reasoning, LINA not only bolsters the resilience of the reasoning process but also eliminates the dependency on external solvers. Additionally, through its adoption of a hypothetical-deductive reasoning paradigm, LINA effectively circumvents the expansive search space challenge that plagues traditional forward reasoning methods. Empirical evaluations demonstrate that LINA substantially outperforms both established propositional logic frameworks and conventional prompting techniques across a spectrum of five logical reasoning tasks. Specifically, LINA achieves an improvement of 24.34% over LINC on the FOLIO dataset, while also surpassing prompting strategies like CoT and CoT-SC by up to 24.02%. Our code is available at https://github.com/wufeiwuwoshihua/nshy.

逻辑推理大模型神经符号假设推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。