arXiv:2501.11599cs.AIcs.CL2025-01AAAI被引 2

让大模型像人一样一步步推理,解决复杂知识问题

SR-FoT: A Syllogistic-Reasoning Framework of Thought for Large Language Models Tackling Knowledge-based Reasoning Tasks

  • 模仿人类三段论推理,分步生成前提和结论
  • 在多个知识推理任务上显著提升准确率
  • 适合需要严谨逻辑推演的AI系统开发者

演绎推理是基于已有知识解决复杂问题的关键逻辑能力。尽管使用了思维链提示,大型语言模型(LLMs)仍可能无法遵循正确的推理路径。如何增强LLM的演绎推理能力,并利用其内置知识完成各类推理任务,仍是开放性问题。受人类演绎推理模式启发,我们提出一种多阶段三段论式思维框架(SR-FoT),使LLM能够进行三段论演绎推理,以应对复杂的知识型推理任务。SR-FoT首先解析问题,结合原问题提出合适的前提;随后分两阶段生成并回答次要前提问题,以匹配有效的小前提;最后引导模型利用已生成的大前提与小前提,完成三段论推理,得出原始问题的答案。在多个知识推理任务上的广泛实验表明,SR-FoT具有显著的有效性和优势。

原文摘要 · Abstract (English)

Deductive reasoning is a crucial logical capability that assists us in solving complex problems based on existing knowledge. Although augmented by Chain-of-Thought prompts, Large Language Models (LLMs) might not follow the correct reasoning paths. Enhancing the deductive reasoning abilities of LLMs, and leveraging their extensive built-in knowledge for various reasoning tasks, remains an open question. Attempting to mimic the human deductive reasoning paradigm, we propose a multi-stage Syllogistic-Reasoning Framework of Thought (SR-FoT) that enables LLMs to perform syllogistic deductive reasoning to handle complex knowledge-based reasoning tasks. Our SR-FoT begins by interpreting the question and then uses the interpretation and the original question to propose a suitable major premise. It proceeds by generating and answering minor premise questions in two stages to match the minor premises. Finally, it guides LLMs to use the previously generated major and minor premises to perform syllogistic deductive reasoning to derive the answer to the original question. Extensive and thorough experiments on knowledge-based reasoning tasks have demonstrated the effectiveness and advantages of our SR-FoT.

逻辑推理大模型三段论思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。