让大模型推理过程可验证可解释,提升复杂逻辑任务的可靠性
Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning
- 用形式化逻辑框架将大模型输出转化为可验证的命题表达
- 在StrategyQA和多模态任务中表现更优,开放场景下稳定性提升
- 适合需要可信推理的高风险应用,如医疗、司法等场景
大型语言模型(LLMs)虽在自然语言处理中取得突破,但在新领域和复杂逻辑序列中仍存在推理不一致问题。本文提出Proof of Thought框架,通过将LLM生成内容转换为一阶逻辑表达式,并交由定理证明器验证,显著提升输出的可靠性和透明性。核心是基于JSON的领域特定语言,兼顾逻辑严谨性与人类可读性。方法包含增强逻辑完整性的一致类型系统、显式区分事实与推论的知识表示,以及可扩展的灵活架构。在StrategyQA基准和一项新型多模态推理任务上验证了有效性,尤其在开放式场景中表现更优。该技术为高风险领域中的人机协同监督提供了可验证、可解释的推理基础。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have revolutionized natural language processing, yet they struggle with inconsistent reasoning, particularly in novel domains and complex logical sequences. This research introduces Proof of Thought, a framework that enhances the reliability and transparency of LLM outputs. Our approach bridges LLM-generated ideas with formal logic verification, employing a custom interpreter to convert LLM outputs into First Order Logic constructs for theorem prover scrutiny. Central to our method is an intermediary JSON-based Domain-Specific Language, which by design balances precise logical structures with intuitive human concepts. This hybrid representation enables both rigorous validation and accessible human comprehension of LLM reasoning processes. Key contributions include a robust type system with sort management for enhanced logical integrity, explicit representation of rules for clear distinction between factual and inferential knowledge, and a flexible architecture that allows for easy extension to various domain-specific applications. We demonstrate Proof of Thought's effectiveness through benchmarking on StrategyQA and a novel multimodal reasoning task, showing improved performance in open-ended scenarios. By providing verifiable and interpretable results, our technique addresses critical needs for AI system accountability and sets a foundation for human-in-the-loop oversight in high-stakes domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。