将自然语言推理转为可执行符号系统,提升逻辑可靠性。
From Natural Language to Executable Narsese: A Neuro-Symbolic Benchmark and Pipeline for Reasoning with NARS
- 用一阶逻辑和Narsese构建可执行符号表示
- 开发支持三标签判断的基准数据集和验证流程
- 适配小模型进行符号化推理,适合可信AI研究者
大语言模型在生成语言方面表现优异,但在需要显式符号结构、多步推理和可解释不确定性的任务中仍不可靠。本文提出一种神经符号框架,将自然语言推理问题转化为一阶逻辑(FOL)和Narsese形式表示,后者是非公理化推理系统(NARS)的语言。为此,我们引入NARS-Reasoning-v0.1基准,包含自然语言问题及其对应的FOL形式、可执行Narsese程序,以及三个标准答案:真、假、不确定。我们构建了从FOL到可执行Narsese的确定性编译管道,并通过OpenNARS for Applications(ONA)运行时执行验证,确保符号目标不仅语法正确,且行为上与预期答案一致。此外,提出语言结构感知(LSP)方法,训练大模型输出推理相关的符号结构而非仅最终语句。作为初步验证,我们在该数据集上训练并发布了一个Phi-2 LoRA适配器,实现三标签推理分类,证明该基准可支持监督微调与可执行评估。总体而言,本文将可执行符号生成与基于执行的验证视为构建更可靠神经符号推理系统的可行路径。
原文摘要 · Abstract (English)
Large language models (LLMs) are highly capable at language generation, but they remain unreliable when reasoning requires explicit symbolic structure, multi-step inference, and interpretable uncertainty. This paper presents a neuro-symbolic framework for translating natural-language reasoning problems into executable formal representations using first-order logic (FOL) and Narsese, the language of the Non-Axiomatic Reasoning System (NARS). To support this direction, we introduce NARS-Reasoning-v0.1, a benchmark of natural-language reasoning problems paired with FOL forms, executable Narsese programs, and three gold labels: True, False, and Uncertain. We develop a deterministic compilation pipeline from FOL to executable Narsese and validate retained examples through runtime execution in OpenNARS for Applications (ONA), ensuring that the symbolic targets are not only syntactically well formed but also behaviorally aligned with the intended answer. We further present Language-Structured Perception (LSP), a formulation in which an LLM is trained to produce reasoning-relevant symbolic structure rather than only a final verbal response. As an initial proof of concept, we also train and release a Phi-2 LoRA adapter on NARS-Reasoning-v0.1 for three-label reasoning classification, showing that the benchmark can support supervised adaptation in addition to executable evaluation. Overall, the paper positions executable symbolic generation and execution-based validation as a practical path toward more reliable neuro-symbolic reasoning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。