arXiv:2608.26329cs.CL2026-08

用符号验证+神经模型,让大模型推理更靠谱。

Neuro-symbolic PRM: Enhancing Scientific Reasoning via Structured Traces and Symbolic Verification

论文配图:Neuro-symbolic PRM: Enhancing Scientific Reasoning via Structured Traces and Symbolic Verification
图 1 · 摘自论文原文
  • 分两步验证:先用符号引擎确保数学合法,再用模型判断逻辑是否合理。
  • 在数学正确前提下,识别出逻辑错误的中间步骤,准确率提升12.7%。
  • 适合需要高可靠性的科学计算场景,如物理、化学推导任务。

尽管工具增强的大语言模型显著提升了量化理工科任务中的多步推理能力,但一个关键残留缺陷仍存在:中间推理步骤语法正确、数学可执行且单位一致,却缺乏语义上下文支撑。现有方法或依赖无法评估语义意图的形式化验证器,或使过程奖励模型(PRM)同时承担算术与逻辑校验的双重负担。本文提出一种神经符号框架,将推理清晰解耦为两个形式维度:符号有效性(V)与语义扎根度(G)。通过确定性符号验证器作为硬过滤器,保证V;为评估G,我们在验证器通过的样本上训练条件PRM。为高效训练该PRM,引入反事实符号扰动(CSP),算法生成保持约束但逻辑错误的强负例。推理时采用验证器优先的受限搜索,在验证器覆盖操作中确保执行一致性,仅依赖PRM排序语义扎根度。本方法针对强工具使用型大模型的残余错误类型,显著提升推理可靠性,避免了先前框架中繁琐的启发式设计。

原文摘要 · Abstract (English)

While tool-augmented Large Language Models have significantly improved multi-step reasoning in quantitative STEM tasks, a critical residual failure mode remains: intermediate reasoning steps that are syntactically well-formed, mathematically executable, and unit-consistent, yet contextually ungrounded. Current approaches either rely on formal verifiers that cannot assess semantic intent, or burden Process Reward Models (PRMs) with the dual task of checking both arithmetic and logic. In this paper, we propose a neuro-symbolic framework that cleanly decouples reasoning into two formal dimensions: Symbolic Validity ($V$) and Semantic Groundedness ($G$). We guarantee $V$ by construction using a deterministic symbolic verifier acting as a hard filter. To assess $G$, we train a PRM conditionally on the verifier-accepted manifold. To train this PRM efficiently, we introduce Counterfactual Symbolic Perturbation (CSP), a novel data synthesis strategy that algorithmically generates constraint-preserving hard negatives (steps that perfectly pass the verifier but are logically flawed). At inference, we deploy a verifier-first constrained search that guarantees execution consistency for verifier-covered operations while relying on the PRM solely to rank semantic grounding. By targeting the exact residual error class of strong tool-using LLMs, our method significantly improves reasoning reliability without the sprawling heuristics of prior frameworks.

推理增强符号逻辑科学计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。