让大模型推理过程可解释,精准定位错误步骤并生成可信证据。
SymDiag: Explainable Diagnosis for LLM Reasoning via Neuro-Symbolic Verification

- 将自然语言推理链转为符号约束,逐步验证逻辑一致性。
- 在多个推理任务中检测到90%以上的不忠实推理,效果优于传统方法。
- 适合需要可解释性与可修复性的高可靠性推理场景。
大型语言模型(LLM)越来越多地作为数据驱动的推理系统使用,但其思维链(CoT)即使最终答案正确,也可能存在不忠实的问题。现有验证方式多不具备诊断能力:仅匹配答案无法发现过程错误,大模型自评主观且不可验证,标量奖励(如PRMs/RMs)也难以定位多步推导中的具体失败点。我们提出 extbf{SymDiag},一种神经符号框架,将推理验证重构为结构化故障诊断。SymDiag将自然语言推理链转化为符号约束,并通过步骤级的可满足性/蕴含检查实现(i)定位失败步骤,(ii)生成可验证的诊断证据,包括反例、矛盾见证和缺失前提指示。核心挑战在于,表面的“逻辑违规”可能源于推理缺陷或神经-符号转换噪声。因此,SymDiag引入自审计模块,通过双重符号编码一致性检查,分离翻译误差与推理误差,在部分可观测条件下仍能实现鲁棒诊断。在涵盖数学、逻辑、科学及通用推理的多种基准测试中,SymDiag显著提升了对不忠实推理的检测能力,并为多轮推理修复提供了更有效的反馈,优于仅基于结果的验证和基于大模型评判的方法,为可信且可扩展的推理诊断提供了原则性基础。
原文摘要 · Abstract (English)
Large language models (LLMs) increasingly serve as data-driven reasoners, yet their chains-of-thought (CoT) can be unfaithful even when final answers are correct. Most existing ``verification'' signals are not diagnostic: answer matching observes only the outcome, LLM-as-judge provides subjective and non-verifiable critiques, and scalar rewards (e.g., PRMs/RMs) offer little insight into where a multi-step derivation fails.We propose \textbf{SymDiag}, a neuro-symbolic framework that \textbf{reframes reasoning verification as structured failure diagnosis}. SymDiag translates natural-language CoT into symbolic constraints and performs step-level satisfiability/entailment checks to (i) localize failing steps and (ii) produce verifiable diagnostic evidence, including counterexamples, inconsistency witnesses, and missing-premise indicators. A central challenge is that apparent ``logic violations'' can be caused either by genuine reasoning defects or by neural-to-symbolic translation noise. SymDiag therefore incorporates a Self-Auditor that disentangles TranslationError from ReasoningError via dual symbolic encodings consistency checks, enabling robust diagnosis under partial observability. Across diverse mathematical, logical, scientific, and general reasoning benchmarks, SymDiag improves detection of unfaithful reasoning and provides substantially more effective feedback for multi-round reasoning repair than outcome-only verification and LLM-based judging, offering a principled foundation for trustworthy and scalable reasoning diagnosis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。