arXiv:2512.20664cs.AIcs.LO2025-12被引 1

用结构约束检测大模型推理中的幻觉,比概率更准

Eidoku: A Neuro-Symbolic Verification Gate for LLM Reasoning via Structural Constraint Satisfaction

  • 将验证转化为无概率依赖的约束满足问题
  • 可100%识别高概率但结构断裂的虚假陈述
  • 轻量级门控机制适合集成到现有推理流程

大语言模型常生成高置信度的幻觉内容,暴露了基于概率验证的根本缺陷。本文提出将推理验证重新建模为独立于生成似然性的约束满足问题(CSP)。不追求统计合理性,而是通过结构违规代价——将候选推理步骤嵌入上下文图结构所需的计算成本——进行可行性判断。定义包含三类代理的总代价函数:(i) 图连通性(结构),(ii) 特征空间一致性(几何),(iii) 逻辑蕴含(符号)。关键在于,验证通过轻量级系统2门控Eidoku实现,拒绝超出上下文校准代价阈值的候选。该阈值基于上下文内在统计特性推导,避免人为启发式设计。实验表明,该方法能有效拒绝对“平滑错误”——即高概率但结构性脱节的陈述——而传统概率验证无法察觉。在受控诊断数据集上,显式施加结构约束可实现此类幻觉的确定性排除,为生成式推理提供神经符号化的合理性检查。

原文摘要 · Abstract (English)

Large Language Models (LLMs) frequently produce hallucinated statements that are assigned high likelihood by the model itself, exposing a fundamental limitation of probability-based verification. This suggests that hallucination is often not a low-confidence phenomenon, but a failure of structural consistency. In this work, we reformulate the verification of LLM reasoning as a Constraint Satisfaction Problem (CSP) operating independently of the generation likelihood. Rather than optimizing for statistical plausibility, we model verification as a feasibility check based on structural violation cost -- the computational cost required to embed a candidate reasoning step into the contextual graph structure. We define a total cost function composed of three proxies: (i) graph connectivity (structural), (ii) feature space consistency (geometric), and (iii) logical entailment (symbolic). Crucially, verification is performed via a lightweight System-2 gate, Eidoku, which rejects candidates exceeding a context-calibrated cost threshold. The threshold is not learned but is derived from the intrinsic statistics of the context, avoiding ad hoc heuristics. We demonstrate that this approach successfully rejects ``smooth falsehoods'' -- statements that are highly probable yet structurally disconnected -- that probability-based verifiers are principally incapable of detecting. Our experiments on a controlled diagnostic dataset show that explicitly enforcing structural constraints allows for the deterministic rejection of this specific class of hallucinations, serving as a neuro-symbolic sanity check for generative reasoning.

大模型验证结构约束幻觉检测神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。