arXiv:2604.06196cs.CLcs.AI2026-04中稿 · ICML

通过逻辑一致性约束提升大模型三元判断的准确性和可靠性。

Compositional Consistency-Guided Decoding for Three-Way Logical Question Answering

论文配图:Compositional Consistency-Guided Decoding for Three-Way Logical Question Answering
图 1 · 摘自论文原文
  • 引入无训练测试时层,结合符号推理与二元蕴含探测
  • 在FOLIO数据集上使GPT-5.2准确率提升4.4点,Claude Sonnet 4.5提升6.8点
  • 适合关注大模型逻辑推理可靠性的研究人员使用

三元逻辑问答任务需对假设H在前提集S下判断为真、假或未知。本文将其视为紧凑的组合推理问题:H与机械否定¬H的预测应在确定性否定映射下保持一致。尽管结构简单,大语言模型仍存在两类缺陷:(i) 否定不一致,即H与¬H的判断违反标签映射;(ii) 认知性未知,即在某侧可推出时仍选择回避。本文提出CGD-PD——一种轻量级、无需训练的测试时层,融合神经三分类、符号否定一致性投影与定向二元蕴含探测。在FOLIO一阶逻辑领域的验证集上,CGD-PD使GPT-5.2准确率提升4.4点,Claude Sonnet 4.5提升6.8点,同时降低未知预测与认知性回避。结果证明,推理时简单的逻辑组合可有效评估并提升大模型推理可靠性,但尚未建立超出该形式化基准之外的鲁棒性。

原文摘要 · Abstract (English)

Three-way logical question answering (QA) assigns one of $\text{True}$, $\text{False}$, or $\text{Unknown}$ to a hypothesis $H$ given a premise set $S$. We study this task as a compact compositional inference problem: predictions for $H$ and for a mechanically negated hypothesis $\neg H$ should agree under a deterministic negation map. Despite this simple structure, large language models (LLMs) can exhibit two practical failure modes: (i) negation inconsistency, where answers to $H$ and $\neg H$ violate the required label mapping, and (ii) epistemic $\text{Unknown}$, where the model abstains even when one side is entailed. We introduce CGD-PD, a lightweight, training-free test-time layer that combines neural 3-way classification, symbolic negation-consistency projection, and targeted binary entailment probes. On one validation split of FOLIO's first-order logic fields, CGD-PD improves accuracy by 4.4 points on GPT-5.2 and 6.8 points on Claude Sonnet 4.5, while reducing $\text{Unknown}$ predictions and epistemic abstention. These results provide a controlled proof of concept that simple logical composition at inference time can help evaluate and improve LLM reasoning reliability; they do not, by themselves, establish robustness beyond this formal benchmark setting.

逻辑推理大模型三元判断测试时优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。