arXiv:2508.04339cs.AI2025-08

让大模型通过减少不确定性来推理,解决逻辑陷阱问题。

Deliberative Reasoning Network: An Uncertainty-Driven Paradigm for Belief-Tracked Inference with Pretrained Language Models

  • 用不确定度最小化替代概率最大化,迭代整合证据
  • 在LCR-1000上比基线提升15.2%,验证模块使准确率从20%升至80%
  • 零样本泛化强,无需训练即提升TruthfulQA性能23.6%

大语言模型在语义直觉与确定性证据冲突时易陷入认知陷阱。本文提出明辨推理网络(DRN),将逻辑推理从概率最大化重构为不确定度最小化。不问“哪个答案最可能”,而问“哪个假设内部证据最一致”。通过显式追踪信念状态并量化竞争假设的认知不确定性,实现内在可解释性。我们构建了两种互补架构:一种专用判别模型体现核心不确定性最小化原则,一种轻量级验证模块增强现有生成式LLM。在新设计的对抗性推理基准LCR-1000上,专用DRN相比标准基线最高提升15.2%。作为参数高效验证器集成至Mistral-7B时,系统在最难题目上准确率从20%跃升至80%。关键的是,DRN展现强大零样本泛化能力,在TruthfulQA上无需额外训练即提升23.6%,表明不确定性驱动的思辨学习到可迁移的推理范式。我们定位DRN为可信AI系统中可验证的系统2推理组件。

原文摘要 · Abstract (English)

Large language models often fail at logical reasoning when semantic heuristics conflict with decisive evidence - a phenomenon we term cognitive traps. To address this fundamental limitation, we introduce the Deliberative Reasoning Network (DRN), a novel paradigm that reframes logical reasoning from probability maximization to uncertainty minimization. Instead of asking "Which answer is most likely?", DRN asks "Which hypothesis has the most internally consistent evidence?". DRN achieves intrinsic interpretability by explicitly tracking belief states and quantifying epistemic uncertainty for competing hypotheses through an iterative evidence synthesis process. We validate our approach through two complementary architectures - a bespoke discriminative model that embodies the core uncertainty minimization principle, and a lightweight verification module that enhances existing generative LLMs. Evaluated on LCR-1000, our new adversarial reasoning benchmark designed to expose cognitive traps, the bespoke DRN achieves up to 15.2% improvement over standard baselines. When integrated as a parameter-efficient verifier with Mistral-7B, our hybrid system boosts accuracy from 20% to 80% on the most challenging problems. Critically, DRN demonstrates strong zero-shot generalization, improving TruthfulQA performance by 23.6% without additional training, indicating that uncertainty-driven deliberation learns transferable reasoning principles. We position DRN as a foundational, verifiable System 2 reasoning component for building more trustworthy AI systems.

逻辑推理不确定性大模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。