让大模型学会反驳,提升科学推理的严谨性。
Addressing Logical Fallacies In Scientific Reasoning From Large Language Models: Towards a Dual-Inference Training Framework
- 引入双重推理训练框架,结合肯定与否定两种逻辑方式。
- 在含否定、反例或错误前提的任务中,模型错误率降低42%。
- 适合需要严谨推理的科研、医疗等高风险场景使用。
大型语言模型(LLMs)已深刻改变自然语言处理,并在推动科学、医疗和决策领域方面展现出巨大潜力。然而,其训练范式仍以基于肯定的推理为主,类似于逻辑中的「肯定前件」(modus ponens),即从公认前提推导出结论。虽然这种单向方法在生成流畅文本方面有效,但使模型易受逻辑谬误、对抗攻击和因果推理失败的影响。本文首先揭示主流平台的LLMs在科学领域面对否定、反例或错误前提时存在系统性缺陷。其次,提出一种双推理训练框架,融合肯定生成与结构化反事实否定。该框架基于形式逻辑、认知科学和对抗训练,将「否定前件」作为一种消证机制,正式建模为增强鲁棒性的计算范式。通过联合生成合成与显式否定感知目标,使模型不仅能确认有效推理,还能拒绝无效推理,从而构建更稳健、可解释且符合人类思维的系统。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to \textit{modus ponens}, where accepted premises yield predicted consequents. While effective for generative fluency, this one-directional approach leaves models vulnerable to logical fallacies, adversarial manipulation, and failures in causal reasoning. This paper makes two contributions. First, it demonstrates how existing LLMs from major platforms exhibit systematic weaknesses when reasoning in scientific domains with negation, counterexamples, or faulty premises \footnote{Code to recreate these experiments are at https://github.com/hannahdavidsoncollege-maker/ScientificReasoningForEnvironment-MedicineWithLLMs. Second, it introduces a dual-reasoning training framework that integrates affirmative generation with structured counterfactual denial. Grounded in formal logic, cognitive science, and adversarial training, this training paradigm formalizes a computational analogue of ``denying the antecedent'' as a mechanism for disconfirmation and robustness. By coupling generative synthesis with explicit negation-aware objectives, the framework enables models that not only affirm valid inferences but also reject invalid ones, yielding systems that are more resilient, interpretable, and aligned with human reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。