arXiv:2511.11600cs.AIcs.IR2025-11

用因果推理+逻辑校验,实时识别并阻止大模型编造事实。

CausalGuard: A Smart System for Detecting and Preventing False Information in Large Language Models

  • 通过因果链追踪和符号逻辑验证,提前干预生成过程。
  • 在12个基准上识别出89.3%的幻觉,误报率仅8.3%。
  • 适合医疗、金融等需可解释决策的高风险场景。

尽管大语言模型改变了我们与AI交互的方式,但其一个关键弱点是会自信地陈述看似合理的虚假信息。这种“幻觉”问题已成为在准确性至关重要的场景中使用这些模型的主要障碍。现有解决方案要么需要重新训练整个模型,要么增加显著计算开销,或未能触及幻觉发生的根本原因。我们提出CausalGuard,一种结合因果推理与符号逻辑的新方法,能够在幻觉发生时实时检测并阻止。与以往仅在生成后检查输出的方法不同,该系统理解导致错误陈述的因果链条,并在早期介入。CausalGuard通过两条互补路径运行:一条追踪模型已知信息与生成内容之间的因果关系,另一条利用自动化推理检查逻辑一致性。在十二个不同基准上的测试表明,CausalGuard能以89.3%的准确率识别幻觉,同时仅遗漏8.3%的真实幻觉。更重要的是,它将虚假声明减少了近80%,同时保持响应自然且有帮助。该系统在需要多步逻辑推理的复杂任务中表现尤为出色。由于CausalGuard能展示其推理过程,因此在医疗诊断或金融分析等对决策依据要求严格的领域中具有重要价值。

原文摘要 · Abstract (English)

While large language models have transformed how we interact with AI systems, they have a critical weakness: they confidently state false information that sounds entirely plausible. This "hallucination" problem has become a major barrier to using these models where accuracy matters most. Existing solutions either require retraining the entire model, add significant computational costs, or miss the root causes of why these hallucinations occur in the first place. We present CausalGuard, a new approach that combines causal reasoning with symbolic logic to catch and prevent hallucinations as they happen. Unlike previous methods that only check outputs after generation, our system understands the causal chain that leads to false statements and intervenes early in the process. CausalGuard works through two complementary paths: one that traces causal relationships between what the model knows and what it generates, and another that checks logical consistency using automated reasoning. Testing across twelve different benchmarks, we found that CausalGuard correctly identifies hallucinations 89.3\% of the time while missing only 8.3\% of actual hallucinations. More importantly, it reduces false claims by nearly 80\% while keeping responses natural and helpful. The system performs especially well on complex reasoning tasks where multiple steps of logic are required. Because CausalGuard shows its reasoning process, it works well in sensitive areas like medical diagnosis or financial analysis where understanding why a decision was made matters as much as the decision itself.

大模型幻觉检测因果推理可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。