arXiv:2605.24076stat.MLcs.LG2026-05

让人工智能摆脱统计幻觉,靠因果推理建立可信系统

Causality as the Statistical Conscience of Artificial Intelligence: From Pearl's Ladder to Trustworthy Machines

  • 用因果结构破解泛化难题,证明泛化必须依赖因果机制
  • 统一多种因果方法,形成可干预推断的统计框架
  • 揭示大模型幻觉、强化学习奖励漏洞等根源在因果盲区

现代人工智能通过海量数据优化统计风险函数获得强大预测能力,但缺乏区分相关性与因果性的能力。本文主张因果推断(识别干预下不变的机制)是人工智能不可或缺的统计良心。没有因果基础,AI只是相关性机器:在熟悉领域表现良好,但在分布漂移下脆弱,在高风险场景中易产生偏差。本文提出三个贡献:第一,因果泛化的统计必要性定理:任何实现跨分布泛化的算法都必须包含因果结构,形式化了预测P(Y|X)与智能P(Y|do(X))的区别;第二,统一框架将Pearl的do-演算、潜在结果框架、双重机器学习与不变风险最小化整合为一类因果统计估计器,各自在不同假设下识别干预分布;第三,大语言模型幻觉、基于人类反馈的强化学习奖励黑客行为及分布偏移下的性能退化,皆为因果盲视的表现,每种问题均有严谨的统计解决路径。可信人工智能本质上是因果统计问题。统计学界不仅具备解决能力,更是唯一拥有严格工具的学科。

原文摘要 · Abstract (English)

Modern Artificial Intelligence achieves remarkable predictive power by optimizing statistical risk functionals over vast corpora. Yet a gap separates this from genuine intelligence: the inability to distinguish correlation from causation. This paper argues that causal inference (identifying mechanisms invariant under intervention) is AI's indispensable statistical conscience. Without causal grounding, AI systems are correlation machines: powerful in familiar domains, brittle under distribution shift, and biased in high-stakes settings. Three contributions develop this argument. First, a Statistical Necessity Theorem for Causal Generalization: any algorithm achieving out-of-distribution generalization must encode causal structure, formalizing the distinction between prediction P(Y|X) and intelligence P(Y|do(X)). Second, a unified framework connects Pearl's do-calculus, the Potential Outcomes framework, Double Machine Learning, and Invariant Risk Minimization as a family of Causal Statistical Estimators, each identifying interventional distributions under different assumptions. Third, three AI failure modes (hallucination in large language models, reward hacking in reinforcement learning from human feedback, and degradation under distribution shift) are manifestations of causal blindness, each admitting a principled statistical remedy. Trustworthy AI is, at its core, a problem of causal statistics. The statistical community is not merely equipped to solve it -- it is the only community with the foundational tools to do so rigorously.

因果推断可信AI泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。