arXiv:2512.14801cs.CLcs.AI2025-12被引 1

大模型幻觉是架构必然,非激励问题,需外部验证机制解决。

Incentives or Ontology? A Structural Rebuttal to OpenAI's Hallucination Thesis

  • 幻觉源于Transformer的统计模式补全机制,非训练激励导致。
  • 实验表明改变激励或提示无法消除幻觉,必须依赖外部验证。
  • 适合关注AI可靠性与系统设计的研究者阅读。

OpenAI认为大模型幻觉主要源于评估激励错位,即鼓励自信猜测而非认知谦逊。本文挑战此观点,基于结构幻觉研究与使用Licensing Oracle的实验证明:幻觉并非优化失败,而是Transformer架构的必然产物。变压器不表征世界,仅建模词元间的统计关联,其嵌入空间形成基于语言共现的伪本体论。在训练数据稀疏或不连贯的语义边界区域,模型必然通过虚构延续来维持连贯性。任何激励机制都无法改变这种对模式补全的结构性依赖。实验证明,唯有通过外部真值验证和拒答模块才能彻底消除幻觉;Licensing Oracle因提供模型缺失的语境根基,实现了跨领域的完美拒答精度。结论:幻觉是生成式架构的结构性特征,可靠AI需采用区分语言流畅性与认知责任的混合系统。

原文摘要 · Abstract (English)

OpenAI has recently argued that hallucinations in large language models result primarily from misaligned evaluation incentives that reward confident guessing rather than epistemic humility. On this view, hallucination is a contingent behavioral artifact, remediable through improved benchmarks and reward structures. In this paper, we challenge that interpretation. Drawing on previous work on structural hallucination and empirical experiments using a Licensing Oracle, we argue that hallucination is not an optimization failure but an architectural inevitability of the transformer model. Transformers do not represent the world; they model statistical associations among tokens. Their embedding spaces form a pseudo-ontology derived from linguistic co-occurrence rather than world-referential structure. At ontological boundary conditions - regions where training data is sparse or incoherent - the model necessarily interpolates fictional continuations in order to preserve coherence. No incentive mechanism can modify this structural dependence on pattern completion. Our empirical results demonstrate that hallucination can only be eliminated through external truth-validation and abstention modules, not through changes to incentives, prompting, or fine-tuning. The Licensing Oracle achieves perfect abstention precision across domains precisely because it supplies grounding that the transformer lacks. We conclude that hallucination is a structural property of generative architectures and that reliable AI requires hybrid systems that distinguish linguistic fluency from epistemic responsibility.

大模型幻觉Transformer可靠性系统设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。