arXiv:2508.01781cs.CLcs.AI2025-08被引 28

系统梳理大模型幻觉类型,揭示其不可避免的本质。

A comprehensive taxonomy of hallucinations in Large Language Models

  • 从理论出发,将幻觉分为内在与外在、事实性与忠实性两类。
  • 列出代码生成、多模态等场景下的具体幻觉表现形式。
  • 适合关注大模型可靠性与安全性的研究人员和工程师。

大型语言模型(LLMs)虽已革新自然语言处理,但其生成看似合理却违背事实的内容(即幻觉)仍是关键挑战。本报告提出一个全面的幻觉分类体系,从形式定义与理论框架出发,指出幻觉在可计算的LLM中具有固有必然性,与架构或训练方式无关。区分了内在幻觉(与输入上下文矛盾)与外在幻觉(与训练数据或现实不符),以及事实性错误与忠实性偏差。详细列举了事实错误、逻辑与上下文不一致、时间错位、伦理违规及代码生成、多模态等领域的特定幻觉。分析成因,归类为数据、模型与提示三方面因素。探讨认知与人为因素对幻觉感知的影响,综述评估基准与检测指标,并提出架构与系统级缓解策略。最后提供在线资源用于监控模型发布与性能。报告强调幻觉的复杂多元性,认为其理论上不可避免,未来需聚焦于可靠检测、有效缓解与持续的人类监督,以确保在关键应用中的负责任部署。

原文摘要 · Abstract (English)

Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucination, generating plausible but factually incorrect or fabricated content, remains a critical challenge. This report provides a comprehensive taxonomy of LLM hallucinations, beginning with a formal definition and a theoretical framework that posits its inherent inevitability in computable LLMs, irrespective of architecture or training. It explores core distinctions, differentiating between intrinsic (contradicting input context) and extrinsic (inconsistent with training data or reality), as well as factuality (absolute correctness) and faithfulness (adherence to input). The report then details specific manifestations, including factual errors, contextual and logical inconsistencies, temporal disorientation, ethical violations, and task-specific hallucinations across domains like code generation and multimodal applications. It analyzes the underlying causes, categorizing them into data-related issues, model-related factors, and prompt-related influences. Furthermore, the report examines cognitive and human factors influencing hallucination perception, surveys evaluation benchmarks and metrics for detection, and outlines architectural and systemic mitigation strategies. Finally, it introduces web-based resources for monitoring LLM releases and performance. This report underscores the complex, multifaceted nature of LLM hallucinations and emphasizes that, given their theoretical inevitability, future efforts must focus on robust detection, mitigation, and continuous human oversight for responsible and reliable deployment in critical applications.

大模型幻觉评估可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。