arXiv:2509.11569cs.CL2025-09被引 6

通过分析模型内部语义广度与深度,无需训练即可检测大模型幻觉。

D$^2$HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs

  • 从层内分散性和层间语义漂移两个维度捕捉生成过程中的异常
  • 在5个开源模型、5个基准上均超越现有无训练方法
  • 轻量可解释,适合高风险领域如医疗金融的可靠性验证

尽管大语言模型(LLMs)取得了显著进展,但其生成非事实内容(即“幻觉”)的问题仍严重阻碍实际应用。在金融、安全、医疗等高风险领域,确保输出可靠性至关重要。本文从模型架构和生成动态出发重新审视幻觉检测,利用大模型的多层结构与自回归解码过程,将幻觉信号分解为两个互补维度:每层内词元表示的语义广度,以及核心概念跨层演进的语义深度。基于此,提出无需训练且无需标签的框架D²HScore,联合衡量:(1) 层内分散性(Intra-Layer Dispersion),量化每层中词元表示的语义多样性;(2) 层间漂移(Inter-Layer Drift),追踪关键词元表示在各层间的渐进变化。为确保漂移反映有意义的语义演变而非噪声或冗余词元,使用注意力信号引导词元选择。通过捕捉推理过程中表征的水平与垂直动态,D²HScore提供了一个可解释且轻量的幻觉检测代理。在五个开源大模型和五个常用基准上的大量实验表明,D²HScore始终优于现有无训练基线。

原文摘要 · Abstract (English)

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a critical challenge, particularly in high-stakes domains such as finance, security, and healthcare. In this work, we revisit hallucination detection from the perspective of model architecture and generation dynamics. Leveraging the multi-layer structure and autoregressive decoding process of LLMs, we decompose hallucination signals into two complementary dimensions: the semantic breadth of token representations within each layer, and the semantic depth of core concepts as they evolve across layers. Based on this insight, we propose \textbf{D$^2$HScore (Dispersion and Drift-based Hallucination Score)}, a training-free and label-free framework that jointly measures: (1) \textbf{Intra-Layer Dispersion}, which quantifies the semantic diversity of token representations within each layer; and (2) \textbf{Inter-Layer Drift}, which tracks the progressive transformation of key token representations across layers. To ensure drift reflects the evolution of meaningful semantics rather than noisy or redundant tokens, we guide token selection using attention signals. By capturing both the horizontal and vertical dynamics of representation during inference, D$^2$HScore provides an interpretable and lightweight proxy for hallucination detection. Extensive experiments across five open-source LLMs and five widely used benchmarks demonstrate that D$^2$HScore consistently outperforms existing training-free baselines.

幻觉检测大模型可解释性无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。