arXiv:2607.24586cs.CLcs.AI2026-07

通过隐藏状态的谱特性检测大模型幻觉,无需外部工具。

D-Score: A Spectral Hidden-State Signal for Hallucination Detection in Large Language Models

论文配图:D-Score: A Spectral Hidden-State Signal for Hallucination Detection in Large Language Models
图 1 · 摘自论文原文
  • 基于隐藏层激活矩阵的奇异值分布计算谱得分D-Score。
  • D-Score越高,表示内容与模型内部信息冲突越明显,幻觉可能性越大。
  • 仅需单次前向传播,适合实时部署,适用于无外部验证场景。

大型语言模型会产生流畅但虚假、缺乏证据支持或与模型内部信息不一致的内容。本文从隐藏激活的几何结构出发,提出D-Score——一种基于单次前向传播计算的简单谱统计量。对于固定模型、层数和容差参数,D-Score统计隐藏激活矩阵中奇异值接近主奇异值的奇异方向数量。当该值超过预设阈值时,判定输入文本为幻觉。其原理是:当模型处理与自身内部状态冲突的内容时,隐藏表示可能同时编码主张内容与反证、不确定或缺乏支持的信息,导致隐藏轨迹扩展至更多奇异方向。我们通过轻量级谱分析形式化此直觉,并在FAVA-Annotation与RAGTruth数据集上评估,结果表明D-Score是一种强有效的幻觉检测信号,且无需外部验证器、检索步骤或多次生成。

原文摘要 · Abstract (English)

Large Language Models can produce fluent text that is false, unsupported by the available evidence, or inconsistent with information that appears to be internally represented by the model. We study hallucination detection from the geometry of hidden activations and introduce the D-Score, a simple spectral statistic computed from a single forward pass. For a fixed model, layer, and tolerance parameter, the D-Score counts how many singular directions of the hidden activation matrix have singular values that remain close to the leading one. We use this quantity as a hallucination score, classifying an input text as hallucinated when its D-Score is larger than a pre-defined quantity. The motivation is that, when a model processes a text that conflicts with information available in its own internal state, the hidden representation may encode both the asserted content and some form of counter-evidence, uncertainty, correction, or lack of support; this can make the hidden trajectory spread across additional singular directions. We formalize this intuition through a lightweight spectral argument and evaluate the resulting detector on FAVA-Annotation and RAGTruth. The experiments indicate that the D-Score is a strong hidden-state signal for hallucination detection, while requiring no external verifier, no retrieval step, and no multiple generations.

幻觉检测隐藏状态谱分析大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。