arXiv:2604.13068cs.CLcs.LG2026-04被引 1

激活探针能提前发现幻觉,但无法纠正,适合预判而非纠错。

Detection Without Correction: A Robust Asymmetry in Activation-Based Hallucination Probing

  • 用激活值做线性探测,可提前定位幻觉信号。
  • 大模型探测准确率超随机水平,但修正效果全失败。
  • 优势在生成前预警,适合需要预判的场景。

激活基线线性探测被广泛用于检测和纠正自回归语言模型中的幻觉。我们在7个模型(参数量117M至7B)和3种架构(GPT-2、Pythia、Qwen-2.5)上进行实证研究,发现一种稳健的不对称性:线性探测可在大模型中以高于随机的准确率检测幻觉信号,但沿探测方向进行激活引导却在7个模型中均无法纠正幻觉。此外,输出置信度基线在所有超过410M参数的模型中均优于激活探测器,尤其在Pythia-6.9B上差距达0.157 AUC。探测器的核心价值不在于检测精度,而在于时间位置:其信号可在生成零位置(即无输出令牌时)获取,实现输出方法无法提供的生成前预警。该时间信号在两个模型中统计显著(Pythia-1.4B, p=0.012;Qwen2.5-7B, p=0.038),而在400M以下模型及仅基础版的Pythia-6.9B中缺失。这些发现可视为主流探测即检测与控制范式的一个明确负结果,并初步表明探测方法应定位为互补用途——生成前预警,而非与输出基探测器在检测精度上竞争。

原文摘要 · Abstract (English)

Activation-based linear probing is widely proposed as a method for both detecting and correcting hallucinations in autoregressive language models. We present an empirical study across seven models spanning 117M to 7B parameters and three architecture families (GPT-2, Pythia, Qwen-2.5) that documents a robust asymmetry: linear probes can detect hallucination signals with above-chance accuracy in larger models, but activation steering along the probe-derived direction fails to correct hallucinations in 7 of 7 models tested. We further find that output-confidence baselines outperform activation probes on raw detection AUC at every model above 410M parameters, with the gap reaching 0.157 AUC for Pythia-6.9B. The probe's distinguishing value is therefore not detection accuracy but temporal positioning: probe signals are accessible at position zero (before any output tokens are produced), enabling pre-generation flagging that output-based methods structurally cannot provide. The temporal signal is statistically significant in two of seven models (Pythia-1.4B, p = 0.012; Qwen2.5-7B, p = 0.038) and absent in models below 400M parameters and in the base-only Pythia-6.9B. We position these findings as a clean negative result for the dominant probing-as-detection-and-control research direction and as initial evidence that probe-based methods occupy a complementary deployment niche, namely pre-generation flagging, rather than competing with output-based detectors on raw accuracy.

幻觉检测激活探测预生成预警

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。