arXiv:2608.16353cs.CLcs.AI2026-08

通过整合模型各层信息,提升幻觉检测准确率

HalluTracer: Hallucination Detection via Depth-Averaging Truth Signals

论文配图:HalluTracer: Hallucination Detection via Depth-Averaging Truth Signals
图 1 · 摘自论文原文
  • 将模型前向传播中每层的真相信号进行几何平均聚合
  • 在六个模型和五个基准上检测效果提升1到14个百分点
  • 适合关注大模型可靠性与安全性的研究者使用

即使对齐良好的大型语言模型也会自信地生成事实错误内容,使幻觉成为高风险部署中的持续可靠性问题。这些模型在其内部表示中仍包含线性可分的真理性信号。然而,现有白盒检测方法仅依赖单一层次或孤立组件,忽略了贯穿整个前向过程的分布式判别信息。我们提出 HalluTracer,一个在模型输出任何答案标记前,读取并聚合前向传播中每一层真相信号的检测框架。几何分析显示,各层信号弱相关,因此简单的深度平均可抑制层间噪声,捕获近乎全部线性可获取的信息。在六个开源语言模型和五个幻觉检测基准上,HalluTracer 均显著优于匹配的白盒基线,性能提升达1至14个百分点。总体而言,本工作将幻觉检测从层选择问题重构为由真理性信号几何稀疏性决定的深度聚合问题。

原文摘要 · Abstract (English)

Even well-aligned large language models confidently generate factually incorrect text, making hallucination a persistent reliability risk in high-stakes deployments. These models nonetheless carry linearly separable truthfulness signals in their internal representations. Existing white-box detectors, however, collapse this evidence to isolated components or a single depth, discarding discriminative information distributed across the full forward pass. We introduce HalluTracer, a detection framework that reads and aggregates truthfulness evidence across every layer of the forward pass before the model emits any answer token. A geometric analysis reveals that the per-layer signals are weakly correlated, so that simple depth averaging suppresses layer-specific noise and captures nearly all linearly accessible information. Across six open-source language models and five hallucination benchmarks, HalluTracer consistently outperforms matched white-box baselines, with gains ranging from one to fourteen points. Collectively, our work recasts hallucination detection from a layer-selection problem into a depth-aggregation problem governed by the geometric sparsity of the truthfulness signal.

幻觉检测大模型可靠性深度聚合白盒分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。