arXiv:2506.02696cs.AI2025-06被引 1

通过扰动中间表示提升大模型幻觉检测准确率

Shaking to Reveal: Perturbation-Based Detection of LLM Hallucinations

  • 动态生成噪声提示,分析输入在中间层的敏感性
  • 在多个基准上显著优于现有方法,提升检测精度
  • 适合关注大模型可信度与推理可靠性研究者

幻觉仍是大语言模型在真实问答任务中可靠部署的主要障碍。现有自评估方法依赖模型输出置信度判断答案真实性,但该方法假设输出分布贴近真实数据分布,实际中可能因模型层间偏差导致最终输出偏离真实推理过程,使置信度不可靠。本文提出样本特异性提示(SSP)框架,通过分析中间表示对扰动的敏感性来改进自评估。中间表示受模型偏差影响较小,能更真实反映模型隐式推理过程。具体而言,SSP为每个输入动态生成噪声提示,使用轻量编码器放大扰动引起的表示变化,并通过对比距离度量量化差异,区分真实与幻觉回答。实验表明,该方法在多个幻觉检测基准上显著优于现有方法。

原文摘要 · Abstract (English)

Hallucination remains a key obstacle to the reliable deployment of large language models (LLMs) in real-world question answering tasks. A widely adopted strategy to detect hallucination, known as self-assessment, relies on the model's own output confidence to estimate the factual accuracy of its answers. However, this strategy assumes that the model's output distribution closely reflects the true data distribution, which may not always hold in practice. As bias accumulates through the model's layers, the final output can diverge from the underlying reasoning process, making output-level confidence an unreliable signal for hallucination detection. In this work, we propose Sample-Specific Prompting (SSP), a new framework that improves self-assessment by analyzing perturbation sensitivity at intermediate representations. These representations, being less influenced by model bias, offer a more faithful view of the model's latent reasoning process. Specifically, SSP dynamically generates noise prompts for each input and employs a lightweight encoder to amplify the changes in representations caused by the perturbation. A contrastive distance metric is then used to quantify these differences and separate truthful from hallucinated responses. By leveraging the dynamic behavior of intermediate representations under perturbation, SSP enables more reliable self-assessment. Extensive experiments demonstrate that SSP significantly outperforms prior methods across a range of hallucination detection benchmarks.

幻觉检测大模型自评估扰动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。