arXiv:2509.23580cs.CL2025-09被引 1

通过分析隐藏层信号频域特征,提升大模型幻觉检测准确率。

LLM Hallucination Detection: HSAD

  • 将推理过程建模为时序信号,用傅里叶变换提取频域特征。
  • 在多个数据集上实现高于主流方法的幻觉检测准确率。
  • 适合关注模型可信性与推理机制分析的研究者。

尽管大型语言模型在语言理解、代码生成等任务中展现出强大能力,但生成过程中的幻觉现象频繁出现,已成为其在关键应用场景部署的重大障碍。当前主流的幻觉检测方法依赖事实一致性验证或静态隐藏层特征,前者受限于知识覆盖范围,后者难以捕捉推理过程中的认知偏差。为此,受认知神经科学中信号分析方法启发,本文提出一种基于隐藏层时序信号频域分析的幻觉检测方法(HSAD)。首先,将大模型的推理过程视为随时间演化的认知旅程,通过隐藏层时序信号模拟人类在反欺骗场景中的信号感知与辨别过程;其次,利用快速傅里叶变换将时序信号映射到频域,构建谱特征以捕捉推理过程中的异常;实验分析表明该方法有效;最后,基于谱特征设计幻觉检测算法,识别生成内容中的幻觉。通过结合推理过程建模与频域特征提取,HSAD克服了现有方法在知识覆盖和推理偏差检测上的局限,表现出更高的检测精度与鲁棒性。

原文摘要 · Abstract (English)

Although Large Language Models have demonstrated powerful capabilities in a wide range of tasks such as language understanding and code generation, the frequent occurrence of hallucinations during the generation process has become a significant impediment to their deployment in critical application scenarios. Current mainstream hallucination detection methods rely on factual consistency verification or static hidden layer features. The former is constrained by the scope of knowledge coverage, while the latter struggles to capture reasoning biases during the inference process. To address these issues, and inspired by signal analysis methods in cognitive neuroscience, this paper proposes a hallucination detection method based on the frequency-domain analysis of hidden layer temporal signals, named HSAD (\textbf{H}idden \textbf{S}ignal \textbf{A}nalysis-based \textbf{D}etection). First, by treating the LLM's reasoning process as a cognitive journey that unfolds over time, we propose modeling and simulating the human process of signal perception and discrimination in a deception-detection scenario through hidden layer temporal signals. Next, The Fast Fourier Transform is applied to map these temporal signals into the frequency domain to construct spectral features, which are used to capture anomalies that arise during the reasoning process; analysis experiments on these spectral features have proven the effectiveness of this approach. Finally, a hallucination detection algorithm is designed based on these spectral features to identify hallucinations in the generated content. By effectively combining the modeling of the reasoning process with frequency-domain feature extraction, the HSAD method overcomes the limitations of existing approaches in terms of knowledge coverage and the detection of reasoning biases, demonstrating higher detection accuracy and robustness.

幻觉检测频域分析大模型可信性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。