arXiv:2512.20949cs.CLcs.AI2025-12被引 2

用神经探针检测大模型幻觉,更准更快且误报少。

Neural Probe-Based Hallucination Detection for Large Language Models

  • 用轻量MLP探针非线性建模深层语义状态
  • 在三个数据集上准确率和召回率均超现有方法
  • 自动搜索最优插入层,适合高风险场景应用

大语言模型在文本生成和问答任务中表现优异,但容易产生幻觉内容,严重限制其在高风险领域的应用。当前基于不确定性和外部知识检索的检测方法在高置信度下仍会出错,且依赖检索效率与知识覆盖范围。相比之下,基于隐藏层状态的探针方法具有实时、轻量优势,但传统线性探针难以捕捉深层语义空间的非线性结构。为此,我们提出一种基于神经网络的逐标记幻觉检测框架。通过冻结语言模型参数,采用轻量MLP探针对高层隐藏状态进行非线性建模,并设计多目标联合损失函数以增强检测稳定性与语义区分度。同时,构建层位置-探针性能响应模型,利用贝叶斯优化自动搜索最优探针插入层,实现更优训练效果。在LongFact、HealthBench和TriviaQA上的实验表明,MLP探针在低误报率条件下显著优于当前最佳方法,在准确率、召回率和检测能力方面均有提升。

原文摘要 · Abstract (English)

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection methods based on uncertainty estimation and external knowledge retrieval suffer from the limitation that they still produce erroneous content at high confidence levels and rely heavily on retrieval efficiency and knowledge coverage. In contrast, probe methods that leverage the model's hidden-layer states offer real-time and lightweight advantages. However, traditional linear probes struggle to capture nonlinear structures in deep semantic spaces.To overcome these limitations, we propose a neural network-based framework for token-level hallucination detection. By freezing language model parameters, we employ lightweight MLP probes to perform nonlinear modeling of high-level hidden states. A multi-objective joint loss function is designed to enhance detection stability and semantic disambiguity. Additionally, we establish a layer position-probe performance response model, using Bayesian optimization to automatically search for optimal probe insertion layers and achieve superior training results.Experimental results on LongFact, HealthBench, and TriviaQA demonstrate that MLP probes significantly outperform state-of-the-art methods in accuracy, recall, and detection capability under low false-positive conditions.

幻觉检测神经探针大模型MLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。