arXiv:2605.17028cs.CLcs.AI2026-05被引 2

发现主流检测基准存在漏洞,真实检测能力远低于宣称水平。

PARALLAX: Separating Genuine Hallucination Detection from Benchmark Construction Artifacts

论文配图:PARALLAX: Separating Genuine Hallucination Detection from Benchmark Construction Artifacts
图 1 · 摘自论文原文
  • 识别出六个数据集中四个直接泄露答案,导致检测结果失真。
  • 简单文本相似度方法在漏洞数据上达到近完美效果,但无实际意义。
  • 真正有效的检测方法仅剩SAPLMA和DRIFT,依赖高层隐藏状态监督探针。

大型语言模型(LLMs)常以自信姿态生成错误内容,在医疗、法律和科学领域可能造成直接伤害。检测此类幻觉从模型内部状态入手,是提升部署安全性的关键路径。然而,我们发现当前多数研究宣称的进展源于基准构建中的漏洞:六大数据集中有四个将真实答案直接嵌入输入提示中。一个名为 extsc{TxTemb}的朴素文本相似性基线可利用此漏洞,无需访问模型内部即可实现近乎完美的检测性能。为评估去除这些干扰后的真实检测能力,我们对22种检测方法、12个开源模型(涵盖6种架构)及6个数据集进行了大规模评估,并引入 extbf{DRIFT}——一种基于层间隐状态转移的监督探针,用于实时生成场景下的检测对比。结果表明,当前报告的进展很大程度上由基准漏洞解释,多数已有基线在控制条件下表现接近随机;唯一持续有效的为SAPLMA与DRIFT,二者均为针对高层隐藏状态的监督探针。

原文摘要 · Abstract (English)

Large language models (LLMs) hallucinate with confidence: their outputs can be fluent, authoritative, and simply wrong. In medical, legal, and scientific applications this failure causes direct harm, and detecting it from internal model states offers a path to safer deployment. A growing body of work reports that this problem is increasingly tractable, with recent methods achieving high detection performance on widely used benchmarks. We show, however, that much of this apparent progress does not survive scrutiny. Four of the six corpora embed the ground-truth answer directly in the input prompt. A naïve text-similarity baseline we call \textsc{TxTemb} exploits this to achieve near-perfect detection scores without any access to model internals. To measure what genuine detection capability remains once these artifacts are controlled, we conduct a large-scale evaluation spanning twenty-two detection methods, twelve open-source models spanning six architectural families, and six corpora. We further introduce \textbf{DRIFT}, a supervised probe over inter-layer hidden-state transitions, as a point of comparison for live-generation detection. Our findings suggest that the field's reported progress on hallucination detection is substantially explained by benchmark construction artifacts in widely used corpora, and that the majority of established baselines perform near chance under controlled conditions; the consistent exceptions are SAPLMA and DRIFT, both supervised probes on upper-layer hidden states.

幻觉检测基准漏洞大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。