arXiv:2602.13224cs.AIcs.CL2026-02被引 1

通过嵌入空间几何分析,揭示大模型幻觉的可检测规律。

A Geometric Taxonomy of Hallucinations in LLMs

  • 基于嵌入向量的几何关系分类幻觉类型
  • 三种幻觉中两种可被几何方法有效检测
  • 适合关注模型可信性与错误诊断的研究者

部署中的语言模型产生幻觉可能对医疗、法律和金融等领域的下游决策造成实际影响。在生产环境中,检测只能依赖可见信息:查询、回答和源文档。无法获得模型内部细节或多次采样。在此黑盒、单次、仅限问答的条件下,主流基线NLI虽能输出结果但无法诊断失败原因。本文主张直接利用嵌入空间的几何特性,使检测方法的成功与失败具有可解释性,其依据源于对比句编码训练的对齐目标。我们提出三种操作上可行的幻觉类型,按响应嵌入与真实响应可接受区域在单位超球面的关系划分,并从对齐目标推导出每类的预测:(1)与查询相近的不忠实幻觉可通过角度比值检测;(2)超出可接受区域的编造内容产生方向性特征,在专家标注错误上优于NLI;(3)与正确答案共享词汇和语境的事实性错误无法通过角度几何区分。为验证部署场景下的表现,我们构建了一个包含212对样本的人工编造数据集,覆盖九个领域。

原文摘要 · Abstract (English)

Hallucinations in deployed language models can have real consequences for downstream decisions in domains such as healthcare, legal, and financial services. In production, detection has to run on what the deployed system can see: the query, the response, and often a source document. White-box access to model internals and multi-sample querying are not generally available behind a third-party API. Within this setting - black-box, single-pass, only question/answer available - the dominant baseline is NLI, which returns a value but no diagnosis when it fails. We argue that operating directly on the geometry of the embedding space provides detection methods whose successes and failures are interpretable as structural properties of contrastive sentence-encoder training \citep{wang2020understanding}. The contribution is: given an operationally-motivated taxonomy, geometry predicts which types of hallucination are detectable and which are not - and the predictions hold. We propose three operational types organized by the relation of the response embedding to the plausibility region of grounded responses on the unit hypersphere, and derive from the alignment objective a prediction for each: (1)query-proximate unfaithfulness is detectable by an angular ratio; (2)confabulation outside the plausibility region produces a directional signature that outperforms NLI on expert-annotated error; (3)factual errors sharing vocabulary and frame with correct answers are not separable by angular geometry. To validate on content resembling deployment, we built a 212-pair human-confabulated dataset across nine domains using provoked confabulation.

幻觉检测嵌入空间可解释性语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。