arXiv:2602.14778cs.CLcs.AI2026-02中稿 · ICML被引 1

从嵌入空间几何角度揭示小模型幻觉成因,可高效识别幻觉响应。

A Geometric Analysis of Small-sized Language Model Hallucinations

  • 通过句子嵌入空间分析重复问答的几何分布,发现真实回答更聚集。
  • 仅需30-50个标注样本,即可实现超90%的幻觉分类准确率。
  • 适合研究模型可靠性与幻觉机制的学者,尤其关注小模型评估者。

幻觉——看似合理但事实错误的回复——是大语言模型在多步或代理任务中可靠性的主要挑战。现有研究通常将幻觉归因于知识缺失;我们发现,即使相关事实知识存在,模型仍会产生幻觉,表明问题出在检索不稳定性而非知识缺口。基于此,我们提出APORIA(通过不对称性检测提示间观察检索不稳定性),一种几何框架,用于分析同一提示下多次生成响应在句子嵌入空间中的分布。核心假设为:真实回答比幻觉回答聚类更紧密;我们实证验证了该假设,并证明经费舍尔投影后,两类响应可稳定区分。利用此几何不对称性,我们设计了高效的APORIA-LP标签传播方法,仅需30–50个标注即可对大规模响应集进行分类,在十种小型语言模型上均达到超过90%的F1分数。为支持后续研究,我们发布了包含30万条已标注响应的SOCRATES-300K数据集,以及数据生成和结果复现代码。关键发现——从嵌入空间几何视角理解幻觉——补充了传统的知识中心与单次响应评估范式,为未来研究开辟新路径。

原文摘要 · Abstract (English)

Hallucinations -- plausible but factually incorrect responses -- pose a major challenge to the reliability of Large Language Models (LLMs), especially in multi-step or agentic settings. Existing work largely frames hallucinations as a consequence of missing knowledge; we show instead that, even when the relevant factual knowledge is present, models still produce hallucinated answers, pointing to retrieval instability rather than knowledge gaps. Building on this observation, we introduce APORIA (Aggregate Prompt-wise Observation Retrieving Instability via Asymmetry -- the state of puzzlement-in-contradiction that hallucinations embody), a geometric framework that studies repeated responses to the same prompt in sentence-embedding space. Our central hypothesis is that genuine responses cluster more tightly than hallucinated ones; we empirically validate this and show that, after Fisher projection, the two response classes become consistently separable. We leverage this asymmetry in geometry via APORIA-LP, an efficient label-propagation method that classifies large collections of responses from as few as 30--50 annotations, achieving F1 scores above 90% across ten small-sized LLMs. To support further research, we release SOCRATES-300K, a fully labelled dataset of 300,000 responses, together with the code for both dataset generation and result reproduction. Our key finding -- framing hallucinations from a geometric perspective in the embedding space -- complements traditional knowledge-centric and single-response evaluation paradigms, paving the way for further research.

幻觉检测嵌入空间小模型几何分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。