arXiv:2601.06196cs.LGcs.AI2026-01

用几何结构选例句,让大模型更少胡说。

Geometry-Aware Hallucination Detection in Large Language Models

  • 基于模型隐空间的原型几何结构选例句,不靠表面词相似。
  • 在事实验证和幻觉检测任务中表现优于传统方法,尤其在对话与摘要任务中提升明显。
  • 无需微调模型,适合想提升生成可信度的研究者与开发者。

大语言模型常生成虚假或无依据的内容,称为幻觉。现有研究尝试通过解码策略、检索增强和监督微调来检测幻觉,近期发现上下文学习(ICL)可显著影响事实可靠性。然而,现有ICL示范选择方法多依赖表层相似性启发式,跨任务和模型泛化能力有限。本文提出GA-ICL,一种基于几何结构的示范采样框架,利用冻结的LLM提取的隐表示,联合建模局部流形结构与类别感知原型几何,依据示范与学习原型的接近程度进行选择,而非仅依赖词汇或嵌入相似性。在FEVER与HaluEval基准上,GA-ICL在多数设置中超越标准ICL基线,尤其在对话与摘要任务中表现突出。该方法对温度扰动和模型变化具有鲁棒性,稳定性优于启发式检索策略。尽管在小规模模型下词汇检索仍具竞争力,但结果表明,几何感知原型选择是一种可靠且无需训练的幻觉检测方法。在Phi-14B与Qwen3-32B上的扩展评估显示,GA-ICL能有效扩展至更大模型,优于所有对比基线,包括在问答任务中展现边界条件局限的小模型,为改进ICL示范选择提供了原则性方向。

原文摘要 · Abstract (English)

Large language models (LLMs) frequently generate factually incorrect or unsupported content, commonly referred to as hallucinations. Prior work has explored decoding strategies, retrieval augmentation, and supervised fine-tuning for hallucination detection, while recent studies show that in-context learning (ICL) can substantially influence factual reliability. However, existing ICL demonstration selection methods often rely on surface-level similarity heuristics and exhibit limited robustness across tasks and models. We propose GA-ICL, a geometry-aware demonstration sampling framework for selecting in-context demonstrations that leverages latent representations extracted from frozen LLMs. By jointly modeling local manifold structure and class-aware prototype geometry, GA-ICL selects demonstrations based on their proximity to learned prototypes rather than lexical or embedding similarity alone. Across factual verification (FEVER) and hallucination detection (HaluEval) benchmarks, GA-ICL outperforms standard ICL selection baselines in the majority of evaluated settings, with particularly strong gains on dialogue and summarization tasks. The method remains robust under temperature perturbations and model variation, indicating improved stability compared to heuristic retrieval strategies. While lexical retrieval can remain competitive in certain question-answering regimes at smaller model scales, our results demonstrate that geometry-aware prototype selection provides a reliable and training-light approach for hallucination detection without modifying LLM parameters. Extended evaluations on Phi-14B and Qwen3-32B confirm that GA-ICL scales effectively to larger models, outperforming all compared baselines including on QA tasks where smaller models show boundary-condition limitations, offering a principled direction for improved ICL demonstration selection.

幻觉检测上下文学习几何结构大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。