通过分组证据建模,提升大模型幻觉检测的准确性与鲁棒性。
FLaG: Fine-Grained Latent Grouping for Hallucination Detection

- 将幻觉检测视为机制感知的证据聚合问题,用潜在分组捕捉多样错误模式。
- 在多个基准上实现当前最佳性能,且对标注数据少和模型变化均保持稳定。
- 无需修改原模型,计算开销极低,适合实际部署于各类大模型系统。
大语言模型中的幻觉由异质性错误机制引发,单一全局置信度难以可靠检测。本文将幻觉检测建模为机制感知的证据聚合问题,需在多种潜在解释下解析多层次信号。提出FLaG框架,通过一组潜在证据组建模正确性,利用基于能量的路由机制对实例进行软分组,并通过合理的对数边际聚合整合组条件可靠性信号。该设计可捕捉异质幻觉模式,且对决策阈值和评估指标不敏感。框架作为冻结模型头运行,无需修改底层模型,计算开销极小。理论分析表明,最优证据聚合在异质误差机制下必具对数边际形式,而FLaG为此提供可控制误差界的可行近似。在多个基准和大模型主干上实验证明,其性能持续领先,跨数据集与模型迁移能力强,且在有限监督下仍有效。
原文摘要 · Abstract (English)
Hallucinations in large language models (LLMs) arise from heterogeneous failure mechanisms, making reliable detection difficult for any single global uncertainty score. In this work, we formulate hallucination detection as a mechanism-aware evidence aggregation problem, where diverse representation- and token-level signals must be interpreted under multiple latent explanations. We propose FLaG, a lightweight hallucination detection framework that models correctness through a set of latent evidence groups. Each instance is softly associated with multiple groups via an energy-based routing mechanism, and group-conditional reliability signals are combined through a principled log-marginal aggregation. This design enables FLaG to capture heterogeneous hallucination patterns while remaining invariant to decision thresholds and evaluation metrics. The framework operates as a frozen-model head, requires no modification to the underlying language model, and incurs minimal computational overhead. We further provide a theoretical perspective that connects FLaG to optimal evidence aggregation under heterogeneous error mechanisms, showing that the Bayes-optimal test statistic necessarily admits a log-marginal form and that FLaG constitutes a tractable approximation with a controllable error bound. Extensive experiments across multiple benchmarks and LLM backbones demonstrate that FLaG consistently achieves SOTA performance, while exhibiting robust transfer across datasets and models, and remaining effective under limited supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。