动态调整采样次数,用更少计算量检测大模型幻觉。
Efficient Hallucination Detection: Adaptive Bayesian Estimation of Semantic Entropy with Guided Semantic Exploration
- 根据不确定性自动调节采样次数,避免固定预算浪费
- 在低预算下少用50%样本,效果仍超现有方法
- 通过扰动探索语义空间,提升检测精度
大型语言模型在自然语言处理任务中表现卓越,但仍易产生事实性错误,即幻觉。现有检测方法通过多次采样并量化生成结果间的语义不一致性来识别幻觉,但依赖固定采样预算,无法适应查询复杂度,导致计算效率低下。本文提出自适应贝叶斯语义熵估计框架(Adaptive Bayesian Estimation of Semantic Entropy with Guided Semantic Exploration),基于分层贝叶斯模型建模语义分布,通过方差阈值动态控制采样迭代,在达到足够确定性时终止生成。同时设计基于扰动的重要度采样策略,系统探索语义空间。在四个问答数据集上的实验表明,该方法在保持高检测性能的同时显著提升效率:在低预算场景下,所需样本量减少约50%,即可达到与现有方法相当的检测效果;相同采样预算下,平均AUROC提升12.6%。
原文摘要 · Abstract (English)
Large language models (LLMs) have achieved remarkable success in various natural language processing tasks, yet they remain prone to generating factually incorrect outputs known as hallucinations. While recent approaches have shown promise for hallucination detection by repeatedly sampling from LLMs and quantifying the semantic inconsistency among the generated responses, they rely on fixed sampling budgets that fail to adapt to query complexity, resulting in computational inefficiency. We propose an Adaptive Bayesian Estimation framework for Semantic Entropy with Guided Semantic Exploration, which dynamically adjusts sampling requirements based on observed uncertainty. Our approach employs a hierarchical Bayesian framework to model the semantic distribution, enabling dynamic control of sampling iterations through variance-based thresholds that terminate generation once sufficient certainty is achieved. We also develop a perturbation-based importance sampling strategy to systematically explore the semantic space. Extensive experiments on four QA datasets demonstrate that our method achieves superior hallucination detection performance with significant efficiency gains. In low-budget scenarios, our approach requires about 50% fewer samples to achieve comparable detection performance to existing methods, while delivers an average AUROC improvement of 12.6% under the same sampling budget.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。