用不确定性量化检测大模型幻觉,提升生成内容可信度。
Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directions
- 基于认知与随机不确定性区分,构建大模型输出可信度评估框架。
- 实证对比多种方法,证明不确定性指标可有效识别错误生成。
- 适合关注大模型可靠性、安全性的研究者与开发者参考。
大型语言模型(LLMs)的快速发展推动了自然语言处理的突破,广泛应用于问答、机器翻译和文本摘要等领域。然而,其在真实场景中的部署引发对可靠性和可信度的担忧,因为大模型仍易产生看似合理但事实错误的幻觉输出。不确定性量化(UQ)已成为解决此问题的核心方向,提供评估模型生成可信度的理论依据。本文首先介绍UQ的基础,包括其形式化定义及认知不确定性与随机不确定性传统区分,并探讨这些概念如何适配大模型场景。在此基础上,系统分析UQ在幻觉检测中的作用:通过量化不确定性,实现不可靠生成的识别与可靠性提升。我们从多个维度对现有方法进行分类,并展示若干代表性方法的实证结果。最后,讨论当前局限性并提出未来研究方向,勾勒出大模型不确定性量化用于幻觉检测的现状图景。
原文摘要 · Abstract (English)
The rapid advancement of large language models (LLMs) has transformed the landscape of natural language processing, enabling breakthroughs across a wide range of areas including question answering, machine translation, and text summarization. Yet, their deployment in real-world applications has raised concerns over reliability and trustworthiness, as LLMs remain prone to hallucinations that produce plausible but factually incorrect outputs. Uncertainty quantification (UQ) has emerged as a central research direction to address this issue, offering principled measures for assessing the trustworthiness of model generations. We begin by introducing the foundations of UQ, from its formal definition to the traditional distinction between epistemic and aleatoric uncertainty, and then highlight how these concepts have been adapted to the context of LLMs. Building on this, we examine the role of UQ in hallucination detection, where quantifying uncertainty provides a mechanism for identifying unreliable generations and improving reliability. We systematically categorize a wide spectrum of existing methods along multiple dimensions and present empirical results for several representative approaches. Finally, we discuss current limitations and outline promising future research directions, providing a clearer picture of the current landscape of LLM UQ for hallucination detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。