通过最小贝叶斯风险统一模型置信度与输出一致性,提升大模型不确定性量化效果。
Uncertainty Quantification for LLMs through Minimum Bayes Risk: Bridging Confidence and Consistency
- 基于最小贝叶斯风险构建不确定性度量,连接置信度与输出一致性
- 在问答、摘要、翻译任务上显著优于现有最先进方法
- 揭示了大模型作为概率模型的特性,解释了旧方法失效原因
大语言模型(LLM)的不确定性量化(UQ)方法主要分为两类:基于信息的方法关注令牌概率表达的模型置信度;基于一致性的方法则评估重复采样生成多个输出间的语义关系。尽管近期有研究尝试结合两者以提升性能,但部分方法仍不如简单基线。本文探讨了直接关联不确定性与最小贝叶斯风险的建模基础,提出一种将模型置信度与输出一致性融合的新范式,形成一系列高效稳健的UQ方法。研究揭示了LLM作为概率模型的独特性质,有助于解释现有方法在某些任务中表现不佳的原因。我们在问答、摘要和机器翻译等任务上验证该方法,结果表明其在多个指标上显著优于当前最优的UQ方法。
原文摘要 · Abstract (English)
Uncertainty quantification (UQ) methods for Large Language Models (LLMs) encompass a variety of approaches, with two major types being particularly prominent: information-based, which focus on model confidence expressed as token probabilities, and consistency-based, which assess the semantic relationship between multiple outputs generated using repeated sampling. Several recent methods have combined these two approaches to boost UQ performance. However, they sometimes fail to outperform much simpler baseline methods. Our work discusses the fundamental approach to constructing uncertainty measures that directly links uncertainty with the minimum Bayes risks achieved by LLM decoding. Building on these findings, we propose a novel approach to integrating model confidence with output consistency, resulting in a family of efficient and robust UQ methods. Our investigation reveals distinctive characteristics of LLMs as probabilistic models, which help to explain why these UQ methods underperform in certain tasks. Based on these findings, we propose a new way of synthesizing model confidence and output consistency, leading to a family of efficient and robust UQ methods. We evaluate our approach across various tasks such as question answering, abstractive summarization, and machine translation, demonstrating sizable improvements over state-of-the-art UQ approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。