arXiv:2605.06053cs.LG2026-05

用少量生成或输入信息实现大模型不确定性估计,提升效率与可信度。

Towards Generation-Efficient Uncertainty Estimation in Large Language Models

论文配图:Towards Generation-Efficient Uncertainty Estimation in Large Language Models
图 1 · 摘自论文原文
  • 提出早期估计框架,从部分生成或输入中推断不确定性
  • Logit Magnitude 和 MetaUE 在部分生成下表现接近全生成方法
  • 适合高风险场景快速识别不可信输出,降低推理开销

不确定性估计对医疗、金融等高风险领域部署大语言模型至关重要,因幻觉内容常具说服力却事实错误。现有方法需一次或多次完整自回归生成来评估不确定性,带来显著推理成本并延迟判断。本文研究是否可用部分生成甚至仅输入信息实现有效估计。提出统一框架,将不确定性估计建模为自回归过程中的早期预测问题,按观测信息(多生成至仅输入)组织现有及新方法,揭示性能与成本的权衡。研究两种低代价设定:部分生成下的估计和仅从输入预测。提出 Logit Magnitude,利用前缀中前M个对数几率证据估计不确定性;MetaUE 将基于生成的不确定性蒸馏为轻量级输入仅估计器。在通用与领域特定基准上实验表明,Logit Magnitude 表现优异,部分生成已足够实现有效估计;MetaUE 在多个设置下提供有竞争力的输入仅近似。结果表明,有效不确定性估计所需生成远少于普遍认知,支持更早识别不可靠输出。

原文摘要 · Abstract (English)

Uncertainty estimation is important for deploying LLMs in high-stakes applications such as healthcare and finance, where hallucinations can appear fluent and plausible while being factually incorrect, making it difficult for users to judge whether an output should be trusted. Existing methods require one or more full autoregressive generations to estimate uncertainty, which introduces substantial inference cost and often delays uncertainty assessment. In this paper, we investigate whether effective uncertainty estimation can be achieved with partial generation or even input-only information. Specifically, we first develop a unified framework that formulates uncertainty estimation as an early estimation problem over the autoregressive generation process of LLMs. This framework organises existing and proposed estimators by the information they observe, ranging from multi-generation to input-only prediction, and clarifies the performance-cost trade-off underlying different uncertainty estimation methods. Building on this view, we study two largely underexplored low-cost settings: estimating uncertainty with part of the generation, and predicting uncertainty from the input prompt. We propose Logit Magnitude, which uses top-M logit evidence to estimate uncertainty from an early-stopped generation prefix, and MetaUE, which distils generation-based uncertainty into a lightweight input-only estimator trained with uncertainty scores. Extensive experiments on general and domain-specific benchmarks show that Logit Magnitude achieves strong performance, and partial generations of LLMs are often sufficient for effective uncertainty estimation. MetaUE further provides a competitive input-only approximation in several settings. These findings suggest that effective uncertainty estimation requires less generation than commonly assumed, enabling unreliable responses to be identified earlier.

不确定性估计大模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。