arXiv:2511.14275cs.CL2025-11被引 2

让大模型用概率分布表达不确定感,提升判断可靠性。

Let the Model Distribute Its Doubt: Confidence Estimation through Verbalized Probability Distribution

  • 要求模型输出概率分布而非单一答案,促进深度思考。
  • 在MMLU-Pro上推理效率提升6倍,达最优得分。
  • 适合需要可信判断的场景,如医疗、金融决策。

在实际应用中,了解模型输出的可靠性至关重要。大型语言模型(LLMs)虽具备强大生成能力,但如何生成可解释的置信度估计仍是研究重点。本文提出通过生成语义化概率分布来增强置信度评估,该方法结合思维链推理,使模型需全面考虑所有可能答案,从而更审慎地分配置信度。我们在多个大模型和任务上系统比较不同语义化方法,结果表明:该方法无论在简单提示设置或经强化学习优化后均表现更优。尤其在推理时扩展中,其推理有效性显著提升,在MMLU-Pro数据集上实现与最强基线相当的最佳Brier得分,同时节省近6倍计算量。我们还揭示了该方法在特定任务上的局限性,并探讨改进方向以提升通用性。

原文摘要 · Abstract (English)

Knowing the reliability of a model's response is essential in practical applications. Given the strong generation capabilities of large language models (LLMs), research has focused on generating verbalized confidence. This approach is further enhanced by integrating chain-of-thought reasoning, which provides logical and transparent estimates. However, how reasoning strategies affect the estimated confidence remains under-explored. In this work, we demonstrate that predicting a verbalized probability distribution effectively promotes reasoning for confidence estimation. It requires an LLM to consider all possible answers rather than relying on a single guess, and the requirement of producing a distribution elicits more careful confidence assignment. We conduct systematic experiments comparing different verbalization-based methods across multiple LLMs and tasks. Our method consistently shows advantages, whether in the simple prompting setup or after optimization via reinforcement learning (RL). Notably, it achieves higher reasoning efficacy during inference-time scaling, saving nearly 6$\times$ the computation to reach the best Brier score of the strongest baseline on MMLU-Pro. Additionally, we reveal its limitations on specific tasks and discuss possible solutions for broader applicability.

置信度估计大模型推理链概率分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。