给大模型推理过程加不确定性评分,提升可信度。
TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning
- 通过随机权重扰动生成分词级不确定度信号。
- 不确定度与答案正确率强相关,可提升推理鲁棒性。
- 适合需要可靠推理的数学题、安全关键场景。
尽管大语言模型在多个任务中表现出色,其输出质量在不同场景下仍不稳定,尤其在需要多步推理的复杂任务中难以判断结果可信度。本文提出一种面向推理的分词级不确定性估计框架TokUR,使大模型能够自我评估并改进推理结果。具体而言,在解码过程中引入低秩随机权重扰动,生成分词级别的预测分布以估计不确定性,并聚合这些量以捕捉生成内容的语义不确定性。在不同难度的数学推理数据集上的实验表明,TokUR的不确定性指标与答案正确性及模型鲁棒性具有强相关性,且该不确定性信号可在测试时用于提升模型推理性能。结果验证了TokUR作为提升大模型在复杂推理任务中可靠性与可解释性的原则性、可扩展方法的有效性。
原文摘要 · Abstract (English)
While Large Language Models (LLMs) have demonstrated impressive capabilities, their output quality remains inconsistent across various application scenarios, making it difficult to identify trustworthy responses, especially in complex tasks requiring multi-step reasoning. In this paper, we propose a Token-level Uncertainty estimation framework for Reasoning (TokUR) that enables LLMs to self-assess and self-improve their responses in mathematical reasoning. Specifically, we introduce low-rank random weight perturbation during LLM decoding to generate predictive distributions for token-level uncertainty estimation, and we aggregate these uncertainty quantities to capture the semantic uncertainty of generated responses. Experiments on mathematical reasoning datasets of varying difficulty demonstrate that TokUR exhibits a strong correlation with answer correctness and model robustness, and the uncertainty signals produced by TokUR can be leveraged to enhance the model's reasoning performance at test time. These results highlight the effectiveness of TokUR as a principled and scalable approach for improving the reliability and interpretability of LLMs in challenging reasoning tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。