高概率输出未必正确,解码策略需谨慎选择。
When are likely answers right? On Sequence Probability and Correctness in LLMs

- 比较不同解码方法的序列概率与正确性关系
- 序列概率高不一定更准确,尤其重复生成时
- 对自一致性、自动纠错有重要实践指导意义
大型语言模型的解码方法常通过调整概率分布,使输出在局部或全局序列层面更可能。其有效性取决于一个核心问题:序列概率(即给定提示后延续的条件概率)是否真正反映正确性?本文在四个层次上量化分析该关系:不同解码方法之间、同一方法内超参数变化、同一数据集中提示-答案对之间,以及同一提示的多次响应之间。发现序列概率高通常预示着答案正确,但改变超参数或方法提升概率,并不保证准确率提高。此外,对相同提示的多次生成,序列概率无法可靠指示正确性。这些结果澄清了解码策略在何种情况下能提升准确性,为解码、自一致性及无验证器自改进提供了实用建议。
原文摘要 · Abstract (English)
Many decoding methods for large language models can be understood as shifting probability mass toward outputs that are more likely under the model, either locally at the token level or globally at the sequence level. Therefore, their success depends on a fundamental question: when does sequence probability, that is, the conditional probability of a continuation given a prompt, actually align with correctness? In this paper, we set out to quantify this relationship across decoding methods, models, and benchmarks at four levels: across decoding methods, across hyperparameters within a method, across prompt-answer pairs within a dataset, and across repeated responses to the same prompt. We find that higher sequence probability is often predictive of correctness across prompt-answer pairs within a fixed dataset. However, this relationship does not generally transfer to decoding decisions: increasing sequence probability by changing hyperparameters or methods does not reliably improve accuracy. Further, sequence probability is not a good indicator of correctness for responses to the same prompt. These findings clarify when decoding can and cannot be expected to improve correctness, and provide practical guidance for decoding, self-consistency, and verifier-free self-improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。