arXiv:2606.24281cs.CLcs.AI2026-06

让大模型在推理前后分别校准信心,提升准确性与可信度。

CALIBER: Calibrating Confidence Before and After Reasoning in Language Models

  • 分阶段校准:推理前估解题成功率,推理后估答案正确率。
  • 7B模型上校准误差降低52.5%,性能接近最优准确率。
  • 在分布外数据上表现更优,尤其适合高可靠性场景。

推理型语言模型不仅需回答难题,还需评估自身成功概率。现有方法通常仅在推理前后之一阶段获取信心估计。我们提出信心具有状态依赖性:推理前应预估模型正确解题的概率,推理后则应预测实际答案的正确性。据此,应以提示级成功为监督目标训练推理前信心,以答案级正确性为监督目标训练推理后信心。本文提出CALIBER(Calibration Before and After Reasoning),统一协议下同时获取并校准两种信心。在BigMathDigits数据集上,7B模型的预期校准误差(ECE)相比最强单信心基线降低52.5%,同时取得最佳布里尔分数(Brier score)和AUROC,准确率仅低2.1点;30B模型同样在BigMathDigits上实现最优ECE,且在其他指标上保持竞争力。在分布外数据(GPQA、TriviaQA、SimpleQA)上,CALIBER在ECE和布里尔分数上均表现最佳,且在分布偏移场景下一致性地降低校准误差。

原文摘要 · Abstract (English)

Reasoning language models are increasingly asked not only to answer difficult questions, but also to estimate their likelihood of success. Existing methods typically elicit confidence only once: either before thinking or after answering. We argue that confidence in reasoning models is state-dependent: before thinking, confidence should estimate the chance of the model correctly solving the prompt, while after thinking it should predict whether the realized answer is likely to be correct. This distinction determines the appropriate supervision target: prompt-level success should supervise confidence estimates made after seeing the prompt, while individual answer-level correctness should supervise confidence estimates made after answering. We introduce CALIBER (Calibration Before and After Reasoning), which elicits both estimates and supervises each with the target matched to its information state. Under this unified protocol, CALIBER reduces Expected Calibration Error (ECE) by 52.5% over the strongest single-confidence baseline on BigMathDigits for the 7B model, while achieving the best Brier score and AUROC, and remains within 2.1 points of the best accuracy. Further, on a larger 30B model, CALIBER achieves the best ECE on BigMathDigits while remaining competitive in Brier score and AUROC. Out of distribution, it achieves the best ECE and Brier score on GPQA and TriviaQA, and remains competitive on SimpleQA. Ablations further show that this position-target alignment is most beneficial under distribution shift where it consistently reduces calibration error across all out-of-distribution benchmarks.

大模型信心校准推理可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。