让大模型学会评估每条陈述的可信度,提升长文本生成的准确性。
Think Through Uncertainty: Improving Long-Form Generation Factuality via Reasoning Calibration

- 将输出拆分为独立声明并标注置信度,实现细粒度不确定性推理。
- 在传记生成任务中,声明级准确率最高提升39.9%,事实召回率不下降。
- 支持不确定时主动回避,适合对真实性要求高的生成场景。
大语言模型在长文本生成中常出现幻觉。现有方法多通过事后修正或基于正确性奖励的强化学习提升事实性,但未教会模型判断哪些内容可靠。为此,本文提出CURE框架,使模型在生成时对每个声明进行不确定性推理。首先设计声明感知推理协议,将输出结构化为原子声明与显式置信度;再构建多阶段训练流程,使模型置信度与声明正确性对齐,并优化事实性。校准后的置信度支持选择性预测,推理时可跳过不确定声明。在四个长文本事实性基准测试上,CURE持续优于监督与强化学习基线,在传记生成中声明级准确率最高提升39.9%。同时,事实性评估指标AUROC提升16.0%(FactBench),证明其校准能力显著增强。
原文摘要 · Abstract (English)
Large language models (LLMs) often hallucinate in long-form generation. Existing approaches mainly improve factuality through post-hoc revision or reinforcement learning (RL) with correctness-based rewards, but they do not teach the model to estimate which parts of its generation are reliable. As a result, models may still state incorrect claims confidently in their responses. Recent advances in reasoning have significantly improved LLM performance, and have been leveraged to estimate confidence by incorporating calibration into RL objectives. However, existing approaches remain limited to a single scalar confidence for the entire response, which is insufficient for long-form generation where uncertainty varies across individual claims. To mitigate this problem, we propose CURE, a framework that improves long-form factuality by teaching LLMs to reason about uncertainty at the claim level. We first introduce a Claim-Aware Reasoning Protocol, which structures outputs into atomic claims paired with explicit confidence estimates. We then develop a multi-stage training pipeline that aligns model confidence with claims' correctness and then optimizes on factuality. The resulting calibrated confidence further enables selective prediction, allowing the model to abstain from uncertain claims at inference time. Experiments on four long-form factuality benchmarks show that CURE consistently improves factual accuracy over competitive supervised and RL baselines, while maintaining factual recall. In particular, it improves claim-level accuracy by up to 39.9% on Biography generation. These gains are accompanied by improved calibration, as reflected by a 16.0% increase in AUROC on FactBench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。