arXiv:2606.03731cs.LGstat.ML2026-06

通过后验采样提升大模型生成可靠性,减少幻觉同时增强有用性。

Conformal Language Modeling via Posterior Sampling

  • 从校准后的高分区域后验中采样,直接融合生成与校正
  • 在生物生成和数学求解任务中保持统计保证,下游效果更优
  • 适合追求生成质量与可信度平衡的研究者与应用开发者

大语言模型仍受幻觉问题困扰。近期研究尝试用基于共形预测的统计方法控制其风险,但这些方法为事后处理,将采样视为原子操作,仅对生成结果进行外科式修正,导致输出不连贯、不一致或违背模型本身分布。此外,事后修正无法将概率质量转移到更有用的回答上。为此,我们提出从近似的大语言模型后验中采样,其中条件事件对应于校准后的高得分区域。我们设计了一种针对条件序列生成的校准程序,有效识别该区域并实现目标风险控制。实验上,我们将该方法应用于开放式传记生成和数学问题求解案例;相比之前工作,在保持相同统计保证的前提下,显著提升了下游实用性。

原文摘要 · Abstract (English)

Large Language Models remain plagued by hallucinations. Recent work has sought to tame their prevalence using statistical techniques based on conformal prediction, with both theoretical and empirical success. However, these methods operate in a post-hoc fashion, treating the sampling procedure itself as atomic and then surgically altering samples to remove hallucinated claims. This disconnect between filtering and generation can result in samples that are incoherent, inconsistent, or simply unlikely under the model itself. Moreover, post-hoc surgery is unable to shift probability mass towards more useful and helpful responses. To address these issues, we propose to instead sample from approximations to an LLM posterior, where the conditioning event corresponds to a calibrated, high-scoring region. We develop a calibration procedure tailored to the setting of conditional sequential generation that effectively identifies this region and achieves target risk control. Empirically, we apply our method to case studies focused on open-ended biography generation and mathematical problem solving; compared to prior work, we obtain the same statistical guarantees, with higher downstream utility.

大模型生成共形预测后验采样幻觉抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。