让大模型在不确定时更诚实,通过概率区间识别错误答案。
Credal Large Language Models for Semantic Commitment under Uncertainty
- 用多个LoRA适配器构建概率区间,揭示模型真实不确定性
- 无需额外生成即可检测幻觉,准确率比现有方法高1.5个百分点
- 适合需要高可信度的问答、推理等关键任务场景
大语言模型常以高度自信输出流畅但错误的答案。核心问题在于标准模型仅用单一预测分布表示不确定性,混淆了认知无知与真实歧义。本文提出可信大语言模型(CLLM):通过一组LoRA适配器构建可信集,其上下界概率能暴露合理预测分布的范围,而非坍缩为单一softmax输出。基于此表示,我们提出两种互补的承诺评分:词元空间的可信词元承诺(CTC)结合下界支持、可信宽度与交集熵,无需额外生成即可计算;语义空间的语义承诺一致性(SCC)利用采样补全,通过SCC-Gap衡量词元与语义层级支持的差异。我们在Gemma-2-9B、Llama-3.1-8B和Qwen2.5-7B上评估了幻觉检测、校准、选择性预测和推理能力,覆盖OpenBookQA、CoQA、TriviaQA和ARC-Challenge。CLLM在问答准确率上表现最佳,且预期校准误差具有竞争力;在多数设置中,CTC的幻觉检测AUROC优于基准不超过1.5个百分点,且无需额外生成。在80%覆盖率的选择性预测下,CLLM+SCC在OpenBookQA上达到99.0%准确率;在ARC-Challenge上,使用语义置信度的CLLM实现≤0.6% ECE。
原文摘要 · Abstract (English)
Large language models (LLMs) often produce fluent but incorrect answers with unwarranted confidence. A central limitation is that standard LLMs represent uncertainty through a single predictive distribution, conflating epistemic ignorance with genuine ambiguity. We introduce Credal Large Language Models (CLLMs): an ensemble of LoRA adapters induces a credal set whose lower and upper probabilities expose the spread of plausible predictive distributions rather than collapsing to a single softmax output. From this representation we derive two complementary commitment scores. Credal Token Commitment (CTC) is a token-space score that combines lower-bound support, credal width, and intersection entropy, computed without additional generation. Semantic Commitment Consistency (SCC) extends commitment to semantic space using sampled completions, with SCC-Gap measuring the mismatch between token-level and semantic-level support. We evaluate hallucination detection, calibration, selective prediction, and reasoning on Gemma-2-9B, Llama-3.1-8B, and Qwen2.5-7B across OpenBookQA, CoQA, TriviaQA, and ARC-Challenge. CLLM is the best method on QA accuracy at competitive expected calibration error, and CTC tracks the best hallucination AUROC within 1.5 pp on most settings without additional generation. On selective prediction at 80% coverage, CLLM with SCC reaches 99.0% accuracy on OpenBookQA, and on ARC-Challenge CLLM with Csem confidence achieves <= 0.6% ECE across the three backbones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。