用少量标注数据训练集成模型,显著提升大模型幻觉检测效果。
When Do Supervised UQ Ensembles Improve LLM Hallucination Detection? A Robustness Study

- 用小规模标注数据训练分类器融合多种不确定性评分
- 仅需100个样本即在30/32场景中超越单一评分方法
- 对领域迁移和生成模式变化有强鲁棒性,适合实际部署
不确定性量化(UQ)方法广泛用于闭卷场景下大语言模型(LLM)的幻觉检测,此时推理时无真实证据可用。已有研究提出通过学习集成融合多个UQ信号,但其鲁棒性尚缺乏实证考察。本文研究一种监督式集成框架:在小规模、特定领域的标注LLM输出数据集上训练分类器,融合异构的基于UQ的评分器输出,无需检索、工具或参考文档即可进行泛化幻觉分类。我们在四个LLM、九个数据集及三种生成模式(短答案问答、长文本生成、代码生成)下系统分析了三个维度的鲁棒性:样本效率、领域内数据迁移能力、生成模式依赖性。结果表明,监督集成在32组中的30组表现优于最佳单个评分器,且仅需100个标注样本即可实现性能提升。在分布偏移下的领域迁移任务中,集成仍保持大部分优势,在28组转移设置中胜过最优非集成评分器23次。基于采样的黑盒集成几乎与全集成相当,而单次生成的白盒集成收益有限。
原文摘要 · Abstract (English)
Uncertainty quantification (UQ) methods are widely used for hallucination detection in large language models (LLMs) in closed-book settings where ground-truth evidence is unavailable at inference time. Prior work has proposed combining UQ signals via learned ensembles, but empirical investigations into the robustness of these ensembles are limited. We study a supervised ensembling framework that trains a classifier over heterogeneous UQ-based scorer outputs on a small, domain-specific dataset of labeled LLM responses, then applies it to out-of-sample hallucination classification without retrieval, tools, or reference documents. Across four LLMs, nine datasets, and three generation regimes (short-form QA, long-form generation, and code generation), we provide a systematic robustness analysis along three axes: sample efficiency, in-domain dataset transfer, and generation regime dependence. We find that supervised ensembles outperform the best individual scorer in 30 of 32 settings, with gains realized from as few as 100 labeled instances. Ensembles retain most of their advantage in cases of in-domain transfer under distribution shift, outperforming the best non-ensemble scorer in 23 of 28 transfer settings. Sampling-based black-box ensembles are nearly as effective as full ensembles, while single-generation white-box ensembles offer limited benefit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。