为大模型幻觉设计可检测性分类,帮开发者选对检测工具。
DECK: A Consistency x Confidence Taxonomy of LLM Hallucinations

- 按输出一致性与置信度将幻觉分为四类,对应不同检测方法。
- 实验证明三模型四数据集下分类准确率超80%,外部标签匹配预期细胞。
- 揭示输出级不确定性估计的通用盲区,适用于所有大模型。
现有幻觉分类关注输出错误类型(如记忆错误、推理失败、流畅虚构),虽利于诊断但无法回答:哪种不确定性评分器能发现该错误?本文提出互补分类法——基于错误的可检测性特征,即评分器能感知的信号。DECK分类是沿样本间一致性和词元级置信度划分的2×2矩阵,形成四种行为模式(漂移、根深蒂固、虚构、缠结),每类对应特定评分器家族:黑盒一致性评分器在漂移和虚构中有效,白盒概率评分器在缠结和虚构中有效,唯有独立预训练的LLM作为裁判才能检测根深蒂固。通过Youden's J最优分割确定各单元归属。在三个模型、四个数据集上验证:一是分析评分器对之间的分歧,二是检查外部标注(SelfAware不可答、HaluEval对抗样本、PopQA实体流行度)是否落入预测细胞,且存在模型规模与内容特异性次级修正。进一步发现输出级不确定性量化存在普遍盲点:在知识空白输入下,生成器产生自信且重复的虚构时,所有输出级方法均失效。对Llama-3-8B隐藏状态的线性探测也退化至随机水平,初步表明该失败可能存在于激活层;更丰富的内部状态方法(如UQ头、信息论估计器)有待检验。
原文摘要 · Abstract (English)
Existing hallucination taxonomies classify LLM errors by what is wrong with the output -- memorised misconceptions, reasoning failures, fluent fabrications. These taxonomies are useful for diagnosis but cannot answer a different question: which uncertainty scorer would have caught this error? We propose a complementary taxonomy that classifies errors by their detectability signature -- the signal a scorer family would read. The DECK taxonomy is a 2x2 partition along inter-sample consistency and token-level confidence into four behavioural regimes (Drift, Entrenched, Confabulation, Knotted), each mapping to a specific scorer family (or families) that can detect it: black-box consistency scorers have signal in D and C, white-box token-probability scorers have signal in K and C, and only an LLM-as-a-Judge with independent pretraining can detect E. Cell membership is operationalised by a Youden's J optimal split on each scorer axis. Across three models and four datasets we validate the taxonomy two ways: by analysing scorer-pair disagreement, and by checking that external labels (SelfAware unanswerable, HaluEval adversarial, PopQA entity popularity) land in the predicted DECK cells, with model-scale and content-specific secondary-cell refinements. We further identify a universal blind spot of output-level UQ: on knowledge-gap inputs where the generator emits confident, repeatable fabrications, every output-level family collapses by construction. A linear probe on Llama-3-8B's hidden states also collapses to chance, giving preliminary evidence that the failure may persist at the activation level; richer internal-state methods (UQ heads, information-theoretic estimators) remain to be tested.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。