发现类别数差异会虚假提升模型分布外检测性能,需谨慎对比。
Rethinking Vacuity for OOD Detection in Evidential Deep Learning
- 用不确定性质量衡量分布外检测时,类别数量必须一致
- 类别数差1时,AUROC最高可差0.427,AUPR差0.745
- 适用于评估大模型分布外检测的论文,需注意数据集定义
不确定性质量(Vacuity)是证据深度学习(EDL)中评估分布外(OOD)检测的常用指标,通常通过将类别数 $K$ 除以模型预测的信念总强度 $S$ 得到,其中 $S$ 由狄利克雷参数之和计算。该方法对 $K$ 的数量敏感。当分布内(ID)与分布外(OOD)类别数不一致时,会导致评价偏差。我们实证发现,即使模型预测不变,仅因类别数差1,标准EDL的AUROC可差0.346,AUPR差0.634;IB-EDL(实现B,Llama3-8B,ARC-E)则分别达0.427和0.745。这表明类别数差异会人为夸大性能。我们进一步讨论在因果语言模型上使用多选问答数据集进行EDL评估的问题,强调需明确定义ID与OOD。主要贡献为揭示在微调的大模型上,基于不确定性质量的OOD检测高度依赖未控制的类别数量差异。
原文摘要 · Abstract (English)
Vacuity, or Uncertainty Mass (UM), is commonly used as a metric to evaluate Out-of-Distribution (OOD) detection in Evidential Deep Learning (EDL). It generally involves dividing the number of classes ($K$) by the total strength of belief ($S$) of the model's predictions, where $S$ is derived from summing the Dirichlet parameters. As such, UM is sensitive to the cardinality of $K$. As a result, when comparing In Distribution (ID) and OOD results, it is important that $K_{\mathrm{ID}}$ and $K_{\mathrm{OOD}}$ are equal; something that is not always ensured in practice. We provide an empirical demonstration of how results for AUROC and AUPR can substantially differ when class cardinality between ID and OOD differs by 1, with AUROC differing by as much as 0.346 and AUPR by 0.634 for standard EDL, and AUROC by 0.427 and AUPR by 0.745 for IB-EDL (both from Implementation B, Llama3-8B, ARC-E). Our findings isolate an evaluation artefact: when $K$ differs between ID and OOD, AUROC/AUPR can be artificially inflated without any change in model predictions. We further discuss the evaluation of EDL over causal language models using Multiple-Choice Question-Answer (MCQA) datasets and argue for clearer definitions of ID and OOD in this context. Our primary contribution is an empirical and theoretical demonstration that vacuity-based OOD detection in EDL-fine-tuned LLMs is highly sensitive to uncontrolled differences in evaluated class cardinality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。