arXiv:2602.01477stat.MLcs.LG2026-02

改进深度学习不确定性建模,让模型更懂自己何时出错。

Density-Informed Pseudo-Counts for Calibrated Evidential Deep Learning

  • 用密度感知伪计数分离预测与置信度,避免误判
  • 在分布外数据上显著降低过自信问题,提升校准度
  • 适合需要可信推理的医疗、自动驾驶等高风险场景

证据深度学习(EDL)通过神经网络参数化的狄利克雷分布建模预测不确定性,但其理论基础和分布偏移下的行为仍不清晰。本文证明EDL训练等价于分层贝叶斯模型中的变分推断,揭示了标准EDL混淆了认知不确定性和随机不确定性,导致对分布外(OOD)输入出现系统性过自信。为此,提出密度感知伪计数证据深度学习(DIP-EDL),通过分别估计条件标签分布与边际协变量密度,实现预测与不确定性量级的解耦。该方法在高密度区域保留证据,在分布外数据上将预测收缩至均匀先验。理论上证明了DIP-EDL具有渐近集中性。实验表明,该方法提升了可解释性,并在分布偏移下增强了鲁棒性与不确定性校准性能。

原文摘要 · Abstract (English)

Evidential Deep Learning (EDL) is a popular framework for uncertainty-aware classification that models predictive uncertainty via Dirichlet distributions parameterized by neural networks. Despite its popularity, its theoretical foundations and behavior under distributional shift remain poorly understood. In this work, we provide a principled statistical interpretation by proving that EDL training corresponds to amortized variational inference in a hierarchical Bayesian model with a tempered pseudo-likelihood. This perspective reveals a major drawback: standard EDL conflates epistemic and aleatoric uncertainty, leading to systematic overconfidence on out-of-distribution (OOD) inputs. To address this, we introduce Density-Informed Pseudo-count EDL (DIP-EDL), a new parametrization that decouples class prediction from the magnitude of uncertainty by separately estimating the conditional label distribution and the marginal covariate density. This separation preserves evidence in high-density regions while shrinking predictions toward a uniform prior for OOD data. Theoretically, we prove that DIP-EDL achieves asymptotic concentration. Empirically, we show that our method enhances interpretability and improves robustness and uncertainty calibration under distributional shift.

不确定性建模深度学习校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。