arXiv:2605.26477cs.LG2026-05

提出新框架提升深度学习不确定性量化能力

Variational Inference for Evidential Deep Learning

论文配图:Variational Inference for Evidential Deep Learning
图 1 · 摘自论文原文
  • 用变分推断重构证据学习,避免证据过度增长
  • 理论证明α=e+1能最小化泛化误差界,实验验证优于现有方法
  • 适合需要可靠置信度评估的医疗、自动驾驶等安全敏感场景

深度神经网络虽性能卓越,但常产生过度自信的预测。证据深度学习(EDL)通过将类别概率建模为狄利克雷分布来显式量化认知不确定性。然而我们发现传统EDL存在两大根本缺陷:仅抑制负类证据的KL惩罚导致正类证据过高,削弱了不确定性量化能力;且对狄利克雷参数α=e+1的设定缺乏理论保证。本文提出数学严谨的变分推断证据深度学习(VI-EDL)框架。通过变分推断视角重构证据学习,导出证据下界(ELBO),有效防止证据过度增长。理论上,我们严格建立了泛化界,揭示预测不确定性、特征复杂度与网络复杂度对界的影响,并证明α = e + 1可使其最小化。在标准视觉与医学数据集上的大量实验表明,VI-EDL达到当前最优性能,在分布外检测、噪声检测及自动驾驶场景中表现优异。代码已开源于https://github.com/seutjw/VI-EDL。

原文摘要 · Abstract (English)

While Deep Neural Networks (DNNs) achieve remarkable performance, their tendency to produce overconfident predictions. Evidential Deep Learning (EDL) mitigates this by formulating predictions as a Dirichlet distribution over class probabilities to explicitly quantify epistemic uncertainty. However, we found that the conventional EDL suffers from two fundamental limitations: a Kullback-Leibler (KL) penalty that only suppresses the evidence of negative classes, producing excessively high evidence therefore decreasing the model's ability to quantify uncertainty, and an absence in theoretical guarantee of setting Dirichlet parameter $α=e+1$. In this paper, we propose a mathematically principled framework, Variational Inference Evidential Deep Learning (VI-EDL). By reformulating evidential learning through the lens of variational inference, we derive an Evidence Lower Bound (ELBO), which prevents the evidence from growing excessively. Theoretically, we rigorously establish a generalization bound and reveal how the predicted uncertainty, feature and network complexity affect this bound, and why setting $\boldsymbolα = \mathbf{e} + \mathbf{1}$ can minimize it. Extensive experiments on standard visual and medical datasets demonstrate that VI-EDL achieves state-of-the-art performance, showing excellent performance in out-of-distribution detection, noise detection and autonomous driving scenario. The code is available in https://github.com/seutjw/VI-EDL.

不确定性量化证据学习变分推断深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。