EDL让深度学习在单次前向传播中高效估计不确定性,适合高风险场景。
A Comprehensive Survey on Evidential Deep Learning and Its Applications
- 基于主观逻辑理论,单次前向传播即可计算不确定性
- 相比传统方法降低计算开销,保持可靠估计性能
- 适合自动驾驶、医疗诊断等对可靠性要求高的领域
可靠的不确定性估计已成为深度学习在工业部署中的关键需求,尤其在自动驾驶和医疗诊断等高风险应用中。然而,主流的不确定性估计方法(如深度集成或贝叶斯神经网络)通常带来显著的计算开销。为此,一种名为证据深度学习(Evidential Deep Learning, EDL)的新范式应运而生,可在单次前向传播中以最小额外计算量实现可靠的不确定性估计。本综述全面梳理了当前关于EDL的研究进展,旨在为读者提供无需先验知识的广泛介绍。我们首先深入探讨了EDL的理论基础——主观逻辑理论,并分析其与其它不确定性估计框架的区别。随后从四个角度总结现有理论进展:证据收集过程的重构、利用分布外样本改进不确定性估计、多种训练策略的探索,以及证据回归网络的设计。此外,详细阐述了EDL在各类机器学习范式及下游任务中的广泛应用。最后,展望了未来提升性能与推广使用的方向,指出了潜在的研究路径。
原文摘要 · Abstract (English)
Reliable uncertainty estimation has become a crucial requirement for the industrial deployment of deep learning algorithms, particularly in high-risk applications such as autonomous driving and medical diagnosis. However, mainstream uncertainty estimation methods, based on deep ensembling or Bayesian neural networks, generally impose substantial computational overhead. To address this challenge, a novel paradigm called Evidential Deep Learning (EDL) has emerged, providing reliable uncertainty estimation with minimal additional computation in a single forward pass. This survey provides a comprehensive overview of the current research on EDL, designed to offer readers a broad introduction to the field without assuming prior knowledge. Specifically, we first delve into the theoretical foundation of EDL, the subjective logic theory, and discuss its distinctions from other uncertainty estimation frameworks. We further present existing theoretical advancements in EDL from four perspectives: reformulating the evidence collection process, improving uncertainty estimation via OOD samples, delving into various training strategies, and evidential regression networks. Thereafter, we elaborate on its extensive applications across various machine learning paradigms and downstream tasks. In the end, an outlook on future directions for better performances and broader adoption of EDL is provided, highlighting potential research avenues.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。