arXiv:2501.05656hep-excs.LG2025-01被引 11

用证据深度学习量化喷注识别不确定性,提升异常检测能力。

Evidential Deep Learning for Uncertainty Quantification and Out-of-Distribution Detection in Jet Identification using Deep Neural Networks

  • 将证据深度学习用于喷注识别,通过证据积累量化模型置信度。
  • 发现原始EDL在异常检测中存在缺陷,改进后可更准确识别分布外数据。
  • 适合高能物理中的模型可靠性分析与异常检测场景。

当前深度学习中的不确定性量化多依赖贝叶斯方法,计算成本高且耗时。本文详细研究了基于证据深度学习(EDL)的不确定性量化方法在大型强子对撞机质子-质子碰撞喷注识别任务中的应用,并探索其在异常检测中的潜力。EDL将学习视为证据积累过程,可为测试数据提供置信度(或认知不确定性)。利用公开的喷注分类基准数据集,我们优化了应用于喷注识别的EDL超参数,研究了各类喷注的不确定性分布、异常检测实现方式、与贝叶斯集成方法的不确定性对比,以及不确定性在模型隐空间中的映射。研究揭示了EDL在异常检测中的若干局限性,并提出了比基础设定更有效的不确定性量化方法。这些工作为解释喷注识别模型中的EDL提供了方法论框架,深化了对EDL如何量化不确定性及检测分布外数据的理解,可能推动适用于分类任务的更优EDL方法发展。

原文摘要 · Abstract (English)

Current methods commonly used for uncertainty quantification (UQ) in deep learning (DL) models utilize Bayesian methods which are computationally expensive and time-consuming. In this paper, we provide a detailed study of UQ based on evidential deep learning (EDL) for deep neural network models designed to identify jets in high energy proton-proton collisions at the Large Hadron Collider and explore its utility in anomaly detection. EDL is a DL approach that treats learning as an evidence acquisition process designed to provide confidence (or epistemic uncertainty) about test data. Using publicly available datasets for jet classification benchmarking, we explore hyperparameter optimizations for EDL applied to the challenge of UQ for jet identification. We also investigate how the uncertainty is distributed for each jet class, how this method can be implemented for the detection of anomalies, how the uncertainty compares with Bayesian ensemble methods, and how the uncertainty maps onto latent spaces for the models. Our studies uncover some pitfalls of EDL applied to anomaly detection and a more effective way to quantify uncertainty from EDL as compared with the foundational EDL setup. These studies illustrate a methodological approach to interpreting EDL in jet classification models, providing new insights on how EDL quantifies uncertainty and detects out-of-distribution data which may lead to improved EDL methods for DL models applied to classification tasks.

不确定性量化证据深度学习喷注识别异常检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。