为神经启发的深度算子设计无需分布假设的不确定性量化方法
Distribution free uncertainty quantification in neuroscience-inspired deep operators
- 结合随机先验网络与分割分位数预测,实现无需分布假设的不确定性估计
- 在多个微分方程测试中,不确定性区间覆盖率达95%以上,显著优于基线方法
- 适用于边缘计算场景,特别适合对能效要求高的神经形态系统
能效高效的深度学习算法对可持续未来和边缘计算至关重要。受神经科学启发的脉冲神经网络(SNN)在降低能耗方面迈出重要一步,但为节省能量往往牺牲少量精度。因此,此类模型的预测需具备不确定性度量能力,以告知用户输出的置信范围。本文提出一种无需分布假设的不确定性量化框架——基于随机先验(RP)网络与分割分位数预测(SCP)的共形化随机先验算子(CRP-O),可应用于传统及脉冲神经算子。为进一步支持零样本超分辨率,引入高斯过程回归进行增强。该扩展版本与最新提出的可变脉冲小波神经算子(VSWNO)集成。通过四个一维与二维偏微分方程案例验证,经校准的不确定性边界相较于原始RP-VSWNO、分位数WNO(Q-WNO)及共形化分位数WNO(CQ-WNO)有显著提升,覆盖率达到95%以上。结果表明该方法具有实际应用潜力。
原文摘要 · Abstract (English)
Energy-efficient deep learning algorithms are essential for a sustainable future and feasible edge computing setups. Spiking neural networks (SNNs), inspired from neuroscience, are a positive step in the direction of achieving the required energy efficiency. However, in a bid to lower the energy requirements, accuracy is marginally sacrificed. Hence, predictions of such deep learning algorithms require an uncertainty measure that can inform users regarding the bounds of a certain output. In this paper, we introduce the Conformalized Randomized Prior Operator (CRP-O) framework that leverages Randomized Prior (RP) networks and Split Conformal Prediction (SCP) to quantify uncertainty in both conventional and spiking neural operators. To further enable zero-shot super-resolution in UQ, we propose an extension incorporating Gaussian Process Regression. This enhanced super-resolution-enabled CRP-O framework is integrated with the recently developed Variable Spiking Wavelet Neural Operator (VSWNO). To test the performance of the obtained calibrated uncertainty bounds, we discuss four different examples covering both one-dimensional and two-dimensional partial differential equations. Results demonstrate that the uncertainty bounds produced by the conformalized RP-VSWNO significantly enhance UQ estimates compared to vanilla RP-VSWNO, Quantile WNO (Q-WNO), and Conformalized Quantile WNO (CQ-WNO). These findings underscore the potential of the proposed approach for practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。