让脉冲神经网络更好估计回归任务的不确定性。
Average-Over-Time Spiking Neural Networks for Uncertainty Estimation in Regression
- 用时间平均框架,让网络同时预测均值和方差。
- 在多个数据集上表现优于或媲美主流深度模型。
- 适合需要低功耗与可靠性评估的应用场景。
不确定性估计是量化现代深度学习模型可靠性的重要工具,对许多实际应用至关重要。然而,针对脉冲神经网络(SNN)尤其是回归模型的高效不确定性估计方法仍显不足。本文提出两种将时间平均脉冲神经网络(AOT-SNN)框架适配于回归任务的方法,以提升事件驱动模型的不确定性估计能力。第一种方法采用异方差高斯方法,使SNN在每个时间步预测目标变量的均值与方差,从而生成条件概率分布;第二种方法借鉴回归转分类(RAC)思想,将回归问题重构为分类问题以简化不确定性建模。我们在一个模拟数据集及多个基准数据集上进行了评估,结果表明,所提出的AOT-SNN模型在性能上可媲美或超越当前最先进的深度神经网络方法,尤其在不确定性估计方面表现突出。研究揭示了SNN在回归任务中进行不确定性估计的巨大潜力,为需兼顾精度与能效的应用提供了高效且符合生物学原理的替代方案。
原文摘要 · Abstract (English)
Uncertainty estimation is a standard tool to quantify the reliability of modern deep learning models, and crucial for many real-world applications. However, efficient uncertainty estimation methods for spiking neural networks, particularly for regression models, have been lacking. Here, we introduce two methods that adapt the Average-Over-Time Spiking Neural Network (AOT-SNN) framework to regression tasks, enhancing uncertainty estimation in event-driven models. The first method uses the heteroscedastic Gaussian approach, where SNNs predict both the mean and variance at each time step, thereby generating a conditional probability distribution of the target variable. The second method leverages the Regression-as-Classification (RAC) approach, reformulating regression as a classification problem to facilitate uncertainty estimation. We evaluate our approaches on both a toy dataset and several benchmark datasets, demonstrating that the proposed AOT-SNN models achieve performance comparable to or better than state-of-the-art deep neural network methods, particularly in uncertainty estimation. Our findings highlight the potential of SNNs for uncertainty estimation in regression tasks, providing an efficient and biologically inspired alternative for applications requiring both accuracy and energy efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。