arXiv:2409.11619eess.IVcs.CV2024-09

提出低功耗脉冲神经网络,实现高精度遥感图像分类

Hyperspectral Image Classification Based on Faster Residual Multi-branch Spiking Neural Network

  • 设计脉冲宽度混合残差模块,高效提取光谱空间特征
  • 引入近似导数方法,实现脉冲网络端到端训练,时间步减少84%
  • 在6个数据集上验证,推理速度提升70%,适合星载机载设备部署

卷积神经网络(CNN)在高光谱图像(HSI)分类中表现优异,但能耗高、结构复杂,难以直接用于边缘计算设备。脉冲神经网络(SNN)因低功耗和事件驱动特性,在HSI分类中发展迅速,但通常需较长的时间步才能达到最优精度。针对上述问题,本文构建基于漏电积分-放电(LIF)神经元模型的脉冲神经网络(SNN-SWMR),采用脉冲宽度混合残差(SWMR)模块作为基本单元进行特征提取,其中包含脉冲混合卷积(SMC),可有效捕捉空间-光谱特征。同时,设计了一种简单高效的反正弦近似导数(AAD),通过拟合狄拉克函数解决脉冲发放不可导问题,实现监督脉冲神经网络的直接训练。在六个公开高光谱数据集上与多种先进脉冲神经网络算法进行对比实验,结果表明AAD具有强鲁棒性和良好拟合效果;相较其他方法,SNN-SWMR在保持相同精度下,时间步减少约84%,训练时间减少约63%,测试时间减少约70%。该研究解决了基于脉冲神经网络的高光谱图像分类的关键瓶颈,对推动其在星载、机载等边缘设备中的实际应用具有重要意义。

原文摘要 · Abstract (English)

Convolutional neural network (CNN) performs well in Hyperspectral Image (HSI) classification tasks, but its high energy consumption and complex network structure make it difficult to directly apply it to edge computing devices. At present, spiking neural networks (SNN) have developed rapidly in HSI classification tasks due to their low energy consumption and event driven characteristics. However, it usually requires a longer time step to achieve optimal accuracy. In response to the above problems, this paper builds a spiking neural network (SNN-SWMR) based on the leaky integrate-and-fire (LIF) neuron model for HSI classification tasks. The network uses the spiking width mixed residual (SWMR) module as the basic unit to perform feature extraction operations. The spiking width mixed residual module is composed of spiking mixed convolution (SMC), which can effectively extract spatial-spectral features. Secondly, this paper designs a simple and efficient arcsine approximate derivative (AAD), which solves the non-differentiable problem of spike firing by fitting the Dirac function. Through AAD, we can directly train supervised spike neural networks. Finally, this paper conducts comparative experiments with multiple advanced HSI classification algorithms based on spiking neural networks on six public hyperspectral data sets. Experimental results show that the AAD function has strong robustness and a good fitting effect. Meanwhile, compared with other algorithms, SNN-SWMR requires a time step reduction of about 84%, training time, and testing time reduction of about 63% and 70% at the same accuracy. This study solves the key problem of SNN based HSI classification algorithms, which has important practical significance for promoting the practical application of HSI classification algorithms in edge devices such as spaceborne and airborne devices.

高光谱分类脉冲神经网络边缘计算低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。