提出可训练的事件卷积与脉冲注意力,提升动态视觉传感器目标识别性能。
A dynamic vision sensor object recognition model based on trainable event-driven convolution and spiking attention mechanism
- 用梯度下降训练事件卷积核,实现局部特征高效提取。
- 在MNIST-DVS和CIFAR10-DVS上优于基线模型,短事件流下表现优异。
- 适合处理稀疏事件流的神经网络应用,如实时视觉系统。
脉冲神经网络(SNNs)因其稀疏脉冲编码和异步事件驱动计算,非常适合处理动态视觉传感器(DVS)产生的事件流。为从DVS物体中提取特征,传统SNN常使用固定参数的事件卷积,此类滤波器对特定方向特征响应强烈,忽略其他方向,导致特征提取不完整。为提升SNN在事件卷积上的特征提取能力,本文提出一种基于可训练事件卷积和脉冲注意力机制的DVS目标识别模型。可训练事件卷积通过梯度下降更新卷积核,能更高效地提取事件流的局部特征。同时,引入脉冲注意力机制以捕捉全局依赖特征。该模型在两个类脑数据集(MNIST-DVS和更为复杂的CIFAR10-DVS)上的分类性能优于基线方法,并展现出对短事件流的良好分类能力。结果表明,该模型有效提升了事件卷积SNN在DVS物体识别中的性能。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) are well-suited for processing event streams from Dynamic Visual Sensors (DVSs) due to their use of sparse spike-based coding and asynchronous event-driven computation. To extract features from DVS objects, SNNs commonly use event-driven convolution with fixed kernel parameters. These filters respond strongly to features in specific orientations while disregarding others, leading to incomplete feature extraction. To improve the current event-driven convolution feature extraction capability of SNNs, we propose a DVS object recognition model that utilizes a trainable event-driven convolution and a spiking attention mechanism. The trainable event-driven convolution is proposed in this paper to update its convolution kernel through gradient descent. This method can extract local features of the event stream more efficiently than traditional event-driven convolution. Furthermore, the spiking attention mechanism is used to extract global dependence features. The classification performances of our model are better than the baseline methods on two neuromorphic datasets including MNIST-DVS and the more complex CIFAR10-DVS. Moreover, our model showed good classification ability for short event streams. It was shown that our model can improve the performance of event-driven convolutional SNNs for DVS objects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。