用树突结构提升事件数据分类效率,低功耗硬件友好。
DendroNN: Dendrocentric Neural Networks for Energy-Efficient Classification of Event-Based Data
- 模仿树突分支机制识别特定脉冲序列,实现高效时空特征提取。
- 在多个事件数据集上达到媲美先进模型的准确率,最高4倍能效提升。
- 无需梯度训练,适合异步数字硬件部署,适合低功耗计算场景。
时空信息是多种感知与计算任务的核心。前馈脉冲神经网络可通过事件驱动计算实现节能,但难以高精度解码时间信息,常依赖循环或延迟机制增强时序能力,却牺牲了硬件效率。大脑中的树突是强大的计算单元,近年才被引入机器学习系统。本文提出一种树突中心神经网络(DendroNN),利用树突分支中存在的序列检测机制,将独特输入脉冲序列作为时空特征进行识别。该工作引入重连阶段,在不使用梯度的情况下训练不可微的脉冲序列;在此过程中,网络记忆高频出现的序列,并剔除无判别力的信息。DendroNN在多个事件型时间序列数据集上表现优异。同时提出一种基于时间轮机制的异步数字硬件架构,依托事件驱动设计,避免传统延迟或循环模型所需的全局每步更新。通过利用DendroNN的动态与静态稀疏性及内在量化特性,在相同音频分类任务中,相比现有类脑硬件实现高达4倍的能效提升,证明其在时空事件计算中的适用性。本研究为事件驱动硬件上的低功耗时空处理提供了新范式。
原文摘要 · Abstract (English)
Spatiotemporal information is at the core of diverse sensory processing and computational tasks. Feed-forward spiking neural networks can be used to solve these tasks while offering potential benefits in terms of energy efficiency by computing event-based. However, they have trouble decoding temporal information with high accuracy. Thus, they commonly resort to recurrence or delays to enhance their temporal computing ability which, however, bring downsides in terms of hardware-efficiency. In the brain, dendrites are computational powerhouses that just recently started to be acknowledged in such machine learning systems. In this work, we focus on a sequence detection mechanism present in branches of dendrites and translate it into a novel type of neural network by introducing a dendrocentric neural network, DendroNN. DendroNNs identify unique incoming spike sequences as spatiotemporal features. This work further introduces a rewiring phase to train the non-differentiable spike sequences without the use of gradients. During the rewiring, the network memorizes frequently occurring sequences and additionally discards those that do not contribute any discriminative information. The networks display competitive accuracies across various event-based time series datasets. We also propose an asynchronous digital hardware architecture using a time-wheel mechanism that builds on the event-driven design of DendroNNs, eliminating per-step global updates typical of delay- or recurrence-based models. By leveraging a DendroNN's dynamic and static sparsity along with intrinsic quantization, it achieves up to 4x higher efficiency than state-of-the-art neuromorphic hardware at comparable accuracy on the same audio classification task, demonstrating its suitability for spatiotemporal event-based computing. This work offers a novel approach to low-power spatiotemporal processing on event-driven hardware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。