arXiv:2410.17066cs.CVcs.LG2024-10NeurIPS被引 10

提出神经元竞争组机制,提升脉冲网络分类精度

Neuronal Competition Groups with Supervised STDP for Spike-Based Classification

  • 引入神经元竞争组,通过双阈值机制实现类内竞争
  • 在CIFAR-10和CIFAR-100上准确率显著提升
  • 适合在神经形态硬件上部署的脉冲网络分类任务

脉冲时间依赖可塑性(STDP)是神经形态硬件上训练脉冲神经网络(SNN)的有前景替代方法。本文提出一种基于首次脉冲编码与监督STDP训练的神经元竞争组(NCG)架构,用于改进分类层中的胜者为王(WTA)竞争机制。每个NCG由一组映射到特定类别的神经元组成,实现类内WTA及基于双室阈值的新竞争调控机制。该机制有效缓解了监督STDP分类中竞争失衡问题,提升了类别分离能力。在两种不同无监督特征提取器基础上,结合状态领先监督STDP规则,在CIFAR-10和CIFAR-100数据集上实现了显著的准确率提升。实验表明,该竞争调控机制对维持平衡竞争至关重要。

原文摘要 · Abstract (English)

Spike Timing-Dependent Plasticity (STDP) is a promising substitute to backpropagation for local training of Spiking Neural Networks (SNNs) on neuromorphic hardware. STDP allows SNNs to address classification tasks by combining unsupervised STDP for feature extraction and supervised STDP for classification. Unsupervised STDP is usually employed with Winner-Takes-All (WTA) competition to learn distinct patterns. However, WTA for supervised STDP classification faces unbalanced competition challenges. In this paper, we propose a method to effectively implement WTA competition in a spiking classification layer employing first-spike coding and supervised STDP training. We introduce the Neuronal Competition Group (NCG), an architecture that improves classification capabilities by promoting the learning of various patterns per class. An NCG is a group of neurons mapped to a specific class, implementing intra-class WTA and a novel competition regulation mechanism based on two-compartment thresholds. We incorporate our proposed architecture into spiking classification layers trained with state-of-the-art supervised STDP rules. On top of two different unsupervised feature extractors, we obtain significant accuracy improvements on image recognition datasets such as CIFAR-10 and CIFAR-100. We show that our competition regulation mechanism is crucial for ensuring balanced competition and improved class separation.

脉冲神经网络神经形态计算类内竞争STDP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。