arXiv:2505.07921cs.LGcs.AI2025-05ICML被引 1

用脉冲网络提升少样本学习效率,低功耗下实现高精度分类

Self-cross Feature based Spiking Neural Networks for Efficient Few-shot Learning

  • 设计自特征提取与跨类对比模块,增强脉冲网络表征能力
  • 在N-Omniglot上显著提升分类性能,功耗远低于传统神经网络
  • 适合追求低功耗、高效率的实时智能系统研发者

深度神经网络(DNN)在计算机视觉中表现优异,尤其在少样本学习(FSL)任务中愈发重要,但其计算成本高且难以扩展。脉冲神经网络(SNN)具有事件驱动特性与低能耗优势,能高效处理稀疏动态数据,但在捕捉复杂时空特征和进行精确跨类比较方面仍存挑战。为此,我们提出一种基于SNN的少样本学习框架,结合自特征提取模块与跨特征对比模块,以优化特征表示并降低功耗。通过融合时间高效训练损失与InfoNCE损失,优化脉冲序列的时间动态性,增强判别能力。实验表明,所提FSL-SNN在神经形态数据集N-Omniglot上显著提升分类性能,并在静态数据集CUB与miniImageNet上达到与人工神经网络(ANN)相当的性能,同时保持低功耗。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) excel in computer vision tasks, especially, few-shot learning (FSL), which is increasingly important for generalizing from limited examples. However, DNNs are computationally expensive with scalability issues in real world. Spiking Neural Networks (SNNs), with their event-driven nature and low energy consumption, are particularly efficient in processing sparse and dynamic data, though they still encounter difficulties in capturing complex spatiotemporal features and performing accurate cross-class comparisons. To further enhance the performance and efficiency of SNNs in few-shot learning, we propose a few-shot learning framework based on SNNs, which combines a self-feature extractor module and a cross-feature contrastive module to refine feature representation and reduce power consumption. We apply the combination of temporal efficient training loss and InfoNCE loss to optimize the temporal dynamics of spike trains and enhance the discriminative power. Experimental results show that the proposed FSL-SNN significantly improves the classification performance on the neuromorphic dataset N-Omniglot, and also achieves competitive performance to ANNs on static datasets such as CUB and miniImageNet with low power consumption.

脉冲神经网络少样本学习低功耗计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。