arXiv:2605.13869cs.NEcs.AI2026-05

让脉冲神经网络动态调整大小,实现在低功耗设备上高效手势识别。

Elastic Spiking Transformers for Efficient Gesture Understanding

论文配图:Elastic Spiking Transformers for Efficient Gesture Understanding
图 1 · 摘自论文原文
  • 通过嵌套弹性结构,单模型可按需裁剪宽度和注意力头。
  • 在多个数据集上性能优于独立训练的固定模型,且能实时运行于边缘设备。
  • 减少激活神经元降低脉冲频率,显著节省能耗,适合神经形态硬件部署。

脉冲神经网络(SNNs),特别是脉冲变压器,在医疗应用中为事件传感器数据提供节能处理。然而,现有架构僵化:训练和部署时参数量与计算图固定,限制了在Loihi、SpiNNaker等神经形态硬件上的应用,这些设备常需小模型以换取可行性。本文提出弹性脉冲变压器,首次将弹性引入脉冲范式。受俄罗斯套娃式表征学习启发,其在特征提取器、脉冲自注意力和前馈块中嵌入嵌套弹性。通过粒度感知权重共享,单个通用模型可在推理时动态切分网络宽度与注意力头,无需重新训练。该设计带来两大优势:一是可根据硬件内存预算调整参数规模;二是减少活跃神经元可降低脉冲频率,从而成比例减少突触操作,实现标准ANN无法获得的能效提升。我们在CIFAR10/100、CIFAR10-DVS及临床手势理解数据集EHWGesture上评估,结果表明,一个弹性脉冲变压器可覆盖广泛的复杂度-精度权衡,性能匹配或超越独立训练的基线,并支持资源受限边缘设备上的自适应实时手势识别。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs), particularly Spiking Transformers, offer energy-efficient processing of event-based sensor data for healthcare applications. Yet current architectures are rigid: they are trained and deployed as static networks with fixed parameter counts and computational graphs. This limits deployment on neuromorphic hardware such as Loihi and SpiNNaker, where on-chip constraints often require smaller models that trade accuracy for feasibility. We introduce the Elastic Spiking Transformer, a runtime-adaptive architecture that brings elasticity into the spiking paradigm. Inspired by Matryoshka-style representation learning, it embeds nested elasticity in the Feature Extractor, Spiking Self-Attention, and Feed-Forward blocks. Through granularity-aware weight sharing, a single universal model can dynamically slice network width and attention heads at inference time without retraining. This design provides two key advantages for SNNs. First, it allows the model to adjust its parameter footprint to different hardware memory budgets. Second, reducing active neurons also lowers spike firing rates, yielding proportional reductions in synaptic operations, an energy benefit not directly available in standard artificial neural networks. We evaluate the approach on CIFAR10/100, CIFAR10-DVS, and the EHWGesture clinical gesture understanding dataset. Results show that one Elastic Spiking Transformer spans a broad range of complexity-accuracy trade-offs, matching or surpassing independently trained baselines while supporting adaptive, real-time gesture recognition on resource-constrained edge devices.

脉冲神经网络弹性模型手势识别低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。