arXiv:2409.11195cs.ROcs.AI2024-09被引 3

用可学习膜阈值的脉冲神经网络,让机器人抓取更高效节能。

SDP: Spiking Diffusion Policy for Robotic Manipulation with Learnable Channel-Wise Membrane Thresholds

  • 在扩散策略中引入脉冲神经网络与通道可学习膜阈值
  • 7个任务上性能媲美人工神经网络,动态功耗降低94.3%
  • 适合追求低功耗、高效率的机器人控制研究者

本文提出一种脉冲扩散策略(SDP)方法,将脉冲神经网络(SNN)与可学习通道级膜电位阈值(LCMT)融入扩散策略模型,提升计算效率并实现高精度机器人操作。所提SDP模型以U-Net为骨干,在脉冲卷积与漏积分放电(LIF)节点间设计残差连接,避免脉冲状态中断。引入时间编码与解码模块,实现静态与动态数据在时间步 $T_S=4$ 下的转换,支持脉冲格式内部传输。通过LCMT自适应调节各通道膜电位阈值,匹配不同通道的电位与发放率变化,省去繁琐的超参数调优。在7个任务上评估表明,其性能接近人工神经网络(ANN)基准,且收敛速度优于基线SNN方法。在45nm硬件上估算,动态能耗降低94.3%。

原文摘要 · Abstract (English)

This paper introduces a Spiking Diffusion Policy (SDP) learning method for robotic manipulation by integrating Spiking Neurons and Learnable Channel-wise Membrane Thresholds (LCMT) into the diffusion policy model, thereby enhancing computational efficiency and achieving high performance in evaluated tasks. Specifically, the proposed SDP model employs the U-Net architecture as the backbone for diffusion learning within the Spiking Neural Network (SNN). It strategically places residual connections between the spike convolution operations and the Leaky Integrate-and-Fire (LIF) nodes, thereby preventing disruptions to the spiking states. Additionally, we introduce a temporal encoding block and a temporal decoding block to transform static and dynamic data with timestep $T_S$ into each other, enabling the transmission of data within the SNN in spike format. Furthermore, we propose LCMT to enable the adaptive acquisition of membrane potential thresholds, thereby matching the conditions of varying membrane potentials and firing rates across channels and avoiding the cumbersome process of manually setting and tuning hyperparameters. Evaluating the SDP model on seven distinct tasks with SNN timestep $T_S=4$, we achieve results comparable to those of the ANN counterparts, along with faster convergence speeds than the baseline SNN method. This improvement is accompanied by a reduction of 94.3\% in dynamic energy consumption estimated on 45nm hardware.

脉冲神经网络机器人控制低功耗扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。