arXiv:2510.10516cs.ROcs.AI2025-10被引 2

用脉冲神经网络实现低功耗高维机器人控制,省电96%还稳定

Population-Coded Spiking Neural Networks for High-Dimensional Robotic Control

  • 用群体编码脉冲网络结合强化学习,实现事件驱动的高效控制
  • 在Franka机械臂上省电96.10%,轨迹跟踪误差小,抓放任务稳定
  • 适合资源受限场景下的实时机器人控制,如嵌入式系统部署

能源效率与高性能运动控制仍是机器人领域的重要挑战,尤其在高维连续控制任务中,受限于机载资源。尽管深度强化学习(DRL)表现优异,但其计算开销和能耗限制了在资源受限环境中的应用。本文提出一种新框架,将群体编码脉冲神经网络(SNN)与DRL结合。核心为群体编码脉冲动作网络(PopSAN),将高维观测编码为神经元群体活动,通过梯度更新实现最优策略学习。在Isaac Gym平台的PixMC基准测试中,使用Franka机械臂完成复杂操作任务。实验结果表明,相比传统人工神经网络(ANNs),本方法最高可节省96.10%能耗,同时保持相近控制性能。训练后的SNN策略能实现精准手指位置追踪,抓放过程中目标高度稳定。该方法为资源受限环境下高能效、高性能机器人控制提供了可行路径,支持真实机器人系统的可扩展部署。

原文摘要 · Abstract (English)

Energy-efficient and high-performance motor control remains a critical challenge in robotics, particularly for high-dimensional continuous control tasks with limited onboard resources. While Deep Reinforcement Learning (DRL) has achieved remarkable results, its computational demands and energy consumption limit deployment in resource-constrained environments. This paper introduces a novel framework combining population-coded Spiking Neural Networks (SNNs) with DRL to address these challenges. Our approach leverages the event-driven, asynchronous computation of SNNs alongside the robust policy optimization capabilities of DRL, achieving a balance between energy efficiency and control performance. Central to this framework is the Population-coded Spiking Actor Network (PopSAN), which encodes high-dimensional observations into neuronal population activities and enables optimal policy learning through gradient-based updates. We evaluate our method on the Isaac Gym platform using the PixMC benchmark with complex robotic manipulation tasks. Experimental results on the Franka robotic arm demonstrate that our approach achieves energy savings of up to 96.10% compared to traditional Artificial Neural Networks (ANNs) while maintaining comparable control performance. The trained SNN policies exhibit robust finger position tracking with minimal deviation from commanded trajectories and stable target height maintenance during pick-and-place operations. These results position population-coded SNNs as a promising solution for energy-efficient, high-performance robotic control in resource-constrained applications, paving the way for scalable deployment in real-world robotics systems.

脉冲神经网络机器人控制低功耗强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。