arXiv:2606.20031cs.ROcs.AI2026-06

用神经形态芯片实现低功耗机器人路径规划,效率比GPU高万倍。

A Neuromorphic Reinforcement Learning Framework for Efficient Pathfinding in Robotic Mobile Fulfillment Systems

  • 将深度强化学习策略转为脉冲神经网络,仅在事件触发时计算。
  • 实测能耗降低11281倍,延迟减半,决策质量不变。
  • 适合资源受限的智能仓储机器人系统部署。

动态环境、有限空间和严格实时性使传统搜索与规则方法在机器人移动履约系统(RMFS)路径规划中面临高计算复杂度和长决策延迟的问题。尽管强化学习(RL)成为有力替代方案,但在资源受限硬件上实现极低功耗的策略部署仍是挑战。本文提出SDQN-RMFS,一个端到端框架,将全精度人工神经网络(ANN)训练的策略高效迁移到神经形态芯片。通过仅在稀疏事件触发时计算,该框架实现了超低功耗的路径规划。全流程包括:利用允许碰撞的策略训练密度化信息轨迹的ANN策略,再通过硬标签知识蒸馏将其转换为脉冲神经网络(SNN),有效缓解输出分布不匹配问题,保留策略性能的同时大幅降低推理延迟。硬件实验表明,相比高性能GPU基准,能耗降低达11,281倍,延迟近乎减半,同时保持与原训练策略相当的决策质量。这些结果确立了物理神经形态推理在大规模RMFS运营中的可行性与能效可持续性。

原文摘要 · Abstract (English)

Dynamic environmental changes, confined workspaces, and stringent real-time constraints make pathfinding in Robotic Mobile Fulfillment Systems (RMFS) a challenging problem for conventional search- and rule-based methods, which typically suffer from high computational complexity and long decision latency. While reinforcement learning (RL) has emerged as a powerful alternative, deploying learned policies with extreme energy efficiency on resource-constrained hardware remains an open challenge. We present SDQN-RMFS, an end-to-end framework that achieves high-fidelity deployment of an RL-trained policy from a full-precision artificial neural network (ANN) through to a neuromorphic chip. By computing only when triggered by sparse events, this framework unlocks ultra-low-power RMFS pathfinding. Our full-stack pipeline operates as follows: an ANN policy is first efficiently trained via a collision-allowing strategy to densify informative trajectories, and then converted into a spiking neural network (SNN) via a hard-label knowledge distillation approach. This effectively addresses the output distribution mismatch, preserving policy capability across the ANN-to-SNN pipeline while substantially reducing inference latency. Hardware experiments demonstrate up to 11,281$\times$ energy savings and a nearly two-fold reduction in latency compared to a high-performance GPU baseline, while maintaining decision quality on par with the original trained policy. These results establish physical neuromorphic inference as a practical and energy-sustainable pathway for large-scale RMFS operations.

路径规划神经形态计算强化学习低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。