用脉冲神经网络实现低功耗高鲁棒的室内导航,适合边缘设备部署。
SpikingNav: Robust Embodied Navigation with Spiking Neural Policies

- 采用脉冲编码视觉特征与脉冲策略网络,实现事件驱动的动态决策。
- 在视觉干扰下成功率提升5.26个百分点,参数更少、计算量更低。
- 已在真实类脑芯片上验证,适用于物联网与智能机器人系统。
具身导航要求智能体从视角观测中做出序列决策。现有基于人工神经网络(ANN)的导航模型性能优异,但依赖密集计算,在视觉退化时表现下降。脉冲神经网络(SNN)具备事件驱动与内在时间动力学特性,更适合资源受限平台的高效鲁棒导航。本文提出SpikingNav,一个用于室内具身导航的脉冲神经网络框架,包含脉冲感知编码器(SSE)与脉冲策略网络(SPN)。SSE使用脉冲骨干网络提取任务相关的视觉特征;SPN通过膜电位积分、阈值激活和脉冲触发重置维持递归策略状态。该设计利用SNN的动态特性和脉冲激活机制,提升导航性能与鲁棒性。我们在PointNav和ObjectNav任务中评估了其在干净观测与视觉退化下的表现。SpikingNav在干净环境下达到可比性能,在视觉退化下平均成功率从8.45%提升至13.71%,同时参数减少且每步计算量更低。例如,ObjectNav成功率达34.12%(对比基线31.05%)。进一步在Thruster-V2类脑芯片上验证其硬件可行性,证明其可在真实类脑硬件上部署,支持人机物融合系统应用。
原文摘要 · Abstract (English)
Embodied navigation requires an agent to make sequential decisions from egocentric observations in a physical environment. Existing Artificial Neural Network (ANN)-based navigation models have achieved strong performance, yet they often rely on dense computation and may degrade under visual corruptions. Spiking neural networks (SNNs) provide event-driven computation and intrinsic temporal dynamics, which are promising for compact and robust navigation on resource-constrained platforms. However, whether spike-based sensing and policy dynamics can improve robustness in visually rich embodied navigation remains an open problem. This paper proposes SpikingNav, a spiking framework for robust indoor embodied navigation. It contains a Spiking Sensing Encoder (SSE) and a Spiking Policy Network (SPN). The SSE extracts task-conditioned visual features with a spike-based backbone. The SPN maintains a recurrent policy state through membrane integration, thresholding, and spike-triggered reset. In this way, SpikingNav exploits the dynamic properties and spike activations of SNNs to improve navigation performance and robustness. We evaluate SpikingNav on PointNav and ObjectNav under clean observations and visual corruptions. SpikingNav achieves competitive clean performance and stronger robustness with fewer parameters and lower per-step computation than a matched ANN baseline. For instance, SpikingNav improves ObjectNav success from 31.05% to 34.12%, and raises the average success under visual corruptions from 8.45% to 13.71%, demonstrating the benefits of spike-based sensing and policy dynamics. We further validate the deployability of our spike-based sensing method on the Thruster-V2 neuromorphic chip. This physical hardware validation shows that SpikingNav can be instantiated on a real neuromorphic substrate for cyber-physical systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。