arXiv:2506.05997cs.RO2025-06被引 17

改进递归网络空间记忆能力,实现无需地图的长距离自主导航

Spatially-Enhanced Recurrent Memory for Long-Range Mapless Navigation via End-to-End Reinforcement Learning

  • 设计新型空间增强循环单元(SRU),强化对多视角观测的空间记忆
  • 在多种复杂环境中,导航成功率比现有方法提升29.6%至105.0%
  • 支持零样本跨域部署,适用于真实世界复杂场景

近期基于强化学习的端到端机器人导航取得显著进展,但仍依赖于建图与规划能力。传统方法通过显式建图流程融合视角信息,而端到端学习则依赖循环神经网络(RNN)隐式融合历史观测。然而,现有LSTM、GRU等结构在空间记忆上存在明显不足,难以整合多角度观测构建有效空间表征。为此,本文提出空间增强循环单元(SRU),对现有RNN进行简单但有效的改造,增强空间记忆能力。结合注意力机制,构建端到端可训练的导航架构,仅需单个前向立体摄像头即可实现长距离无地图导航。通过正则化技术优化强化学习训练过程。实验表明,相比现有RNN,整体导航性能提升23.5%;在多样环境下的长时程任务中,优于依赖显式建图的基线方法29.6%,优于依赖堆叠历史观测的方法105.0%。最后,利用大规模合成深度数据预训练,成功实现从仿真到真实世界的零样本迁移,可在复杂真实场景中直接部署。

原文摘要 · Abstract (English)

Recent advancements in robot navigation, particularly with end-to-end learning approaches such as reinforcement learning (RL), have demonstrated strong performance. However, successful navigation still depends on two key capabilities: mapping and planning (explicitly or implicitly). Classical approaches rely on explicit mapping pipelines to register egocentric observations into a coherent map. In contrast, end-to-end learning often achieves this implicitly -- through recurrent neural networks (RNNs) that fuse current and historical observations into a latent space for planning. While existing architectures, such as LSTM and GRU, can capture temporal dependencies, our findings reveal a critical limitation: their inability to effectively perform spatial memorization. This capability is essential for integrating sequential observations from varying perspectives to build spatial representations that support planning. To address this, we propose Spatially-Enhanced Recurrent Units (SRUs) -- a simple yet effective modification to existing RNNs -- that enhance spatial memorization. We further introduce an attention-based network architecture integrated with SRUs, enabling long-range mapless navigation using a single forward-facing stereo camera. We also employ regularization techniques to facilitate robust end-to-end recurrent training via RL. Experimental results show 23.5% overall improvement in long-range navigation compared to existing RNNs. With SRU memory, our method outperforms RL baselines -- one relying on explicit mapping and the other on stacked historical observations -- by 29.6% and 105.0%, respectively, across diverse environments requiring long-horizon mapping and memorization. Finally, we address the sim-to-real gap by leveraging large-scale pretraining on synthetic depth data, enabling zero-shot transfer for deployment across diverse and complex real-world environments.

机器人导航强化学习空间记忆端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。