用压缩的激光雷达数据实现高效自主导航,比传统方法快且成功率更高。
World Models for Autonomous Navigation of Terrestrial Robots from LIDAR Observations
- 构建基于DreamerV3的世界模型,用MLP-VAE编码激光雷达数据为低维隐状态。
- 在模拟TurtleBot3任务中达成100%成功率,远超SAC等模型自由基线(<85%)。
- 适合研究高维感知下机器人强化学习、尤其关注采样效率与鲁棒性的团队。
利用强化学习从激光雷达观测实现地面机器人的自主导航仍具挑战,主要源于传感器数据维度高及模型无关方法样本效率低。传统策略网络难以处理全分辨率激光雷达输入,迫使先前工作依赖简化观测,削弱空间感知与导航鲁棒性。本文提出一种基于DreamerV3的新型模型基础强化学习框架,将多层感知机变分自编码器(MLP-VAE)集成于世界模型中,将高维激光雷达读数编码为紧凑的隐表示。这些隐特征与学习到的动力学预测器结合,实现基于想象的高效策略优化。在模拟TurtleBot3导航任务上的实验表明,所提架构相比SAC、DDPG和TD3等模型无关基线具有更快收敛速度和更高成功率。值得注意的是,基于DreamerV3的智能体在使用完整Turtlebot3激光雷达数据集(360个读数)时,在所有评估环境中均达到100%成功率,而模型无关方法最高仅达85%。结果表明,将预测性世界模型与学习的隐表示相结合,可实现从高维感官数据中更高效、更鲁棒的导航。
原文摘要 · Abstract (English)
Autonomous navigation of terrestrial robots using Reinforcement Learning (RL) from LIDAR observations remains challenging due to the high dimensionality of sensor data and the sample inefficiency of model-free approaches. Conventional policy networks struggle to process full-resolution LIDAR inputs, forcing prior works to rely on simplified observations that reduce spatial awareness and navigation robustness. This paper presents a novel model-based RL framework built on top of the DreamerV3 algorithm, integrating a Multi-Layer Perceptron Variational Autoencoder (MLP-VAE) within a world model to encode high-dimensional LIDAR readings into compact latent representations. These latent features, combined with a learned dynamics predictor, enable efficient imagination-based policy optimization. Experiments on simulated TurtleBot3 navigation tasks demonstrate that the proposed architecture achieves faster convergence and higher success rate compared to model-free baselines such as SAC, DDPG, and TD3. It is worth emphasizing that the DreamerV3-based agent attains a 100% success rate across all evaluated environments when using the full dataset of the Turtlebot3 LIDAR (360 readings), while model-free methods plateaued below 85%. These findings demonstrate that integrating predictive world models with learned latent representations enables more efficient and robust navigation from high-dimensional sensory data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。