arXiv:2504.18253cs.ROcs.AI2025-04中稿 · ICRA被引 3

用深度强化学习+稀疏测深,让无人船在浅水区安全导航

Depth-Constrained ASV Navigation with Deep RL and Limited Sensing

  • 仅靠单次测深数据,结合高斯过程推断水下地形
  • 在模拟与真实水域中均实现安全高效导航
  • 适合浅水环境下的无人船自主导航研究

自主水面艇(ASVs)在海上作业中至关重要,但在浅水区域的导航仍面临动态扰动和深度限制的挑战。传统方法受限于传感器信息不足,难以实现安全高效的运行。本文提出一种基于强化学习(RL)的深度约束下ASV导航框架,车辆需在每一步仅获得一次来自向下式单波束回声测深仪(SBES)的深度读数条件下抵达目标,并避开危险区域。为增强环境感知能力,我们引入高斯过程(GP)回归,使智能体能从稀疏声呐数据中逐步构建水深图。该方法通过提供更丰富的环境表征,提升了决策性能。此外,实验验证了良好的仿真到现实迁移能力,表明训练策略可在真实水下环境中有效泛化。结果证明,该方法显著提升了复杂浅水环境中的导航安全性与效率。

原文摘要 · Abstract (English)

Autonomous Surface Vehicles (ASVs) play a crucial role in maritime operations, yet their navigation in shallow-water environments remains challenging due to dynamic disturbances and depth constraints. Traditional navigation strategies struggle with limited sensor information, making safe and efficient operation difficult. In this paper, we propose a reinforcement learning (RL) framework for ASV navigation under depth constraints, where the vehicle must reach a target while avoiding unsafe areas with only a single depth measurement per timestep from a downward-facing Single Beam Echosounder (SBES). To enhance environmental awareness, we integrate Gaussian Process (GP) regression into the RL framework, enabling the agent to progressively estimate a bathymetric depth map from sparse sonar readings. This approach improves decision-making by providing a richer representation of the environment. Furthermore, we demonstrate effective sim-to-real transfer, ensuring that trained policies generalize well to real-world aquatic conditions. Experimental results validate our method's capability to improve ASV navigation performance while maintaining safety in challenging shallow-water environments.

无人船导航强化学习浅水环境高斯过程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。