融合全局路径与局部强化学习,提升机器人在复杂环境中的导航安全与成功率。
Hybrid Motion Planning with Deep Reinforcement Learning for Mobile Robot Navigation
- 用图规划生成全局路径,嵌入强化学习状态与奖励中实现分层控制
- 在真实地图仿真中,成功率超95%,碰撞率低于2%,平均到达时间减少30%
- 适合需兼顾长程规划与社交互动的智能机器人应用场景
在复杂动态环境中,自主移动机器人需在包含静态障碍物和多种移动代理的场景中安全导航。传统基于图的规划器擅长长距离路径规划但缺乏反应性,而深度强化学习方法虽具强避障能力却常因缺乏全局上下文无法抵达远目标。本文提出混合运动规划框架HMP-DRL,利用图基础全局规划器生成路径,并通过一系列编码为状态空间与奖励函数的检查点,将其融入局部DRL策略。为保证社会合规性,局部规划器采用实体感知奖励结构,根据周围代理的语义类型动态调整安全距离与惩罚。在基于真实地图数据构建的逼真仿真环境中进行充分测试表明,HMP-DRL在成功率、碰撞率及到达时间等关键指标上均显著优于现有方法,包括当前最优方案。结果证实,将长期路径引导与语义感知的局部控制相结合,能有效提升复杂人机共存场景下的导航安全性与可靠性。
原文摘要 · Abstract (English)
Autonomous mobile robots operating in complex, dynamic environments face the dual challenge of navigating large-scale, structurally diverse spaces with static obstacles while safely interacting with various moving agents. Traditional graph-based planners excel at long-range pathfinding but lack reactivity, while Deep Reinforcement Learning (DRL) methods demonstrate strong collision avoidance but often fail to reach distant goals due to a lack of global context. We propose Hybrid Motion Planning with Deep Reinforcement Learning (HMP-DRL), a hybrid framework that bridges this gap. Our approach utilizes a graph-based global planner to generate a path, which is integrated into a local DRL policy via a sequence of checkpoints encoded in both the state space and reward function. To ensure social compliance, the local planner employs an entity-aware reward structure that dynamically adjusts safety margins and penalties based on the semantic type of surrounding agents. We validate the proposed method through extensive testing in a realistic simulation environment derived from real-world map data. Comprehensive experiments demonstrate that HMP-DRL consistently outperforms other methods, including state-of-the-art approaches, in terms of key metrics of robot navigation: success rate, collision rate, and time to reach the goal. Overall, these findings confirm that integrating long-term path guidance with semantically-aware local control significantly enhances both the safety and reliability of autonomous navigation in complex human-centric settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。