让机器人在遮挡环境下安全高效导航,利用掩体和视野信息决策
HAVEN: Hierarchical Adversary-aware Visibility-Enabled Navigation with Cover Utilization using Deep Transformer Q-Networks
- 分层架构:用深度变换器网络选子目标,模块化控制器执行路径
- 在2D/3D环境中成功率提升,安全距离更大,到达目标更快
- 适合城市驾驶、安防巡逻等需避障与隐蔽的机器人场景
在部分可观测环境中,自主导航需超越即时感知,利用遮挡并保障安全。传统路径规划与无记忆强化学习在视域受限和遮挡情况下常导致不安全或低效行为。本文提出一种分层导航框架,采用深度变换器Q网络(DTQN)作为高层子目标选择器,结合模块化低层控制器执行航点。DTQN接收包含里程计、目标方向、障碍物距离和可见性线索的短期特征历史,输出Q值以排序候选子目标。引入基于可见性的候选生成机制,通过掩码与暴露惩罚,鼓励使用掩体并提前规避风险。低层势场控制器则跟踪选定子目标,实现短时程平滑避障。我们在2D仿真中验证方法,并将该框架直接扩展至3D Unity-ROS环境,通过将点云感知投影到相同特征空间实现迁移,无需修改架构。结果表明,相比经典规划器与强化学习基线,本方法在成功率、安全裕度与到达时间上均有显著提升,消融实验验证了时序记忆与可见性感知设计的有效性。该框架具备强泛化能力,适用于多种机器人平台的安全导航。
原文摘要 · Abstract (English)
Autonomous navigation in partially observable environments requires agents to reason beyond immediate sensor input, exploit occlusion, and ensure safety while progressing toward a goal. These challenges arise in many robotics domains, from urban driving and warehouse automation to defense and surveillance. Classical path planning approaches and memoryless reinforcement learning often fail under limited fields of view (FoVs) and occlusions, committing to unsafe or inefficient maneuvers. We propose a hierarchical navigation framework that integrates a Deep Transformer Q-Network (DTQN) as a high-level subgoal selector with a modular low-level controller for waypoint execution. The DTQN consumes short histories of task-aware features, encoding odometry, goal direction, obstacle proximity, and visibility cues, and outputs Q-values to rank candidate subgoals. Visibility-aware candidate generation introduces masking and exposure penalties, rewarding the use of cover and anticipatory safety. A low-level potential field controller then tracks the selected subgoal, ensuring smooth short-horizon obstacle avoidance. We validate our approach in 2D simulation and extend it directly to a 3D Unity-ROS environment by projecting point-cloud perception into the same feature schema, enabling transfer without architectural changes. Results show consistent improvements over classical planners and RL baselines in success rate, safety margins, and time to goal, with ablations confirming the value of temporal memory and visibility-aware candidate design. These findings highlight a generalizable framework for safe navigation under uncertainty, with broad relevance across robotic platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。