用几何强化学习实现未知环境下的边走边建图导航,仅靠局部感知完成高效路径规划。
GRL-SNAM: Geometric Reinforcement Learning with Path Differential Hamiltonians for Simultaneous Navigation and Mapping in Unknown Environments
- 基于动态哈密顿优化,将感知转为局部能量场指导路径搜索。
- 在两个2D任务中以最少探索实现高保真导航,清除率优于基线方法。
- 适合需要实时避障与地图构建的机器人系统,尤其适用于无先验地图场景。
我们提出GRL-SNAM,一种用于未知环境下同时导航与建图(SNAM)的几何强化学习框架。该问题挑战在于设计多智能体的分层或联合策略,在无地图环境中引导真实机器人到达目标,需通过传感器主动获取环境信息并实时构建地图。传感器由路径学习器(导航者)通过主动查询触发,并沿运动路径持续反馈。GRL-SNAM区别于传统预设导航算法及其他强化学习方法,完全依赖局部感官观测,不构建全局地图。该方法将导航与建图建模为受控哈密顿优化下的动态最短路径搜索与发现过程:感官输入被转化为编码可达性、障碍物屏障与形变约束的局部能量场;感知、规划与重构策略通过更新哈密顿量分阶段演化。一个简化的哈密顿量作为自适应评分函数,动态更新动能/势能项,嵌入障碍约束,并随新局部信息持续优化轨迹。我们在两个不同2D导航任务上评估GRL-SNAM,对比在相同分阶段感知约束下的局部反应基线与全局策略学习方法,结果表明其保持良好清除率,可泛化至未见布局,证明通过哈密顿量更新的几何强化学习,可在极小探索下实现高质量导航,而非依赖大规模全局建图。代码已公开于GitHub。
原文摘要 · Abstract (English)
We present GRL-SNAM, a geometric reinforcement learning framework for Simultaneous Navigation and Mapping(SNAM) in unknown environments. A SNAM problem is challenging as it needs to design hierarchical or joint policies of multiple agents that control the movement of a real-life robot towards the goal in mapless environment, i.e. an environment where the map of the environment is not available apriori, and needs to be acquired through sensors. The sensors are invoked from the path learner, i.e. navigator, through active query responses to sensory agents, and along the motion path. GRL-SNAM differs from preemptive navigation algorithms and other reinforcement learning methods by relying exclusively on local sensory observations without constructing a global map. Our approach formulates path navigation and mapping as a dynamic shortest path search and discovery process using controlled Hamiltonian optimization: sensory inputs are translated into local energy landscapes that encode reachability, obstacle barriers, and deformation constraints, while policies for sensing, planning, and reconfiguration evolve stagewise via updating Hamiltonians. A reduced Hamiltonian serves as an adaptive score function, updating kinetic/potential terms, embedding barrier constraints, and continuously refining trajectories as new local information arrives. We evaluate GRL-SNAM on two different 2D navigation tasks. Comparing against local reactive baselines and global policy learning references under identical stagewise sensing constraints, it preserves clearance, generalizes to unseen layouts, and demonstrates that Geometric RL learning via updating Hamiltonians enables high-quality navigation through minimal exploration via local energy refinement rather than extensive global mapping. The code is publicly available on \href{https://github.com/CVC-Lab/GRL-SNAM}{Github}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。