用记忆代理图实现无需地图的视觉导航,性能达新高
Memory Proxy Maps for Visual Navigation
- 采用分层强化学习构建三层级导航模型,不依赖地图与里程计
- 记忆代理图在自监督下学习环境表征,作为高效记忆替代传统地图
- 适合无先验地图的智能体自主导航,尤其适用于移动机器人场景
视觉导航受人类启发,可在未知环境中仅凭视觉导航而无需详细地图。我们提出一种无需强化学习、无需图结构、无需里程计的新方法,通过封建学习构建三层代理系统。核心是记忆代理图(MPM),由高层管理器代理在自监督下学习得到的环境中间表示,充当简化记忆,近似代理所见内容。实验表明,在此学习的潜在空间中记录观测是一种有效且高效的记忆代理,可消除对图结构和里程计的需求。中层管理器采用路径点网络(WayNet),输出中间子目标即路径点,模仿人类局部导航时的路径选择。底层工作代理在离散动作空间上训练分类器,避开局部障碍并朝向WayNet指定的路径点移动。最终的封建导航网络实现了无需强化学习、无需图结构、无需里程计、无需度量地图的全新范式,并在图像目标导航任务上达到当前最优性能。
原文摘要 · Abstract (English)
Visual navigation takes inspiration from humans, who navigate in previously unseen environments using vision without detailed environment maps. Inspired by this, we introduce a novel no-RL, no-graph, no-odometry approach to visual navigation using feudal learning to build a three tiered agent. Key to our approach is a memory proxy map (MPM), an intermediate representation of the environment learned in a self-supervised manner by the high-level manager agent that serves as a simplified memory, approximating what the agent has seen. We demonstrate that recording observations in this learned latent space is an effective and efficient memory proxy that can remove the need for graphs and odometry in visual navigation tasks. For the mid-level manager agent, we develop a waypoint network (WayNet) that outputs intermediate subgoals, or waypoints, imitating human waypoint selection during local navigation. For the low-level worker agent, we learn a classifier over a discrete action space that avoids local obstacles and moves the agent towards the WayNet waypoint. The resulting feudal navigation network offers a novel approach with no RL, no graph, no odometry, and no metric map; all while achieving SOTA results on the image goal navigation task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。