让智能体先判断目标图是否在同房间,再导航,提升准确性。
REGNav: Room Expert Guided Image-Goal Navigation
- 引入房间专家模型,判断观察图与目标图是否同房间。
- 在三个基准上超越现有最佳方法,显著减少无效徘徊。
- 适合需要精准视觉导航的机器人或VR应用。
图像目标导航旨在引导智能体前往由一张图像指定的目标位置。以往方法通常学习导航策略,通过提取目标和观测图像的视觉特征并比较相似性来预测动作。然而,当智能体与目标图像处于不同房间时,难以准确判断两者相似性,导致导航失败、持续徘徊。受人类行为启发——人在执行任务前会大致判断当前环境与目标是否在同一房间,我们提出房间专家引导的图像目标导航模型(REGNav),赋予智能体判断目标与观测图像是否同房间的能力。具体而言,我们使用自收集的未标注房间图像,通过无监督学习预训练一个房间专家模型,该模型可提取图像中隐含的房间风格信息,并预测二者是否属于同一房间。同时,探索了两种不同的融合方式,以高效利用房间关系知识指导导航。大量实验表明,REGNav在三个主流基准上均超越现有最先进方法。
原文摘要 · Abstract (English)
Image-goal navigation aims to steer an agent towards the goal location specified by an image. Most prior methods tackle this task by learning a navigation policy, which extracts visual features of goal and observation images, compares their similarity and predicts actions. However, if the agent is in a different room from the goal image, it's extremely challenging to identify their similarity and infer the likely goal location, which may result in the agent wandering around. Intuitively, when humans carry out this task, they may roughly compare the current observation with the goal image, having an approximate concept of whether they are in the same room before executing the actions. Inspired by this intuition, we try to imitate human behaviour and propose a Room Expert Guided Image-Goal Navigation model (REGNav) to equip the agent with the ability to analyze whether goal and observation images are taken in the same room. Specifically, we first pre-train a room expert with an unsupervised learning technique on the self-collected unlabelled room images. The expert can extract the hidden room style information of goal and observation images and predict their relationship about whether they belong to the same room. In addition, two different fusion approaches are explored to efficiently guide the agent navigation with the room relation knowledge. Extensive experiments show that our REGNav surpasses prior state-of-the-art works on three popular benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。