用扩散模型补全未知区域地图,让机器人在不完整环境里准确定位目标。
Plug-and-Play Label Map Diffusion for Universal Goal-Oriented Navigation

- 基于扩散模型补全未观测区域的障碍物与语义标签
- 在三个导航任务中达到当前最优性能,提升地图覆盖范围
- 可无缝接入现有导航系统,适合复杂环境下的机器人定位
在具身视觉中,目标导向导航(GON)要求机器人在未探索环境中定位特定目标。主要挑战在于需构建鸟瞰图(BEV)地图以理解环境,同时定位未观测目标。现有基于地图的方法多依赖自中心语义地图,常面临对完整地图的依赖或语义关联不一致的问题。为此,我们提出即插即用标签地图扩散(PLMD),一种基于去噪扩散概率模型(DDPM)的新地图补全扩散模型。PLMD通过扩散过程生成未观测区域的障碍物与语义标签,从而在部分观测环境下实现目标定位。此外,它通过利用已知与未知障碍布局间的结构一致性,并将障碍先验融入语义去噪过程,缓解了语义关联不一致问题。通过用预测标签替代未观测区域,机器人可准确定位指定物体。大量实验表明,PLMD(I)有效扩展了未知地图区域,(II)可无缝集成至依赖语义地图的现有导航策略,(III)在三个GON任务上达到领先性能。
原文摘要 · Abstract (English)
In embodied vision, Goal-Oriented Navigation (GON) requires robots to locate a specific goal within an unexplored environment. The primary challenge of GON arises from the need to construct a Bird's-Eye-View (BEV) map to understand the environment while simultaneously localizing an unobserved goal. Existing map-based methods typically employ self-centered semantic maps, often facing challenges such as reliance on complete maps or inconsistent semantic association. To this end, we propose Plug-and-Play Label Map Diffusion (PLMD), which defines a novel map completion diffusion model based on Denoising Diffusion Probabilistic Models (DDPM). PLMD generates obstacle and semantic labels for unobserved regions through a diffusion-based completion process, thereby enabling goal localization even in partially observed environments. Moreover, it mitigates inconsistent semantic association by leveraging structural consistency between known and unknown obstacle layouts and integrating obstacle priors into the semantic denoising process. By substituting predicted labels for unobserved regions, robots can accurately localize the specified objects. Extensive experiments demonstrate that PLMD \textbf{(I)} effectively expands the region of unknown maps, \textbf{(II)} integrates seamlessly into existing navigation strategies that rely on semantic maps, \textbf{(III)} achieves state-of-the-art performance on three GON tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。