用模拟中特权信息训练机器人导航扩散模型,实现零样本跨环境迁移。
NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidance
- 基于统一Transformer架构,联合学习轨迹生成与评估
- 在3000个场景中构建超百万米导航数据集,实测性能领先
- 适合需高效泛化导航的机器人研发者使用
在动态复杂开放世界环境中自主导航是机器人关键但具挑战性的能力。现有方法多依赖级联模块框架,需大量调参或依赖有限的真实示范数据。本文提出导航扩散策略(NavDP),一种仅在仿真中训练的端到端网络,可在多样环境与机器人形态间实现零样本仿真到现实迁移。其核心为基于Transformer的统一架构,仅依赖局部RGB-D观测,联合学习轨迹生成与评估。通过预测对比轨迹样本的评判值,有效利用仿真中可用的特权信息,促进精准空间理解并区分安全与危险行为。为此,我们在仿真中构建了高效的生成管道,并建立大规模数据集,涵盖3000个场景、超过一百万米的导航经验。在仿真与真实环境中的实验证明,NavDP显著优于现有最先进方法。此外,我们识别出影响其泛化性能的关键因素。数据集与代码已公开于https://wzcai99.github.io/navigation-diffusion-policy.github.io。
原文摘要 · Abstract (English)
Learning to navigate in dynamic and complex open-world environments is a critical yet challenging capability for autonomous robots. Existing approaches often rely on cascaded modular frameworks, which require extensive hyperparameter tuning or learning from limited real-world demonstration data. In this paper, we propose Navigation Diffusion Policy (NavDP), an end-to-end network trained solely in simulation that enables zero-shot sim-to-real transfer across diverse environments and robot embodiments. The core of NavDP is a unified transformer-based architecture that jointly learns trajectory generation and trajectory evaluation, both conditioned solely on local RGB-D observation. By learning to predict critic values for contrastive trajectory samples, our proposed approach effectively leverages supervision from privileged information available in simulation, thereby fostering accurate spatial understanding and enabling the distinction between safe and dangerous behaviors. To support this, we develop an efficient data generation pipeline in simulation and construct a large-scale dataset encompassing over one million meters of navigation experience across 3,000 scenes. Empirical experiments in both simulated and real-world environments demonstrate that NavDP significantly outperforms prior state-of-the-art methods. Furthermore, we identify key factors influencing the generalization performance of NavDP. The dataset and code are publicly available at https://wzcai99.github.io/navigation-diffusion-policy.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。