arXiv:2504.10003cs.ROcs.CV2025-04ICRA被引 43

用扩散模型生成视觉导航路径,自动满足成本约束。

NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigation

  • 用条件扩散模型学习路径与图像的映射关系。
  • 推理时融合场景和任务成本梯度,生成高效无碰撞路径。
  • 零样本迁移能力强,适合真实机器人快速部署。

视觉导航是移动机器人领域的基础挑战,需具备适应多样环境的泛化能力。传统方法依赖几何解法最小化特定成本,虽可适应新场景但易受多模块设计和手工规则影响产生误差;学习方法虽规划成功率高,却难以泛化到未见环境,且训练开销大。为此,我们提出一种混合方法,结合学习与经典方法优势,实现仅依赖RGB图像的视觉导航。首先在多样路径-图像观测对上训练条件扩散模型;推理时,通过整合可微分的场景特定与任务级成本梯度,引导模型生成满足约束的有效路径。该方法无需重新训练,具备即插即用特性。在室内与室外、仿真与真实场景中广泛实验表明,该方法具备零样本迁移能力,在成功率与碰撞率上均优于基线。代码将发布于 https://github.com/SYSU-RoboticsLab/NaviD。

原文摘要 · Abstract (English)

Visual navigation, a fundamental challenge in mobile robotics, demands versatile policies to handle diverse environments. Classical methods leverage geometric solutions to minimize specific costs, offering adaptability to new scenarios but are prone to system errors due to their multi-modular design and reliance on hand-crafted rules. Learning-based methods, while achieving high planning success rates, face difficulties in generalizing to unseen environments beyond the training data and often require extensive training. To address these limitations, we propose a hybrid approach that combines the strengths of learning-based methods and classical approaches for RGB-only visual navigation. Our method first trains a conditional diffusion model on diverse path-RGB observation pairs. During inference, it integrates the gradients of differentiable scene-specific and task-level costs, guiding the diffusion model to generate valid paths that meet the constraints. This approach alleviates the need for retraining, offering a plug-and-play solution. Extensive experiments in both indoor and outdoor settings, across simulated and real-world scenarios, demonstrate zero-shot transfer capability of our approach, achieving higher success rates and fewer collisions compared to baseline methods. Code will be released at https://github.com/SYSU-RoboticsLab/NaviD.

视觉导航扩散模型机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。