arXiv:2509.17941cs.ROcs.AI2025-09被引 2

让机器人通过组合动作模型,智能理解并执行复杂导航指令。

ComposableNav: Instruction-Following Navigation in Dynamic Environments via Composable Diffusion

  • 将导航指令拆解为独立动作模块,用扩散模型分别训练
  • 部署时并行组合动作,支持训练中未见的指令组合
  • 无需每种动作都人工示范,适合复杂动态环境应用

本文研究机器人在动态环境中遵循指令进行导航的问题。挑战在于指令规格具有组合性:每个指令可包含多个要求,随着机器人技能增多,可能的组合数量呈指数增长。例如,“超车行人同时保持在道路右侧”包含两个要求:超车行人和靠右行走。为此,我们提出ComposableNav,基于将指令分解为独立满足的运动基元的直觉。利用扩散模型,该方法分别学习每个基元,部署时并行组合以满足训练中未见过的新指令组合。为避免为每个基元收集演示数据,我们采用两阶段训练:(1) 监督预训练构建动态导航基础扩散模型;(2) 强化学习微调,使基础模型演化为不同运动基元。仿真与真实世界实验表明,ComposableNav能生成满足多样化、未见指令组合的轨迹,显著优于非组合式视觉-语言模型策略及基于代价图组合的基线方法。视频与补充材料见项目页:https://amrl.cs.utexas.edu/ComposableNav/

原文摘要 · Abstract (English)

This paper considers the problem of enabling robots to navigate dynamic environments while following instructions. The challenge lies in the combinatorial nature of instruction specifications: each instruction can include multiple specifications, and the number of possible specification combinations grows exponentially as the robot's skill set expands. For example, "overtake the pedestrian while staying on the right side of the road" consists of two specifications: "overtake the pedestrian" and "walk on the right side of the road." To tackle this challenge, we propose ComposableNav, based on the intuition that following an instruction involves independently satisfying its constituent specifications, each corresponding to a distinct motion primitive. Using diffusion models, ComposableNav learns each primitive separately, then composes them in parallel at deployment time to satisfy novel combinations of specifications unseen in training. Additionally, to avoid the onerous need for demonstrations of individual motion primitives, we propose a two-stage training procedure: (1) supervised pre-training to learn a base diffusion model for dynamic navigation, and (2) reinforcement learning fine-tuning that molds the base model into different motion primitives. Through simulation and real-world experiments, we show that ComposableNav enables robots to follow instructions by generating trajectories that satisfy diverse and unseen combinations of specifications, significantly outperforming both non-compositional VLM-based policies and costmap composing baselines. Videos and additional materials can be found on the project page: https://amrl.cs.utexas.edu/ComposableNav/

导航扩散模型指令跟随动态环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。