一个可动态配置的导航模型,让机器人在不同任务间无缝切换。
Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System

- 通过参数化接口控制观察策略和任务模式,实现推理时灵活配置。
- 在1560万样本上训练,8B参数下跨基准表现领先,零样本泛化至真实机器人。
- 适合构建复杂自主导航系统,支持长期任务分解与动态行为组合。
自主导航系统需要一个可在推理时外部重配置观测策略的基础导航模型,因为指令遵循、物体搜索、目标追踪和自动驾驶共享同一感知-规划主干,却对视觉流的消费方式有根本性差异。我们提出 Qwen-RobotNav,一种基于 Qwen-RobotNav 的可扩展导航模型,通过一个包含两个互补维度的参数化接口解决该问题:多任务模式用于选择导航行为,可控的观察参数(如令牌预算、每摄像头权重)用于调控视觉历史编码方式。通过训练时对所有参数的随机化,Qwen-RobotNav 对任意推理时配置均具鲁棒性,且无需修改 Qwen-RobotNav 主干架构。我们在1560万样本上训练 Qwen-RobotNav;与视觉-语言数据联合训练可防止仅用轨迹训练时出现的反应式动作序列映射崩溃现象。该参数化接口也使 Qwen-RobotNav 成为自主系统中的天然构件:在长时程场景中,上层规划器将目标分解为子任务,并在剧集中动态切换 Qwen-RobotNav 的任务模式与上下文策略,通过重复调用同一模型组合出复杂行为。大量实验表明,Qwen-RobotNav 在主要导航基准上达到新最优性能。该模型从2B到8B参数表现出良好扩展性,联合多任务训练构建了共享的空间-规划基底,可在任务族间迁移,并展现出强大的零样本泛化能力,适用于多种环境下的真实机器人。
原文摘要 · Abstract (English)
Agentic navigation systems require a base navigation model whose observation strategy can be externally reconfigured at inference time, because instruction following, object search, target tracking, and autonomous driving share the same perception-planning backbone yet demand fundamentally different strategies for consuming the visual stream. We present Qwen-RobotNav, a scalable navigation model built on Qwen-RobotNav that addresses it through a parameterised interface with two complementary dimensions: multiple task modes that select the navigation behaviour, and controllable observation parameters (e.g., token budget, per-camera weights) that govern how visual history is encoded. With training-time randomization over all parameters, Qwen-RobotNav is robust to any inference-time configuration requiring zero architectural modification to the Qwen-RobotNav backbone. We train Qwen-RobotNav on 15.6M samples; co-training with vision-language data prevents the collapse into reactive action-sequence mappers observed in trajectory-only training. The parameterised interface also makes Qwen-RobotNav a natural building block for agentic systems: for long-horizon scenarios, an upper-level planner decomposes goals into sub-tasks and dynamically switches Qwen-RobotNav's task mode and context strategy mid-episode, composing complex behaviours from repeated calls to the same model. Extensive experiments show that Qwen-RobotNav sets new state-of-the-art results across major navigation benchmarks. The model exhibits favourable scaling from 2B to 8B parameters, with joint multi-task training developing a shared spatial-planning substrate that transfers across task families, and demonstrates strong zero-shot generalisation to real-world robots across diverse environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。