通过空间引导让机器人更懂指令,实现通用任务自主执行。
InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy
- 用空间定位连接语言指令与动作,分两阶段训练提升理解力。
- 在多个仿真和真实场景中,任务成功率最高提升20.6%。
- 适合想构建通用机器人策略的研究者与开发者使用。
我们提出InternVLA-M1,一种统一的空间定位与机器人控制框架,推动指令跟随机器人向可扩展、通用智能迈进。其核心是空间引导的视觉-语言-动作训练:第一阶段在超过230万条空间推理数据上预训练,确定‘何处执行’,将指令与无体感的视觉位置对齐;第二阶段通过即插即用的空间提示生成具身体感的动作,决定‘如何执行’。该训练方法带来显著提升:在SimplerEnv Google Robot上比无空间引导的变体高14.6%,WidowX上高17%,LIBERO Franka上高4.3%;在盒子、点、轨迹预测中展现更强空间推理能力。为扩大指令泛化,我们构建模拟引擎,收集24.4万条可迁移的拾取放置任务,使200个任务、3000+物体上的平均性能提升6.2%。真实世界集群拾取任务中提升7.3%;结合合成数据协同训练,在未见物体和新配置下达20.6%提升。在长时程、高推理强度场景中,优于现有方法超10%。结果表明,空间引导是实现可扩展、鲁棒通用机器人的统一范式。代码与模型已开源。
原文摘要 · Abstract (English)
We introduce InternVLA-M1, a unified framework for spatial grounding and robot control that advances instruction-following robots toward scalable, general-purpose intelligence. Its core idea is spatially guided vision-language-action training, where spatial grounding serves as the critical link between instructions and robot actions. InternVLA-M1 employs a two-stage pipeline: (i) spatial grounding pre-training on over 2.3M spatial reasoning data to determine ``where to act'' by aligning instructions with visual, embodiment-agnostic positions, and (ii) spatially guided action post-training to decide ``how to act'' by generating embodiment-aware actions through plug-and-play spatial prompting. This spatially guided training recipe yields consistent gains: InternVLA-M1 outperforms its variant without spatial guidance by +14.6% on SimplerEnv Google Robot, +17% on WidowX, and +4.3% on LIBERO Franka, while demonstrating stronger spatial reasoning capability in box, point, and trace prediction. To further scale instruction following, we built a simulation engine to collect 244K generalizable pick-and-place episodes, enabling a 6.2% average improvement across 200 tasks and 3K+ objects. In real-world clustered pick-and-place, InternVLA-M1 improved by 7.3%, and with synthetic co-training, achieved +20.6% on unseen objects and novel configurations. Moreover, in long-horizon reasoning-intensive scenarios, it surpassed existing works by over 10%. These results highlight spatially guided training as a unifying principle for scalable and resilient generalist robots. Code and models are available at https://github.com/InternRobotics/InternVLA-M1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。