arXiv:2510.03342cs.RO2025-10被引 82

让机器人像人一样思考再行动,解决复杂任务。

Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfer

  • 引入思维-动作交替机制,让机器人先思考再执行。
  • 在多个任务上达到新基准,支持多步复杂操作。
  • 适合研究通用机器人与具身智能的学者和开发者。

通用机器人需要对物理世界有深刻理解、先进的推理能力以及通用灵活的控制。本文介绍最新一代的Gemini Robotics模型系列:Gemini Robotics 1.5,一个支持多形态的视觉-语言-动作(VLA)模型,以及Gemini Robotics-ER 1.5,当前最先进的具身推理(ER)模型。本工作融合三大创新:第一,Gemini Robotics 1.5采用新型架构与运动迁移(MT)机制,可从异构、多形态机器人数据中学习,提升VLA模型的泛化性;第二,该模型在自然语言中穿插多层级内部推理过程与动作执行,实现“思考后行动”,显著增强复杂多步任务的分解与执行能力,并提升行为可解释性;第三,Gemini Robotics-ER 1.5在视觉与空间理解、任务规划、进展估计等关键具身推理能力上创下新纪录。该模型家族推动物理智能体迈向新阶段,使机器人能感知、思考并行动以完成复杂多步任务。

原文摘要 · Abstract (English)

General-purpose robots need a deep understanding of the physical world, advanced reasoning, and general and dexterous control. This report introduces the latest generation of the Gemini Robotics model family: Gemini Robotics 1.5, a multi-embodiment Vision-Language-Action (VLA) model, and Gemini Robotics-ER 1.5, a state-of-the-art Embodied Reasoning (ER) model. We are bringing together three major innovations. First, Gemini Robotics 1.5 features a novel architecture and a Motion Transfer (MT) mechanism, which enables it to learn from heterogeneous, multi-embodiment robot data and makes the VLA more general. Second, Gemini Robotics 1.5 interleaves actions with a multi-level internal reasoning process in natural language. This enables the robot to "think before acting" and notably improves its ability to decompose and execute complex, multi-step tasks, and also makes the robot's behavior more interpretable to the user. Third, Gemini Robotics-ER 1.5 establishes a new state-of-the-art for embodied reasoning, i.e., for reasoning capabilities that are critical for robots, such as visual and spatial understanding, task planning, and progress estimation. Together, this family of models takes us a step towards an era of physical agents-enabling robots to perceive, think and then act so they can solve complex multi-step tasks.

具身智能机器人多模态推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。