用统一坐标系动作表示,让不同机器人共享训练数据。
SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policies

- 用末端位姿变化量作为通用动作表示,避免机器人差异干扰
- 跨机器人数据训练时成功率提升40%以上,部署时适应动态变化
- 适合需要多机器人通用策略的工业场景,尤其硬件不一致时
在机器人学习中,扩大跨形态和环境的数据规模已成为训练通用机器人策略的主要范式。这些策略通常通过行为克隆模仿预收集的示范动作。然而,由于机器人动作与其自身动力学绑定,不同机器人实现相同运动可能需要不同动作,这种差异阻碍了策略在多样化机器人间的训练与部署。为此,我们提出采用笛卡尔状态增量作为跨机器人的通用动作表示,并引入状态预测与自适应执行(SPACE)框架。SPACE在三个层面处理机器人动力学差异:不同形态之间、同一形态的硬件单元间,以及单个机器人运行过程中的变化。该框架包含两个组件:(i) 笛卡尔状态增量策略,预测末端执行器的几何位移;(ii) 动作适配器,将预测的位移转换为机器人特定控制指令。实验表明,当从不同形态及同形态硬件单元数据中学习时,SPACE显著优于直接预测控制指令的策略。在部署阶段,即使控制频率、物体重量或控制器增益发生变化,空间框架仍保持鲁棒性。
原文摘要 · Abstract (English)
In robot learning, scaling training datasets across diverse embodiments and environments has become a dominant paradigm for learning generalizable robot policies. These policies are commonly trained via behavior cloning to imitate actions from pre-collected demonstrations. However, since robot actions are tied to the dynamics of the data collection robot, different robots may require different actions to achieve the same motion. This discrepancy hinders both policy training and deployment across diverse robots. To address this, we propose using Cartesian state delta as a universal action representation across robots, and introduce State Prediction and Adaptive Command Execution (SPACE) framework. SPACE handles robot dynamics variation at three levels: across different embodiments, across hardware units of the same embodiment, and within a single robot during operation. It consists of two components: (i) a Cartesian state delta policy that predicts geometric end-effector displacement, and (ii) Action Adapter, which converts the predicted Cartesian state delta into robot-specific control commands. Experiments show that SPACE substantially outperforms policies that directly predict control commands when learning from data collected across different embodiments and across hardware units of the same embodiment. SPACE also remains robust under dynamics shifts at deployment, including changes in control frequency, object weight, and controller gains. The project page is available at http://haeone.site/space-website/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。