用人类示范训练机器人搬大件物品,实现零样本真实迁移。
RobotMover: Learning to Move Large Objects From Human Demonstrations
- 用交互链简化空间表示,捕捉物体移动关键动态
- 仿真训练政策,实现在真实Spot机器人上零样本部署
- 支持长时序搬运与重排,适合家庭服务机器人
在人机共存环境中,移动大型物体(如家具、电器)是机器人的重要能力。该任务面临全身协调避障、处理笨重物体动力学等挑战。本文提出RobotMover,一种基于学习的大型物体操作方法,利用人类-物体交互示范训练机器人控制策略。该系统将操作问题建模为模仿学习,采用名为“交互链”(Interaction Chain)的简化空间表示,有效捕捉核心交互动态并跨不同机器人本体泛化。将交互链融入奖励函数,结合领域随机化在仿真中训练策略,实现零样本迁移到真实机器人。实验表明,Spot机器人可成功操控椅子、桌子和立式灯等多种大型物体。在仿真与真实世界中均展现出优异的能力、鲁棒性与可控性,优于学习型与遥操作基线。系统还通过融合学习策略与简单规划模块,支持长时序物体运输与重排任务。
原文摘要 · Abstract (English)
Moving large objects, such as furniture or appliances, is a critical capability for robots operating in human environments. This task presents unique challenges, including whole-body coordination to avoid collisions and managing the dynamics of bulky, heavy objects. In this work, we present RobotMover, a learning-based system for large object manipulation that uses human-object interaction demonstrations to train robot control policies. RobotMover formulates the manipulation problem as imitation learning using a simplified spatial representation called the Interaction Chain, which captures essential interaction dynamics in a way that generalizes across different robot bodies. We incorporate this Interaction Chain into a reward function and train policies in simulation using domain randomization to enable zero-shot transfer to real-world robots. The resulting policies allow a Spot robot to manipulate various large objects, including chairs, tables, and standing lamps. Through extensive experiments in both simulation and the real world, we show that RobotMover achieves strong performance in terms of capability, robustness, and controllability, outperforming both learned and teleoperation baselines. The system also supports practical applications by combining learned policies with simple planning modules to perform long-horizon object transport and rearrangement tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。