用强化学习让机器人全身拥抱大件物体,更稳更强。
Embracing Bulky Objects with Humanoid Robots: Whole-Body Manipulation with Reinforcement Learning
- 结合人类动作先验与神经符号距离场,生成自然协调的全身动作。
- 实测可稳定抓握不同形状大小物体,且仿真到真实场景迁移成功。
- 适合需要多点接触、长时间操作的复杂人形机器人任务。
人形机器人在执行大件物体拥抱任务时,传统仅靠末端执行器的抓取方式受限于稳定性和负载能力。本文提出一种强化学习框架,融合预训练的人类动作先验与神经符号距离场(NSDF)表示,实现鲁棒的全身操纵。方法采用教师-学生架构,从大规模人类动作数据中蒸馏出符合运动学规律且物理可行的全身运动模式,协调控制手臂与躯干,实现多点接触交互,提升操作稳定性和承载能力。嵌入的NSDF提供精确连续的几何感知,增强长时序任务中的接触意识。通过全面的仿真与真实实验验证,结果表明该方法能适应多种形状和尺寸的物体,并成功实现仿真到真实的迁移,为复杂人形机器人多接触、长时序全身操纵提供了有效实用的解决方案。
原文摘要 · Abstract (English)
Whole-body manipulation (WBM) for humanoid robots presents a promising approach for executing embracing tasks involving bulky objects, where traditional grasping relying on end-effectors only remains limited in such scenarios due to inherent stability and payload constraints. This paper introduces a reinforcement learning framework that integrates a pre-trained human motion prior with a neural signed distance field (NSDF) representation to achieve robust whole-body embracing. Our method leverages a teacher-student architecture to distill large-scale human motion data, generating kinematically natural and physically feasible whole-body motion patterns. This facilitates coordinated control across the arms and torso, enabling stable multi-contact interactions that enhance the robustness in manipulation and also the load capacity. The embedded NSDF further provides accurate and continuous geometric perception, improving contact awareness throughout long-horizon tasks. We thoroughly evaluate the approach through comprehensive simulations and real-world experiments. The results demonstrate improved adaptability to diverse shapes and sizes of objects and also successful sim-to-real transfer. These indicate that the proposed framework offers an effective and practical solution for multi-contact and long-horizon WBM tasks of humanoid robots.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。