用人类示范指导机器人在软地上站起来,自适应地形变形。
Demonstration-Guided Humanoid Stand-Up on an Emulated Deformable Surface

- 以人类硬地示范为参考,通过强化学习生成站起动作。
- 软地接触最大下沉40毫米,仍能保持姿势稳定与目标高度。
- 显式奖励机制确保站立成功,适合仿人机器人控制研究者。
本文提出一种参考引导的强化学习框架,用于29自由度的Unitree G1人形机器人在可变形软地上的站起运动生成,基于在硬地上记录的人类示范。地形柔顺性通过MuJoCo刚体软接触模型中的solref和solimp参数建模。奖励函数包含(i)通过残差关节位置控制实现参考运动跟踪,以及(ii)显式的恢复目标,如骨盆高度、躯干直立度和最终姿态。首先在硬地条件下训练策略;随后降低地形刚度(调整solref),扩大名义穿透区域(调整solimp)。后续训练使策略适应接触阶段因显著地面下陷导致的支持力延迟,同时保留原始示范模式。所学策略在仿真中成功完成从倒地到站立的任务,达到目标骨盆高度与直立度,过程中最大接触穿透约40毫米。该方法在两个站起序列上验证,均在硬地与软地上成功达成最终恢复目标。消融实验表明,仅靠参考跟踪不足以成功站起,显式恢复奖励至关重要。
原文摘要 · Abstract (English)
This paper presents a reference-guided reinforcement learning framework to generate stand-up motion for a 29-DOF Unitree G1 humanoid on deformable soft ground, using a human demonstration recorded on hard ground. The terrain compliance is modelled using solref and solimp parameters from MuJoCo's rigid body soft-contact model. The rewards consists of (i) reference motion tracking through residual joint-position control and (ii) explicit recovery objectives such as pelvis height, torso uprightness, and the final posture. First, the policy is trained with the specified rewards considering hard ground. Next, the terrain stiffness is lowered by updating solref and the nominal surface penetration zone is expanded using solimp. Subsequent training enables the policy to adapt to the delayed support force generation due to significant surface penetration during contact-intensive phases while preserving the original demonstration pattern. The learned policy successfully completes the fallen-to-standing task in simulation, reaching the targeted pelvis height and uprightness, with a maximum contact penetration of approximately 40 mm during the process. The proposed method is demonstrated on two stand-up sequences and successfully achieves the final recovery objective on both hard and soft ground. Ablation studies show that reference tracking alone is insufficient for successful stand-up, and that explicit recovery rewards are essential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。