让机器人像攀岩一样安全爬上0.8米高台,突破腿长限制。
APEX: Learning Adaptive High-Platform Traversal for Humanoid Robots
- 用感知引导的攀爬策略,分阶段完成上下平台动作。
- 在29自由度机器人上实现零样本迁移,成功越过1.14倍腿长平台。
- 自适应切换技能,适合复杂地形的智能机器人研发者。
人形机器人通过深度强化学习在不平坦地形上实现了稳健的足部行走,但超过腿部长度的平台仍难以跨越。现有RL训练常收敛于高冲击、扭矩受限的跳跃式解法,不适合真实部署。为此,我们提出APEX系统,实现基于感知的攀爬式高平台穿越,包括垂直边缘的上下攀爬、平台上的行走或爬行,以及姿态调整的起立与躺下。核心是通用的棘轮进展奖励机制,追踪最优任务进度并惩罚无进步步态,提供密集且无需速度信息的监督,支持强安全约束下的高效探索。基于此,我们训练了基于激光雷达的全身操作策略,并通过双重策略缩小仿真到现实的感知差距:训练时建模映射伪影,部署时对高程图进行滤波和补全。最终将六项技能融合为单一策略,根据局部几何和指令自主选择行为与转换。实验在29自由度的Unitree G1机器人上验证,实现了零样本仿真到现实的0.8米平台穿越(约1.14倍腿长),具备高度与初始姿态的鲁棒适应性,以及平滑稳定的多技能过渡。
原文摘要 · Abstract (English)
Humanoid locomotion has advanced rapidly with deep reinforcement learning (DRL), enabling robust feet-based traversal over uneven terrain. Yet platforms beyond leg length remain largely out of reach because current RL training paradigms often converge to jumping-like solutions that are high-impact, torque-limited, and unsafe for real-world deployment. To address this gap, we propose APEX, a system for perceptive, climbing-based high-platform traversal that composes terrain-conditioned behaviors: climb-up and climb-down at vertical edges, walking or crawling on the platform, and stand-up and lie-down for posture reconfiguration. Central to our approach is a generalized ratchet progress reward for learning contact-rich, goal-reaching maneuvers. It tracks the best-so-far task progress and penalizes non-improving steps, providing dense yet velocity-free supervision that enables efficient exploration under strong safety regularization. Based on this formulation, we train LiDAR-based full-body maneuver policies and reduce the sim-to-real perception gap through a dual strategy: modeling mapping artifacts during training and applying filtering and inpainting to elevation maps during deployment. Finally, we distill all six skills into a single policy that autonomously selects behaviors and transitions based on local geometry and commands. Experiments on a 29-DoF Unitree G1 humanoid demonstrate zero-shot sim-to-real traversal of 0.8 meter platforms (approximately 114% of leg length), with robust adaptation to platform height and initial pose, as well as smooth and stable multi-skill transitions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。