让机器人像人一样灵活跨越障碍,靠视觉感知自主决策。
Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching
- 用运动匹配拼接人类动作技能,生成流畅长序列轨迹
- 实测可攀爬高达1.25米障碍(96%机器人身高)
- 仅靠机载深度相机和简单指令,实现复杂环境自主穿越
尽管近期类人机器人在复杂地形上实现了稳定行走,但捕捉高度动态的人类运动敏捷性与适应性仍是开放挑战。尤其在复杂环境中进行敏捷跑酷,不仅需要底层鲁棒性,还需具备类人运动表现力、长时序技能组合能力以及感知驱动的决策能力。本文提出感知型类人跑酷框架(Perceptive Humanoid Parkour, PHP),使类人机器人能够自主完成跨挑战性障碍赛道的长时序视觉引导跑酷。方法首先通过特征空间中的最近邻搜索实现运动匹配,将人类原子动作技能重新映射并组合成长时序运动轨迹,保证复杂技能链的灵活衔接与自然流畅性。随后,训练运动追踪强化学习专家策略,并通过DAgger与强化学习结合的方式将其压缩为单一基于深度图的多技能学生策略。关键在于感知与技能组合的融合,使机器人仅使用机载深度传感器和离散二维速度指令,即可根据环境实时判断并执行跨越、攀爬、翻越或滚下等动作,应对不同几何与高度障碍。我们在Unitree G1类人机器人上进行了大量真实世界实验,验证了其在高动态跑酷任务中的能力,包括攀爬最高达1.25米(96%机器人高度)的障碍物,以及在闭环反馈下对实时障碍扰动的长时序多障碍穿越能力。
原文摘要 · Abstract (English)
While recent advances in humanoid locomotion have achieved stable walking on varied terrains, capturing the agility and adaptivity of highly dynamic human motions remains an open challenge. In particular, agile parkour in complex environments demands not only low-level robustness, but also human-like motion expressiveness, long-horizon skill composition, and perception-driven decision-making. In this paper, we present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour across challenging obstacle courses. Our approach first leverages motion matching, formulated as nearest-neighbor search in a feature space, to compose retargeted atomic human skills into long-horizon kinematic trajectories. This framework enables the flexible composition and smooth transition of complex skill chains while preserving the elegance and fluidity of dynamic human motions. Next, we train motion-tracking reinforcement learning (RL) expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy, using a combination of DAgger and RL. Crucially, the combination of perception and skill composition enables autonomous, context-aware decision-making: using only onboard depth sensing and a discrete 2D velocity command, the robot selects and executes whether to step over, climb onto, vault or roll off obstacles of varying geometries and heights. We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot, demonstrating highly dynamic parkour skills such as climbing tall obstacles up to 1.25m (96% robot height), as well as long-horizon multi-obstacle traversal with closed-loop adaptation to real-time obstacle perturbations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。