arXiv:2502.17219cs.ROcs.LG2025-02被引 26

仅靠本体感知实现人形机器人在狭窄地形上的稳定行走

Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning

  • 基于动态平衡与强化学习的全身运动控制
  • 在无外部感知条件下仍可稳定通过窄路和突发障碍
  • 适合复杂环境下的机器人自主导航任务

人类具备精细的动态平衡机制,可在多变地形和极端条件下保持稳定。然而,尽管近期进展显著,现有仿人机器人步态算法在缺乏外部感知(如视觉或激光雷达)时仍难以穿越极端环境。原因在于当前方法多依赖步态或感知奖励,缺乏有效应对不可见障碍和突发失衡的机制。为此,我们提出一种基于动态平衡与强化学习的全身运动算法,使仿人机器人仅依靠本体感知即可穿越极端地形,尤其是狭窄路径和意外障碍。具体而言,在全身演员-评论家框架中引入扩展的零力矩点(ZMP)驱动奖励与任务驱动奖励,实现上下肢协调动作,提升运动鲁棒性。在全尺寸Unitree H1-2机器人上的实验验证了该方法在极窄地形和外部扰动下仍能保持平衡,显著增强了机器人在复杂环境中的适应能力。视频见 https://whole-body-loco.github.io。

原文摘要 · Abstract (English)

Humans possess delicate dynamic balance mechanisms that enable them to maintain stability across diverse terrains and under extreme conditions. However, despite significant advances recently, existing locomotion algorithms for humanoid robots are still struggle to traverse extreme environments, especially in cases that lack external perception (e.g., vision or LiDAR). This is because current methods often rely on gait-based or perception-condition rewards, lacking effective mechanisms to handle unobservable obstacles and sudden balance loss. To address this challenge, we propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL) that enables humanoid robots to traverse extreme terrains, particularly narrow pathways and unexpected obstacles, using only proprioception. Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework, aiming to achieve coordinated actions of the upper and lower limbs for robust locomotion. Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains and under external disturbances, demonstrating its effectiveness in enhancing the robot's adaptability to complex environments. The videos are given at https://whole-body-loco.github.io.

人形机器人动态平衡强化学习全身控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。