arXiv:2411.14386cs.RO2024-11ICRA被引 112

用内置高程图让机器人走路更稳,不依赖摄像头干扰。

Learning Humanoid Locomotion with Perceptive Internal Model

  • 用实时更新的地形高程图替代原始点云,提升感知清晰度。
  • 3小时完成训练,4090显卡上计算开销极低。
  • 适用于多种机器人和复杂地形,尤其擅长连续爬楼梯。

与可使用“盲策略”在多样地形中行走的四足机器人不同,双足机器人因自由度高且本体结构不稳定,需精确感知以实现稳定行走。然而,引入感知信号常带来额外扰动,降低系统鲁棒性、泛化性和效率。本文提出感知内模(Perceptive Internal Model, PIM),利用机器人自带、持续更新的以自身为中心的高程图来感知周围环境。在仿真中,通过真实障碍物高度训练策略,基于混合内模(HIM)优化,并在推理时使用构建的高程图采样高度。相比直接编码深度图或原始点云的方法,本方法使机器人能更清晰地感知脚下地形,且受相机运动或噪声影响更小。由于仿真中无需渲染深度图,计算开销极低,可在单张RTX 4090 GPU上3小时内完成训练。我们在多种双足机器人、室内外多种地形、台阶及不同传感器配置下验证了该方法的有效性,可实现双足机器人持续爬楼梯,具有作为未来双足控制基础算法的潜力。

原文摘要 · Abstract (English)

In contrast to quadruped robots that can navigate diverse terrains using a "blind" policy, humanoid robots require accurate perception for stable locomotion due to their high degrees of freedom and inherently unstable morphology. However, incorporating perceptual signals often introduces additional disturbances to the system, potentially reducing its robustness, generalizability, and efficiency. This paper presents the Perceptive Internal Model (PIM), which relies on onboard, continuously updated elevation maps centered around the robot to perceive its surroundings. We train the policy using ground-truth obstacle heights surrounding the robot in simulation, optimizing it based on the Hybrid Internal Model (HIM), and perform inference with heights sampled from the constructed elevation map. Unlike previous methods that directly encode depth maps or raw point clouds, our approach allows the robot to perceive the terrain beneath its feet clearly and is less affected by camera movement or noise. Furthermore, since depth map rendering is not required in simulation, our method introduces minimal additional computational costs and can train the policy in 3 hours on an RTX 4090 GPU. We verify the effectiveness of our method across various humanoid robots, various indoor and outdoor terrains, stairs, and various sensor configurations. Our method can enable a humanoid robot to continuously climb stairs and has the potential to serve as a foundational algorithm for the development of future humanoid control methods.

双足行走内模模型地形感知高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。