arXiv:2509.09106cs.RO2025-09被引 5

用倒立摆模型设计奖励函数,让双足机器人在野外更稳更会看路。

LIPM-Guided Reinforcement Learning for Stable and Perceptive Locomotion in Bipedal Robots

  • 基于倒立摆模型设计奖励,调控质心高度和躯干姿态以保持平衡。
  • 在仿真与真实户外环境中均实现高速、抗干扰、稳定视点的行走。
  • 适合研究双足机器人步态控制与感知融合的开发者参考。

在非结构化户外环境中实现双足机器人的稳定且具备感知能力的行走仍是重大挑战,源于复杂地形几何特征及对外部扰动的敏感性。本文提出一种受线性倒立摆模型(LIPM)启发的新奖励设计,以实现野外环境下兼具感知与稳定的行走。LIPM为动态平衡提供了理论指导,通过调节质心(CoM)高度与躯干朝向,确保机器人相机拥有稳定视野,是实现地形感知行走的关键。基于此,我们设计了兼顾平衡性与动态稳定性的奖励函数,并促进精确的质心轨迹跟踪。为自适应权衡速度追踪与稳定性,采用奖励融合模块(RFM),必要时优先保障稳定性。采用双评论家架构分别评估稳定性与运动目标,提升训练效率与鲁棒性。通过在仿真与真实双足机器人上的大量实验验证,结果表明该方法在多种速度与感知条件下均表现出优异的地形适应性、抗干扰能力与一致性能。

原文摘要 · Abstract (English)

Achieving stable and robust perceptive locomotion for bipedal robots in unstructured outdoor environments remains a critical challenge due to complex terrain geometry and susceptibility to external disturbances. In this work, we propose a novel reward design inspired by the Linear Inverted Pendulum Model (LIPM) to enable perceptive and stable locomotion in the wild. The LIPM provides theoretical guidance for dynamic balance by regulating the center of mass (CoM) height and the torso orientation. These are key factors for terrain-aware locomotion, as they help ensure a stable viewpoint for the robot's camera. Building on this insight, we design a reward function that promotes balance and dynamic stability while encouraging accurate CoM trajectory tracking. To adaptively trade off between velocity tracking and stability, we leverage the Reward Fusion Module (RFM) approach that prioritizes stability when needed. A double-critic architecture is adopted to separately evaluate stability and locomotion objectives, improving training efficiency and robustness. We validate our approach through extensive experiments on a bipedal robot in both simulation and real-world outdoor environments. The results demonstrate superior terrain adaptability, disturbance rejection, and consistent performance across a wide range of speeds and perceptual conditions.

双足机器人强化学习步态控制感知融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。