arXiv:2503.04462cs.ROcs.LG2025-03被引 2

让四足机器人在复杂地形上灵活又稳定地移动,还能实时调整身体姿态。

PALo: Learning Posture-Aware Locomotion for Quadruped Robots

  • 用深度强化学习实现端到端的姿态感知运动控制。
  • 在仿真中训练后无需微调即可在真实环境中实时运行。
  • 适合研究机器人低层运动控制或具身智能的学者与工程师。

随着具身智能的快速发展,四足机器人在复杂地形上的运动控制已成为研究热点。不同于传统仅关注速度跟踪的方法,本文旨在平衡四足机器人的敏捷性与鲁棒性。为此,提出一种名为PALo的端到端深度强化学习框架,实现姿态感知的运动控制,可同时处理线速度、角速度跟踪以及实时调整躯干高度、俯仰角和滚转角。将运动控制问题建模为部分可观测马尔可夫决策过程,并采用非对称演员-评论家架构以克服仿真到现实的挑战。通过定制化训练课程,PALo在仿真环境中实现敏捷的姿态感知运动控制,并成功迁移至真实场景而无需微调,实现了复杂地形下四足机器人的实时运动与姿态控制。实验分析揭示了关键组件对性能的贡献,验证了方法的有效性。研究成果为高维指令空间下的四足机器人底层运动控制提供了新可能,并为具身智能上层模块的研究奠定基础。

原文摘要 · Abstract (English)

With the rapid development of embodied intelligence, locomotion control of quadruped robots on complex terrains has become a research hotspot. Unlike traditional locomotion control approaches focusing solely on velocity tracking, we pursue to balance the agility and robustness of quadruped robots on diverse and complex terrains. To this end, we propose an end-to-end deep reinforcement learning framework for posture-aware locomotion named PALo, which manages to handle simultaneous linear and angular velocity tracking and real-time adjustments of body height, pitch, and roll angles. In PALo, the locomotion control problem is formulated as a partially observable Markov decision process, and an asymmetric actor-critic architecture is adopted to overcome the sim-to-real challenge. Further, by incorporating customized training curricula, PALo achieves agile posture-aware locomotion control in simulated environments and successfully transfers to real-world settings without fine-tuning, allowing real-time control of the quadruped robot's locomotion and body posture across challenging terrains. Through in-depth experimental analysis, we identify the key components of PALo that contribute to its performance, further validating the effectiveness of the proposed method. The results of this study provide new possibilities for the low-level locomotion control of quadruped robots in higher dimensional command spaces and lay the foundation for future research on upper-level modules for embodied intelligence.

四足机器人强化学习运动控制仿真实现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。