用强化学习让蝾螈机器人在陆地和水中稳定移动。
Learning Whole-Body Control for a Salamander Robot
- 用强化学习直接控制关节,实现全身协调运动。
- 在真实环境中稳定行走于平坦与不平地形。
- 首次实现陆地与水中运动模式的自然切换。
受蝾螈启发的两栖四足机器人在复杂两栖环境中具有应用潜力。尽管传统四足机器人已成功训练出多样化的运动控制器,但多数蝾螈机器人仍依赖基于中央模式发生器(CPG)和模型的协调策略。在高度关节化的物理蝾螈机器人上,实现从仿真到硬件的统一关节级全身控制仍较少被探索。此外,极少有四足机器人尝试在两栖环境中使用基于学习的控制器。本文采用强化学习,将本体感受观测和命令速度映射为关节动作,使协调运动行为自然涌现。为部署于硬件,我们采用系统级真实-仿真匹配与仿真-现实迁移策略。所学控制器在真实世界中实现了平坦与不平地形上的稳定协调步行。超越陆地运动,该框架在仿真中实现了步行与游泳之间的过渡,揭示了跨物理模式运动的重要现象。
原文摘要 · Abstract (English)
Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional quadrupedal robots, most salamander robots relied on central-pattern-generator (CPG)-based and model-based coordination strategies for locomotion control. Learning unified joint-level whole-body control that reliably transfers from simulation to highly articulated physical salamander robots remains relatively underexplored. In addition, few legged robots have tried learning-based controllers in amphibious environments. In this work, we employ Reinforcement Learning to map proprioceptive observations and commanded velocities to joint-level actions, allowing coordinated locomotor behaviors to emerge. To deploy these policies on hardware, we adopt a system-level real-to-sim matching and sim-to-real transfer strategy. The learned controller achieves stable and coordinated walking on both flat and uneven terrains in the real world. Beyond terrestrial locomotion, the framework enables transitions between walking and swimming in simulation, highlighting a phenomenon of interest for understanding locomotion across distinct physical modes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。