arXiv:2411.04787cs.RO2024-11ICRA被引 16

一个控制器能生成所有四足动物步态并自动优化能耗。

AllGaits: Learning All Quadruped Gaits and Transitions

  • 用强化学习调控抽象振荡器参数,动态生成不同步态。
  • 发现奔跑速度不同时最优步态不同,且需调整步态风格以省能。
  • 实测可应对腿损、泛化到未训练步态,适合机器人多场景应用。

我们提出一种框架,通过深度强化学习训练单一策略,实现所有四足步态及过渡的自动生成。该框架利用中央模式发生器(CPG)的抽象振荡器系统,通过调节其耦合关系生成不同步态,并由模式形成层控制身体高度、抬脚高度和足部偏移等步态特征。用户可实时在任意速度下切换步态。我们系统研究了不同速度下的最优步态选择及过渡时机,从能量效率(运输成本,COT)角度分析。结果显示,当前流行的快跑步态(trot)并非最低COT,综合平均基底速度与关节加速度等多指标时,最优步态会变化。我们在多种硬件平台上部署该控制器,成功实现9种典型四足动物步态,并验证了对未见步态的泛化能力及对腿部故障的鲁棒性。视频演示见https://youtu.be/OLoWSX_R868。

原文摘要 · Abstract (English)

We present a framework for learning a single policy capable of producing all quadruped gaits and transitions. The framework consists of a policy trained with deep reinforcement learning (DRL) to modulate the parameters of a system of abstract oscillators (i.e. Central Pattern Generator), whose output is mapped to joint commands through a pattern formation layer that sets the gait style, i.e. body height, swing foot ground clearance height, and foot offset. Different gaits are formed by changing the coupling between different oscillators, which can be instantaneously selected at any velocity by a user. With this framework, we systematically investigate which gait should be used at which velocity, and when gait transitions should occur from a Cost of Transport (COT), i.e. energy-efficiency, point of view. Additionally, we note how gait style changes as a function of locomotion speed for each gait to keep the most energy-efficient locomotion. While the currently most popular gait (trot) does not result in the lowest COT, we find that considering different co-dependent metrics such as mean base velocity and joint acceleration result in different `optimal' gaits than those that minimize COT. We deploy our controller in various hardware experiments, showing all 9 typical quadruped animal gaits, and demonstrate generalizability to unseen gaits during training, and robustness to leg failures. Video results can be found at https://youtu.be/OLoWSX_R868.

四足机器人步态控制强化学习能耗优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。