arXiv:2605.10063cs.RO2026-05中稿 · RA-L 2026, website…被引 1

通过外力引导加速四足机器人动态运动学习,提升训练效率与成功率。

EFGCL: Learning Dynamic Motion through Spotting-Inspired External Force Guided Curriculum Learning

论文配图:EFGCL: Learning Dynamic Motion through Spotting-Inspired External Force Guided Curriculum Learning
图 1 · 摘自论文原文
  • 引入外部辅助力模拟体操中的保护动作,引导智能体早期体验成功
  • 跳跃任务学习速度提升约2倍,复杂翻滚动作可成功训练
  • 适合需高风险探索的机器人动态运动学习,尤其适用于真实部署

通过强化学习(RL)学习腿式机器人的动态全身运动仍具挑战性,因失败风险高导致探索效率低且学习不稳定。本文提出外部力引导课程学习(EFGCL),基于物理引导原理,在训练中引入外部辅助力。受艺术体操中“保护”动作启发,EFGCL使智能体在无需特定任务奖励设计或参考轨迹的情况下,亲身经历成功的运动执行。在四足机器人完成跳跃、后空翻和侧翻任务的实验中,EFGCL将跳跃任务的学习速度提升约两倍,并成功训练出传统RL方法无法实现的复杂全身动作。进一步验证表明,所学策略可在真实机器人上部署,复现与仿真一致的动作。结果表明,通过物理引导让智能体早期体验成功,是提升动态全身运动任务学习效率的有效通用策略。

原文摘要 · Abstract (English)

Learning dynamic whole-body motions for legged robots through reinforcement learning (RL) remains challenging due to the high risk of failure, which makes efficient exploration difficult and often leads to unstable learning. In this paper, we propose External Force Guided Curriculum Learning (EFGCL), a guided RL approach based on the principle of physical guidance, in which external assistive forces are introduced during training. Inspired by spotting in artistic gymnastics, EFGCL enables agents to physically experience successful motion executions without relying on task-specific reward shaping or reference trajectories. Experiments on a quadrupedal robot performing Jump, Backflip, and Lateral-Flip tasks demonstrate that EFGCL accelerates learning of the Jump task by approximately a factor of two and enables the acquisition of complex whole body motions that conventional RL methods fail to learn. We further show that the learned policies can be deployed on real robot, reproducing motions consistent with those observed in simulation. These results indicate that physically guided exploration, which allows agents to experience success early in training, is an effective and general strategy for improving learning efficiency in dynamic whole-body motion tasks.

强化学习机器人运动动态控制物理引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。