用物理模型+强化学习,让机器人跳得更稳更快。
SRL: Combining SLIP Model and Reinforcement Learning for Agile Robotic Jumping

- 结合弹簧倒立摆模型与强化学习,实现前馈+实时反馈控制
- 训练时间大幅减少,位置误差低于0.1米,速度误差在±3%内
- 适合复杂地形跳跃,支持从仿真到现实的跨域部署
机器人跳跃在搜救和物流等场景中至关重要,需跨越障碍并提升移动效率。弹簧-质量倒立摆(SLIP)模型通过简化的弹簧-质量动力学自然生成生物合理的跳跃动作,但在不规则地形上因接触和关节动力学的理想化假设导致性能下降。而强化学习(RL)虽能适应复杂环境,但通常需要大量无指导探索数据。鉴于两者优势互补,本文提出弹簧加载强化学习(SRL),将基于SLIP的前馈控制信号与RL驱动的实时反馈相结合,实现跳跃行为的持续优化。实验表明,SRL相比基线方法显著减少训练时间,平均位置跟踪误差低于0.1米,速度跟踪误差保持在目标值±3%以内。通过双足与四足机器人在地面及台阶跳跃的仿真,以及仿真到仿真、仿真到现实的验证,SRL展现出对多种任务需求和环境复杂性的强鲁棒性,具备实际部署潜力。
原文摘要 · Abstract (English)
Robotic jumping is pivotal in applications such as search and rescue and logistics, where crossing obstacles and enhancing mobility efficiency are critical. The Spring-Loaded Inverted Pendulum (SLIP) model leverages simplified spring-mass dynamics that naturally encode biologically plausible hopping motions, yet its performance degrades on irregular terrain due to idealized assumptions regarding contact and joint dynamics. Meanwhile, Reinforcement Learning (RL) can adapt to diverse and complex environments but often requires extensive data from unguided exploration. The complementary strengths of SLIP's physically grounded baseline and RL's adaptive capabilities motivate a hybrid framework that overcomes these individual limitations. We therefore propose Spring-loaded Reinforcement Learning (SRL), which integrates SLIP-based feedforward control signals with RL-driven real-time feedback, enabling continuous optimization of robotic jumping. Experimental results demonstrate that SRL can achieve more stable jumps with much less training time than the baseline method, maintaining an average position tracking error below 0.1 m and velocity tracking errors within +/-3% of the target values. Through bipedal and quadrupedal simulations of ground and stair jumping, as well as sim-to-sim and sim-to-real validations, SRL exhibits robust adaptability to various task requirements and environmental complexities, underscoring its potential for real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。