无需训练即可实时优化四足机器人完整动力学,实现精准带载跳跃。
Full-Order Sampling-Based MPC for Torque-Level Locomotion Control via Diffusion-Style Annealing
- 采用类扩散退火机制迭代优化,兼顾全局探索与局部收敛。
- 相比标准MPPI降低13.4倍轨迹跟踪误差,攀爬任务性能超强化学习50%。
- 首次实现实时全阶动力学控制,适合高精度运动控制场景。
由于高维性和非凸性,基于完整动力学模型的实时最优控制对足式机器人极具挑战,因此非线性模型预测控制(NMPC)常受限于简化模型。采样型MPC在非凸甚至不连续问题中展现出潜力,但通常解的质量低且方差大,限制了其在高维运动控制中的应用。本文提出DIAL-MPC(Diffusion-Inspired Annealing for Legged MPC),一种基于新型类扩散退火过程的采样型MPC框架。该退火机制基于模型预测路径积分控制(MPPI)的理论景观分析,并建立了MPPI与单步扩散模型之间的联系。算法上,DIAL-MPC在线迭代精炼解,同时实现全局覆盖与局部收敛。在四足扭矩级控制任务中,相较于标准MPPI,DIAL-MPC将轨迹跟踪误差降低13.4倍;在复杂攀爬任务中,性能优于强化学习策略50%,且无需任何训练。特别地,DIAL-MPC实现了真实世界中带负载的精确四足跳跃。据我们所知,DIAL-MPC是首个在实时中对完整四足动力学进行优化的免训练方法。
原文摘要 · Abstract (English)
Due to high dimensionality and non-convexity, real-time optimal control using full-order dynamics models for legged robots is challenging. Therefore, Nonlinear Model Predictive Control (NMPC) approaches are often limited to reduced-order models. Sampling-based MPC has shown potential in nonconvex even discontinuous problems, but often yields suboptimal solutions with high variance, which limits its applications in high-dimensional locomotion. This work introduces DIAL-MPC (Diffusion-Inspired Annealing for Legged MPC), a sampling-based MPC framework with a novel diffusion-style annealing process. Such an annealing process is supported by the theoretical landscape analysis of Model Predictive Path Integral Control (MPPI) and the connection between MPPI and single-step diffusion. Algorithmically, DIAL-MPC iteratively refines solutions online and achieves both global coverage and local convergence. In quadrupedal torque-level control tasks, DIAL-MPC reduces the tracking error of standard MPPI by $13.4$ times and outperforms reinforcement learning (RL) policies by $50\%$ in challenging climbing tasks without any training. In particular, DIAL-MPC enables precise real-world quadrupedal jumping with payload. To the best of our knowledge, DIAL-MPC is the first training-free method that optimizes over full-order quadruped dynamics in real-time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。