用扩散模型模拟多模态动作分布,实现高速高精度机器人控制。
Diffusion-Based Approximate MPC: Fast and Consistent Imitation of Multi-Modal Action Distributions
- 用扩散模型建模多模态动作解分布,替代传统L2回归方法。
- 在7自由度机械臂上实现250Hz实时控制,速度提升70倍以上。
- 支持闭环稳定选模,适合高实时性、多解场景的机器人控制。
使用模仿学习近似模型预测控制(MPC)可避免在线求解昂贵的优化问题,实现快速控制。但基于神经网络的简单L2回归方法无法有效捕捉由局部最优或非凸约束(如障碍物)导致的多模态解分布,严重限制了其实际应用。本文提出基于扩散模型的AMPC方法,能精确表示完整解分布(即所有模式),支持高达千赫兹的采样速率。实验表明,该方法在多模态动作分布上的表现显著优于传统L2回归。与多数早期模仿学习工作不同,本方法在关节空间以更高频率(250 Hz)运行,并在去噪过程中引入梯度引导,确保闭环中稳定选择同一解模式,避免切换。同时,在并行采样后,利用原始MPC的代价与约束满足情况在线选择更优模式。在7自由度机械臂仿真与实机上验证,相较在线求解MPC提速超70倍,且成功率达甚至超过用于训练的数值优化器。
原文摘要 · Abstract (English)
Approximating model predictive control (MPC) using imitation learning (IL) allows for fast control without solving expensive optimization problems online. However, methods that use neural networks in a simple L2-regression setup fail to approximate multi-modal (set-valued) solution distributions caused by local optima found by the numerical solver or non-convex constraints, such as obstacles, significantly limiting the applicability of approximate MPC in practice. We solve this issue by using diffusion models to accurately represent the complete solution distribution (i.e., all modes) up to kilohertz sampling rates. This work shows that diffusion-based AMPC significantly outperforms L2-regression-based approximate MPC for multi-modal action distributions. In contrast to most earlier work on IL, we also focus on running the diffusion-based controller at a higher rate and in joint space instead of end-effector space. Additionally, we propose the use of gradient guidance during the denoising process to consistently pick the same mode in closed loop to prevent switching between solutions. We propose using the cost and constraint satisfaction of the original MPC problem during parallel sampling of solutions from the diffusion model to pick a better mode online. We evaluate our method on the fast and accurate control of a 7-DoF robot manipulator both in simulation and on hardware deployed at 250 Hz, achieving a speedup of more than 70 times compared to solving the MPC problem online and also outperforming the numerical optimization (used for training) in success ratio.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。