用模仿学习压缩长时序MPC成本,让短时序控制更快更准。
ZipMPC: Compressed Context-Dependent MPC Cost via Imitation Learning
- 通过神经网络模仿长时序MPC行为,生成压缩的上下文相关成本函数。
- 在真实赛车场景中跑完圈速接近长时序基线,且在未见赛道仍有效。
- 保持低计算开销,满足约束,并可泛化到训练外环境。
模型预测控制(MPC)的计算负担限制了其在机器人等实时系统中的应用,通常需采用短预测时域,这不仅影响控制性能,还使设计能反映长期目标的成本函数变得困难。本文提出ZipMPC,通过模仿长时域MPC行为,学习一个压缩且上下文相关的短时域MPC成本函数。该方法在优化长期目标、保持近似短时域MPC的计算成本、确保约束满足以及泛化至训练中未见环境方面均优于替代方法。ZipMPC利用可微分MPC与神经网络结合,将模仿损失梯度通过MPC优化过程反传。我们在仿真和真实赛车实验中验证了该方法,结果表明,与选定基线相比,ZipMPC始终以更快速度完成赛道,其圈速接近长时域MPC基线;在短时域基线无法完赛的挑战场景中,ZipMPC仍能成功完赛,且这些优势在训练未见赛道上依然成立。
原文摘要 · Abstract (English)
The computational burden of model predictive control (MPC) limits its application on real-time systems, such as robots, and often requires the use of short prediction horizons. This not only affects the control performance, but also increases the difficulty of designing MPC cost functions that reflect the desired long-term objective. This paper proposes ZipMPC, a method that imitates a long-horizon MPC behaviour by learning a compressed and context-dependent cost function for a short-horizon MPC. It improves performance over alternative methods, such as approximate explicit MPC and automatic cost parameter tuning, in particular in terms of i) optimizing the long term objective; ii) maintaining computational costs comparable to a short-horizon MPC; iii) ensuring constraint satisfaction; and iv) generalizing control behaviour to environments not observed during training. For this purpose, ZipMPC leverages the concept of differentiable MPC with neural networks to propagate gradients of the imitation loss through the MPC optimization. We validate our proposed method in simulation and real-world experiments on autonomous racing. ZipMPC consistently completes laps faster than selected baselines, achieving lap times close to the long-horizon MPC baseline. In challenging scenarios where the short-horizon MPC baseline fails to complete a lap, ZipMPC is able to do so. In particular, these performance gains are also observed on tracks unseen during training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。