用模型预测控制引导深度学习,提升机器人安全分析的精度与效率
Bridging Model Predictive Control and Deep Learning for Scalable Reachability Analysis
- 结合MPC生成关键点近似解,指导神经网络训练
- 在40维系统上实现更准确的可达集计算,误差显著降低
- 适合需要高可靠安全验证的复杂机器人系统研究者
哈密顿-雅可比(HJ)可达性分析是保障机器人系统安全的常用方法。传统方法通过数值求解HJ偏微分方程(PDE)在网格上计算可达集,但受维度灾难影响计算成本极高。近年基于学习的方法尝试用神经网络逼近可达解,但常因残差损失信号弱导致训练不稳定、解不优。本文提出新方法,利用模型预测控制(MPC)技术引导并加速可达性学习。鉴于HJ可达性本质上源于最优控制,我们采用MPC在关键配点生成近似可达解,以约束神经网络训练;同时迭代使用学习到的可达解优化MPC解,避免陷入局部最优。在2维垂直无人机、13维四旋翼、7维F1Tenth赛车及40维发布-订阅系统上的案例研究显示,融合MPC与深度学习显著提升了可达集的鲁棒性与准确性,带来更强的安全保证。
原文摘要 · Abstract (English)
Hamilton-Jacobi (HJ) reachability analysis is a widely used method for ensuring the safety of robotic systems. Traditional approaches compute reachable sets by numerically solving an HJ Partial Differential Equation (PDE) over a grid, which is computationally prohibitive due to the curse of dimensionality. Recent learning-based methods have sought to address this challenge by approximating reachability solutions using neural networks trained with PDE residual error. However, these approaches often suffer from unstable training dynamics and suboptimal solutions due to the weak learning signal provided by the residual loss. In this work, we propose a novel approach that leverages model predictive control (MPC) techniques to guide and accelerate the reachability learning process. Observing that HJ reachability is inherently rooted in optimal control, we utilize MPC to generate approximate reachability solutions at key collocation points, which are then used to tactically guide the neural network training by ensuring compliance with these approximations. Moreover, we iteratively refine the MPC generated solutions using the learned reachability solution, mitigating convergence to local optima. Case studies on a 2D vertical drone, a 13D quadrotor, a 7D F1Tenth car, and a 40D publisher-subscriber system demonstrate that bridging MPC with deep learning yields significant improvements in the robustness and accuracy of reachable sets, as well as corresponding safety assurances, compared to existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。