arXiv:2409.00393cs.LGcs.SY2024-09

用神经微分方程实现带稳定保证的连续时间控制,提升系统鲁棒性与推理速度。

Lyapunov Neural ODE State-Feedback Control Policies

  • 基于李雅普诺夫函数设计新型损失,使神经控制策略具备指数稳定性
  • 在等离子体医学剂量输送任务中,对初始状态扰动保持稳定且推理更快
  • 适合需要安全性和实时性的复杂非线性系统控制场景

深度神经网络在基于学习的控制范式中被广泛用于参数化控制策略。针对连续时间最优控制问题(OCPs),此类问题在诸多决策任务中至关重要,可转化为神经常微分方程(NODE)形式,自然地处理状态与控制约束。本文提出一种名为李雅普诺夫-神经微分方程控制(L-NODEC)的方法,用于将已知约束的非线性系统稳定至目标状态。该方法采用新颖的李雅普诺夫损失,融合指数稳定控制李雅普诺夫函数,学习状态反馈神经控制策略,实现了通过NODE求解连续时间OCP并保证稳定性。所提损失函数确保受控系统指数稳定,并对初始状态扰动具有对抗鲁棒性。在两个问题中验证了性能,包括等离子体医学中的剂量输送问题。在两种情况下,即便存在初始状态扰动,L-NODEC仍能有效将系统稳定至目标状态,并显著缩短达到目标所需的推理时间。

原文摘要 · Abstract (English)

Deep neural networks are increasingly used as an effective parameterization of control policies in various learning-based control paradigms. For continuous-time optimal control problems (OCPs), which are central to many decision-making tasks, control policy learning can be cast as a neural ordinary differential equation (NODE) problem wherein state and control constraints are naturally accommodated. This paper presents a NODE approach to solving continuous-time OCPs for the case of stabilizing a known constrained nonlinear system around a target state. The approach, termed Lyapunov-NODE control (L-NODEC), uses a novel Lyapunov loss formulation that incorporates an exponentially-stabilizing control Lyapunov function to learn a state-feedback neural control policy, bridging the gap of solving continuous-time OCPs via NODEs with stability guarantees. The proposed Lyapunov loss allows L-NODEC to guarantee exponential stability of the controlled system, as well as its adversarial robustness to perturbations to the initial state. The performance of L-NODEC is illustrated in two problems, including a dose delivery problem in plasma medicine. In both cases, L-NODEC effectively stabilizes the controlled system around the target state despite perturbations to the initial state and reduces the inference time necessary to reach the target.

神经微分方程控制理论李雅普诺夫稳定控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。