用神经网络学习可验证的收缩度量,让非线性系统稳定性分析更高效。
Neural Contraction Metrics with Formal Guarantees for Discrete-Time Nonlinear Dynamical Systems
- 将神经网络作为收缩度量,通过可验证方法分析离散非线性系统的稳定性。
- 提出新充分条件,支持连续但非光滑动态系统的正式验证。
- 适用于带ReLU神经网络控制器的系统,适合控制与验证领域研究者。
收缩度量在控制理论中至关重要,为分析各类动力系统的稳定性、鲁棒性和收敛性提供了强大框架。然而,由于缺乏可扩展且高效的方法,复杂非线性系统的收缩度量识别仍是开放难题。本文探索了针对离散时间非线性动力系统,以神经网络(NNs)参数化学习可验证收缩度量的方法。先前关于一般非线性系统收缩度量的正式验证工作多依赖凸优化方法(如线性矩阵不等式),并假设动态系统连续可微;而如今广泛使用的基于神经网络的控制器常采用ReLU激活函数,导致闭环动态非光滑,带来新挑战。为此,本文在仅假设动态连续的前提下,建立了适用于一般离散时间非线性系统的神经收缩度量的新充分条件。从计算角度,该条件可利用最先进的神经网络验证工具α,β-CROWN高效验证,该工具通过符号线性边界传播与分支定界法的创新结合,实现非凸神经网络验证的高效扩展。基于此分析工具,我们进一步开发了从采样数据中合成神经收缩度量的学习方法。最后,通过多个非线性系统的成功合成与验证,证明了方法的有效性。
原文摘要 · Abstract (English)
Contraction metrics are crucial in control theory because they provide a powerful framework for analyzing stability, robustness, and convergence of various dynamical systems. However, identifying these metrics for complex nonlinear systems remains an open challenge due to the lack of scalable and effective tools. This paper explores the approach of learning verifiable contraction metrics parametrized as neural networks (NNs) for discrete-time nonlinear dynamical systems. While prior works on formal verification of contraction metrics for general nonlinear systems have focused on convex optimization methods (e.g. linear matrix inequalities, etc) under the assumption of continuously differentiable dynamics, the growing prevalence of NN-based controllers, often utilizing ReLU activations, introduces challenges due to the non-smooth nature of the resulting closed-loop dynamics. To bridge this gap, we establish a new sufficient condition for establishing formal neural contraction metrics for general discrete-time nonlinear systems assuming only the continuity of the dynamics. We show that from a computational perspective, our sufficient condition can be efficiently verified using the state-of-the-art neural network verifier $α,\!β$-CROWN, which scales up non-convex neural network verification via novel integration of symbolic linear bound propagation and branch-and-bound. Built upon our analysis tool, we further develop a learning method for synthesizing neural contraction metrics from sampled data. Finally, our approach is validated through the successful synthesis and verification of NN contraction metrics for various nonlinear examples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。