用可微分的混合区间分析法,让神经网络避开非凸危险区域。
Provably-Safe Neural Network Training Using Hybrid Zonotope Reachability Analysis
- 基于可缩放混合区间表示,通过混合整数线性规划实现可微碰撞检测。
- 在240个神经元的网络上验证有效,计算复杂度与神经元数量线性相关。
- 适合安全关键控制场景,如非凸输入下的闭环控制器训练。
尽管神经网络越来越多地应用于安全关键的控制任务中,但对其输出施加约束仍具挑战性,难以保证安全性。现有方法多聚焦于验证网络是否满足安全约束,却少有解决如何修正不安全网络的问题。少数能从验证中提取训练信号的方法无法处理非凸集,或过于保守、效率低下。本文提出一种神经网络训练方法,可促使带ReLU非线性的神经网络在非凸输入集下的输出精确避开非凸危险区域。该方法基于缩放混合区间可达性分析,对现有混合区间表示进行改进,支持非凸多面体集的参数化缩放,并通过混合整数线性规划(MILP)实现可微分的碰撞检测。实验表明,该方法在最多含240个神经元的网络上表现高效,计算复杂度主要由矩阵求逆决定,随神经元数量及输入/危险集复杂度线性增长。我们通过训练一个具有非凸输入集的仿射动力系统前向不变神经网络控制器,以及为黑箱动力系统生成安全避障路径,验证了该方法的实际可行性。
原文摘要 · Abstract (English)
Even though neural networks are being increasingly deployed in safety-critical control applications, it remains difficult to enforce constraints on their output, meaning that it is hard to guarantee safety in such settings. While many existing methods seek to verify a neural network's satisfaction of safety constraints, few address how to correct an unsafe network. The handful of works that extract a training signal from verification cannot handle non-convex sets, and are either conservative or slow. To begin addressing these challenges, this work proposes a neural network training method that can encourage the exact image of a non-convex input set for a neural network with rectified linear unit (ReLU) nonlinearities to avoid a non-convex unsafe region. This is accomplished by reachability analysis with scaled hybrid zonotopes, a modification of the existing hybrid zonotope set representation that enables parameterized scaling of non-convex polytopic sets with a differentiable collision check via mixed-integer linear programs (MILPs). The proposed method was shown to be effective and fast for networks with up to 240 neurons, with the computational complexity dominated by inverse operations on matrices that scale linearly in size with the number of neurons and complexity of input and unsafe sets. We demonstrate the practicality of our method by training a forward-invariant neural network controller for an affine dynamical system with a non-convex input set, as well as generating safe reach-avoid plans for a black-box dynamical system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。